mlsanityData to 7 Oct 2026

VoxArabica: A Robust Dialect-Aware Arabic Speech Recognition System

arXiv 2310.11069 ↗First posted 17 Oct 2023cs.CL cs.SD eess.AScited by 3

Not on the map. Why?

Abstract (arXiv)

Arabic is a complex language with many varieties and dialects spoken by over 450 millions all around the world. Due to the linguistic diversity and variations, it is challenging to build a robust and generalized ASR system for Arabic. In this work, we address this gap by developing and demoing a system, dubbed VoxArabica, for dialect identification (DID) as well as automatic speech recognition (ASR) of Arabic. We train a wide range of models such as HuBERT (DID), Whisper, and XLS-R (ASR) in a supervised setting for Arabic DID and ASR tasks. Our DID models are trained to identify 17 different dialects in addition to MSA. We finetune our ASR models on MSA, Egyptian, Moroccan, and mixed data. Additionally, for the remaining dialects in ASR, we provide the option to choose various models such as Whisper and MMS in a zero-shot setting. We integrate these models into a single web interface with diverse features such as audio recording, file upload, model selection, and the option to raise flags for incorrect outputs. Overall, we believe VoxArabica will be useful for a wide range of audiences concerned with Arabic research. Our system is currently running at https://cdce-206-12-100-168.ngrok.io/.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 21 of its 46 references that are in the map. First posted on arXiv 17 Oct 2023.

Builds on

21 of 46 references.

References · 21

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  4. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  5. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  6. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 458
  7. 2023Scaling Speech Technology to 1,000+ Languagescited by 401
  8. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 340
  9. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 228
  10. 2017Speech Recognition Challenge in the Wild: Arabic MGB-3cited by 60
  11. 2020NADI 2020: The First Nuanced Arabic Dialect Identification Shared Taskcited by 47
  12. 2021Towards One Model to Rule All: Multilingual Strategy for Dialectal Code-Switching Arabic ASRcited by 40
9 more
  1. 2021NADI 2021: The Second Nuanced Arabic Dialect Identification Shared Taskcited by 32
  2. 2022NADI 2022: The Third Nuanced Arabic Dialect Identification Shared Taskcited by 23
  3. 2023N-Shot Benchmarking of Whisper on Diverse Arabic Speech Recognitioncited by 20
  4. 2019Analyzing Phonetic and Graphemic Representations in End-to-End Automatic Speech Recognitioncited by 16
  5. 2023On the Robustness of Arabic Speech Dialect Identificationcited by 13
  6. 2021Arabic Speech Recognition by End-to-End, Modular Systems and Humancited by 12
  7. 2022There is more than one kind of robustness: Fooling Whisper with adversarial examplescited by 11
  8. 2021Multi-Dialect Arabic Speech Recognitioncited by 5
  9. 2018Insights into End-to-End Learning Scheme for Language Identificationcited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.

  1. 2024To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillationcited by 4
  2. 2025ADI-20: Arabic Dialect Identification dataset and modelscited by 3
  3. 2025Voice Conversion Improves Cross-Domain Robustness for Spoken Arabic Dialect Identificationcited by 0