mlsanityData to 14 Oct 2026

Open Universal Arabic ASR Leaderboard

arXiv 2412.13788 ↗First posted 18 Dec 2024cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

In recent years, the enhanced capabilities of ASR models and the emergence of multi-dialect datasets have increasingly pushed Arabic ASR model development toward an all-dialect-in-one direction. This trend highlights the need for benchmarking studies that evaluate model performance on multiple dialects, providing the community with insights into models' generalization capabilities. In this paper, we introduce Open Universal Arabic ASR Leaderboard, a continuous benchmark project for open-source general Arabic ASR models across various multi-dialect datasets. We also provide a comprehensive analysis of the model's robustness, speaker adaptation, inference efficiency, and memory consumption. This work aims to offer the Arabic ASR community a reference for models' general performance and also establish a common evaluation framework for multi-dialectal Arabic ASR models.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 18 Dec 2024.

Builds on

22 of 31 references.

References · 22

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  3. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  4. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  5. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  6. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  7. 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 727
  8. 2020Unsupervised Cross-lingual Representation Learning for Speech Recognitioncited by 501
  9. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
  10. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  11. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 347
  12. 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 235
10 more
  1. 2023SeamlessM4T: Massively Multilingual & Multimodal Machine Translationcited by 125
  2. 2023Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognitioncited by 124
  3. 2017Speech Recognition Challenge in the Wild: Arabic MGB-3cited by 60
  4. 2024Open-Source Conversational AI with SpeechBrain 1.0cited by 56
  5. 2021Towards One Model to Rule All: Multilingual Strategy for Dialectal Code-Switching Arabic ASRcited by 41
  6. 2021QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpuscited by 38
  7. 2023Stateful Conformer with Cache-based Inference for Streaming Automatic Speech Recognitioncited by 25
  8. 2023N-Shot Benchmarking of Whisper on Diverse Arabic Speech Recognitioncited by 20
  9. 2024Casablanca: Data and Models for Multidialectal Arabic Speech Recognitioncited by 20
  10. 2023LAraBench: Benchmarking Arabic AI with Large Language Modelscited by 16

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.

  1. 2025ASR-FAIRBENCH: Measuring and Benchmarking Equity Across Speech Recognition Systemscited by 4
  2. 2025Advancing Arabic Speech Recognition Through Large-Scale Weakly Supervised Learningcited by 2
  3. 2025Flavors of Moonshine: Tiny Specialized ASR Models for Edge Devicescited by 2
  4. 2025Arabic ASR on the SADA Large-Scale Arabic Speech Corpus with Transformer-Based Modelscited by 0