Advancing Arabic Speech Recognition Through Large-Scale Weakly Supervised Learning
Not on the map. Why?
Abstract (arXiv)
Automatic speech recognition (ASR) is crucial for human-machine interaction in diverse applications like conversational agents, industrial robotics, call center automation, and automated subtitling. However, developing high-performance ASR models remains challenging, particularly for low-resource languages like Arabic, due to the scarcity of large, labeled speech datasets, which are costly and labor-intensive to produce. In this work, we employ weakly supervised learning to train an Arabic ASR model using the Conformer architecture. Our model is trained from scratch on 15,000 hours of weakly annotated speech data covering both Modern Standard Arabic (MSA) and Dialectal Arabic (DA), eliminating the need for costly manual transcriptions. Despite the absence of human-verified labels, our approach achieves state-of-the-art (SOTA) results in Arabic ASR, surpassing both open and closed-source models on standard benchmarks. By demonstrating the effectiveness of weak supervision as a scalable, cost-efficient alternative to traditional supervised approaches, paving the way for improved ASR systems in low resource settings.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 17 of its 34 references that are in the map. First posted on arXiv 16 Apr 2025.
Builds on
17 of 34 references.
References · 17
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2021GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audiocited by 399
- 2021The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usagecited by 101
- 2020Rethinking Evaluation in ASR: Are Our Models Robust Enough?cited by 73
- 2024Automatic Speech Recognition using Advanced Deep Learning Approaches: A surveycited by 50
- 2018Toward domain-invariant speech recognition via large scale trainingcited by 35
- 2023Deep Transfer Learning for Automatic Speech Recognition: Towards Better Generalizationcited by 28
- 2020Exploring Transformers for Large-Scale Speech Recognitioncited by 24
- 2024Casablanca: Data and Models for Multidialectal Arabic Speech Recognitioncited by 20
5 more
- 2021Arabic Speech Recognition by End-to-End, Modular Systems and Humancited by 12
- 2020Transformer in action: a comparative study of transformer-based acoustic models for large scale speech recognition applicationscited by 11
- 2023Learning from Flawed Data: Weakly Supervised Automatic Speech Recognitioncited by 8
- 2024Open Universal Arabic ASR Leaderboardcited by 4
- 2019DARTS: Dialectal Arabic Transcription Systemcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.