mlsanityData to 14 Oct 2026

Towards One Model to Rule All: Multilingual Strategy for Dialectal Code-Switching Arabic ASR

arXiv 2105.14779 ↗First posted 31 May 2021cs.CL cs.HC cs.SDcited by 41

Not on the map. Why?

Abstract (arXiv)

With the advent of globalization, there is an increasing demand for multilingual automatic speech recognition (ASR), handling language and dialectal variation of spoken content. Recent studies show its efficacy over monolingual systems. In this study, we design a large multilingual end-to-end ASR using self-attention based conformer architecture. We trained the system using Arabic (Ar), English (En) and French (Fr) languages. We evaluate the system performance handling: (i) monolingual (Ar, En and Fr); (ii) multi-dialectal (Modern Standard Arabic, along with dialectal variation such as Egyptian and Moroccan); (iii) code-switching -- cross-lingual (Ar-En/Fr) and dialectal (MSA-Egyptian dialect) test cases, and compare with current state-of-the-art systems. Furthermore, we investigate the influence of different embedding/character representations including character vs word-piece; shared vs distinct input symbol per language. Our findings demonstrate the strength of such a model by outperforming state-of-the-art monolingual dialectal Arabic and code-switching Arabic ASR.

Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). Builds on 15 of its 42 references that are in the map. First posted on arXiv 31 May 2021.

Builds on

15 of 42 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  4. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  5. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
  6. 2015Listen, Attend and Spellcited by 543
  7. 2020Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameterscited by 110
  8. 2019Large-Scale Multilingual Speech Recognition with a Streaming End-to-End Modelcited by 93
  9. 2017Multilingual Speech Recognition With A Single End-To-End Modelcited by 87
  10. 2017Speech Recognition Challenge in the Wild: Arabic MGB-3cited by 60
  11. 2018Bytes are All You Need: End-to-End Multilingual Speech Recognition and Synthesis with Bytescited by 54
  12. 2018Multilingual sequence-to-sequence speech recognition: architecture, transfer learning, and language modelingcited by 34
3 more
  1. 2020Multi-Encoder-Decoder Transformer for Code-Switching Speech Recognitioncited by 28
  2. 2020Language-agnostic Multilingual Modelingcited by 17
  3. 2021Arabic Speech Recognition by End-to-End, Modular Systems and Humancited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 5; 2022: 5; 2023: 12; 2024: 4; 2025: 8; 2026: 7.

41 papers.

Sort:

By area:

  1. 2021ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversationcited by 44
  2. 2021QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpuscited by 38
  3. 2022The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challengescited by 35
  4. 2023Can Whisper perform speech-based in-context learning?cited by 35
  5. 2023N-Shot Benchmarking of Whisper on Diverse Arabic Speech Recognitioncited by 20
  6. 2021Arabic Code-Switching Speech Recognition using Monolingual Datacited by 17
  7. 2023LAraBench: Benchmarking Arabic AI with Large Language Modelscited by 16
  8. 2023Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparationcited by 16
  9. 2022ArzEn-ST: A Three-way Speech Translation Corpus for Code-Switched Egyptian Arabic - Englishcited by 13
  10. 2025CS-FLEURS: A Massively Multilingual and Code-Switched Speech Datasetcited by 12
  11. 2022Textual Data Augmentation for Arabic-English Code-Switching Speech Recognitioncited by 10
  12. 2023Speech collage: code-switched audio generation by collaging monolingual corporacited by 10
29 more
  1. 2024ZAEBUC-Spoken: A Multilingual Multidialectal Arabic-English Speech Corpuscited by 10
  2. 2021What do End-to-End Speech Models Learn about Speaker, Language and Channel Information? A Layer-wise and Neuron-level Analysiscited by 9
  3. 2023Automatic Pronunciation Assessment -- A Reviewcited by 7
  4. 2022Benchmarking Evaluation Metrics for Code-Switching Automatic Speech Recognitioncited by 5
  5. 2023Multilingual Word Error Rate Estimation: e-WER3cited by 5
  6. 2025A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directionscited by 5
  7. 2025Can we train ASR systems on Code-switch without real code-switch data? Case study for Singapore's languagescited by 5
  8. 2023Pseudo-Labeling for Domain-Agnostic Bangla Automatic Speech Recognitioncited by 4
  9. 2024To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillationcited by 4
  10. 2024Open Universal Arabic ASR Leaderboardcited by 4
  11. 2025Code-Switching in End-to-End Automatic Speech Recognition: A Systematic Literature Reviewcited by 4
  12. 2023VoxArabica: A Robust Dialect-Aware Arabic Speech Recognition Systemcited by 3
  13. 2023Data Augmentation Techniques for Machine Translation of Code-Switched Texts: A Comparative Studycited by 3
  14. 2025TEDxTN: A Three-way Speech Translation Corpus for Code-Switched Tunisian Arabic - Englishcited by 3
  15. 2026Multi-Task Instruction Tuning via Data Scheduling for Low-Resource Arabic SpeechLLMscited by 3
  16. 2023Simple yet Effective Code-Switching Language Identification with Multitask Pre-Training and Transfer Learningcited by 2
  17. 2025Flavors of Moonshine: Tiny Specialized ASR Models for Edge Devicescited by 2
  18. 2021Balanced End-to-End Monolingual pre-training for Low-Resourced Indic Languages Code-Switching Speech Recognitioncited by 1
  19. 2022The Who in Code-Switching: A Case Study for Predicting Egyptian Arabic-English Code-Switching Levels based on Character Profilescited by 1
  20. 2025Open Automatic Speech Recognition Models for Classical and Modern Standard Arabiccited by 1
  21. 2026WASIL: In-the-Wild Arabic Spoken Interactions with LLMscited by 1
  22. 2026Bulbul: A Dataset for Dialectal Arabic Speech Recognitioncited by 1
  23. 2023MyVoice: Arabic Speech Resource Collaboration Platformcited by 0
  24. 2024Empowering the Deaf and Hard of Hearing Community: Enhancing Video Captions Using Large Language Modelscited by 0
  25. 2025Arabic ASR on the SADA Large-Scale Arabic Speech Corpus with Transformer-Based Modelscited by 0
  26. 2026CV-18 NER: Augmented Common Voice for Named Entity Recognition from Arabic Speechcited by 0
  27. 2026When Multiple Scripts Matter: Evaluating ASR in Clinical Settingscited by 0
  28. 2026Adding Robust Code-Switching Capabilities to High Performance Multilingual ASRcited by 0
  29. 2026Child ASR Adaptation with Adult Retention: An Empirical Studycited by 0