Textual Data Augmentation for Arabic-English Code-Switching Speech Recognition
Not on the map. Why?
Abstract (arXiv)
The pervasiveness of intra-utterance code-switching (CS) in spoken content requires that speech recognition (ASR) systems handle mixed language. Designing a CS-ASR system has many challenges, mainly due to data scarcity, grammatical structure complexity, and domain mismatch. The most common method for addressing CS is to train an ASR system with the available transcribed CS speech, along with monolingual data. In this work, we propose a zero-shot learning methodology for CS-ASR by augmenting the monolingual data with artificially generating CS text. We based our approach on random lexical replacements and Equivalence Constraint (EC) while exploiting aligned translation pairs to generate random and grammatically valid CS content. Our empirical results show a 65.5% relative reduction in language model perplexity, and 7.7% in ASR WER on two ecologically valid CS test sets. The human evaluation of the generated text using EC suggests that more than 80% is of adequate quality.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 11 of its 39 references that are in the map. First posted on arXiv 7 Jan 2022.
Builds on
11 of 39 references.
References · 11
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
- 2018TED-LIUM 3: twice as much data and corpus repartition for experiments on speaker adaptationcited by 224
- 2021Word Alignment by Fine-tuning Embeddings on Parallel Corporacited by 186
- 2020CoSDA-ML: Multi-Lingual Code-Switching Data Augmentation for Zero-Shot Cross-Lingual NLPcited by 79
- 2017Speech Recognition Challenge in the Wild: Arabic MGB-3cited by 60
- 2019Code-Switched Language Models Using Neural Based Synthetic Data from Parallel Sentencescited by 55
- 2021Towards One Model to Rule All: Multilingual Strategy for Dialectal Code-Switching Arabic ASRcited by 40
- 2021QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpuscited by 38
- 2021Arabic Code-Switching Speech Recognition using Monolingual Datacited by 17
- 2021Investigations on Speech Recognition Systems for Low-Resource Dialectal Arabic-English Code-Switching Speechcited by 15
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 1; 2025: 4.
10 papers.
- 2022Investigating Lexical Replacements for Arabic-English Code-Switched Data Augmentationcited by 9
- 2023Speech collage: code-switched audio generation by collaging monolingual corporacited by 9
- 2025A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directionscited by 5
- 2023Data Augmentation Techniques for Machine Translation of Code-Switched Texts: A Comparative Studycited by 3
- 2023Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentationcited by 2
- 2024Gated Low-rank Adaptation for personalized Code-Switching Automatic Speech Recognition on the low-spec devicescited by 2
- 2025Adapting Language Balance in Code-Switching Speechcited by 2
- 2023Simple yet Effective Code-Switching Language Identification with Multitask Pre-Training and Transfer Learningcited by 1
- 2025The Impact of Code-switched Synthetic Data Quality is Task Dependent: Insights from MT and ASRcited by 1
- 2025Bayesian Low-Rank Factorization for Robust Model Adaptationcited by 1
- 2025Adapting Language Balance in Code-Switching Speech21 Oct 2025
- 2025Bayesian Low-Rank Factorization for Robust Model Adaptation21 Oct 2025
- 2025The Impact of Code-switched Synthetic Data Quality is Task Dependent: Insights from MT and ASR30 Mar 2025
- 2025A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directions23 Jan 2025
- 2024Gated Low-rank Adaptation for personalized Code-Switching Automatic Speech Recognition on the low-spec devices24 Apr 2024
- 2023Data Augmentation Techniques for Machine Translation of Code-Switched Texts: A Comparative Study23 Oct 2023
- 2023Speech collage: code-switched audio generation by collaging monolingual corpora27 Sep 2023
- 2023Improving Code-Switching and Named Entity Recognition in ASR with Speech Editing based Data Augmentation14 Jun 2023
- 2023Simple yet Effective Code-Switching Language Identification with Multitask Pre-Training and Transfer Learning31 May 2023
- 2022Investigating Lexical Replacements for Arabic-English Code-Switched Data Augmentation25 May 2022