mlsanityData to 14 Oct 2026

Synthetic Voice Data for Automatic Speech Recognition in African Languages

arXiv 2507.17578 ↗First posted 23 Jul 2025cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Speech technology remains out of reach for most of the over 2300 languages in Africa. We present the first systematic assessment of large-scale synthetic voice corpora for African ASR. We apply a three-step process: LLM-driven text creation, TTS voice synthesis, and ASR fine-tuning. Eight out of ten languages for which we create synthetic text achieved readability scores above 5 out of 7. We evaluated ASR improvement for three (Hausa, Dholuo, Chichewa) and created more than 2,500 hours of synthetic voice data at below 1% of the cost of real data. Fine-tuned Wav2Vec-BERT-2.0 models trained on 250h real and 250h synthetic Hausa matched a 500h real-data-only baseline, while 579h real and 450h to 993h synthetic data created the best performance. We also present gender-disaggregated ASR performance evaluation. For very low-resource languages, gains varied: Chichewa WER improved about 6.5% relative with a 1:2 real-to-synthetic ratio; a 1:1 ratio for Dholuo showed similar improvements on some evaluation data, but not on others. Investigating intercoder reliability, ASR errors and evaluation datasets revealed the need for more robust reviewer protocols and more accurate evaluation data. All data and models are publicly released to invite further work to improve synthetic data for African languages.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 38 of its 61 references that are in the map. First posted on arXiv 23 Jul 2025.

Builds on

38 of 61 references.

References · 38

  1. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  2. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
  3. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  4. 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
  5. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  6. 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 356
  7. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
  8. 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 278
  9. 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 243
  10. 2022Will we run out of data? Limits of LLM scaling based on human-generated datacited by 195
  11. 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 192
  12. 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
26 more
  1. 2018Model Evaluation, Model Selection, and Algorithm Selection in Machine Learningcited by 157
  2. 2023SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectscited by 152
  3. 2024How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapsecited by 79
  4. 2023Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMscited by 64
  5. 2024On the Diversity of Synthetic Data and its Impact on Training Large Language Modelscited by 59
  6. 2024Fairness Feedback Loops: Training on Synthetic Data Amplifies Biascited by 55
  7. 2020LRSpeech: Extremely Low-Resource Speech Synthesis and Recognitioncited by 43
  8. 2024PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Datacited by 37
  9. 2024Can LLM Generate Culturally Relevant Commonsense QA Data? Case Study in Indonesian and Sundanesecited by 36
  10. 2021Synt++: Utilizing Imperfect Synthetic Data to Improve Speech Recognitioncited by 24
  11. 2023Zambezi Voice: A Multilingual Speech Corpus for Zambian Languagescited by 18
  12. 2025Jawaher: A Multidialectal Dataset of Arabic Proverbs for LLM Benchmarkingcited by 18
  13. 2023CML-TTS A Multilingual Dataset for Speech Synthesis in Low-Resource Languagescited by 15
  14. 2024Correcting FLORES Evaluation Dataset for Four African Languagescited by 13
  15. 2024What is lost in Normalization? Exploring Pitfalls in Multilingual ASR Model Evaluationscited by 13
  16. 2024Bias Amplification: Large Language Models as Increasingly Biased Mediacited by 12
  17. 2024Enhancing Low-Resource ASR through Versatile TTS: Bridging the Data Gapcited by 12
  18. 20241000 African Voices: Advancing inclusive multi-speaker multi-accent speech synthesiscited by 9
  19. 2024Leveraging Synthetic Audio Data for End-to-End Low-Resource Speech Translationcited by 9
  20. 2022Text-To-Speech Data Augmentation for Low Resource Speech Recognitioncited by 6
  21. 2022Separating Grains from the Chaff: Using Data Filtering to Improve Multilingual Translation for Low-Resourced African Languagescited by 6
  22. 2024Diverse and Effective Synthetic Data Generation for Adaptable Zero-Shot Dialogue State Trackingcited by 6
  23. 2021A Toolbox for Construction and Analysis of Speech Datasetscited by 5
  24. 2023Text Generation with Speech Synthesis for ASR Data Augmentationcited by 5
  25. 2025Recognizing Every Voice: Towards Inclusive ASR for Rural Bhojpuri Womencited by 3
  26. 2024ANGOFA: Leveraging OFA Embedding Initialization and Synthetic Data for Angolan Language Modelcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.