Synthetic Voice Data for Automatic Speech Recognition in African Languages
Not on the map. Why?
Abstract (arXiv)
Speech technology remains out of reach for most of the over 2300 languages in Africa. We present the first systematic assessment of large-scale synthetic voice corpora for African ASR. We apply a three-step process: LLM-driven text creation, TTS voice synthesis, and ASR fine-tuning. Eight out of ten languages for which we create synthetic text achieved readability scores above 5 out of 7. We evaluated ASR improvement for three (Hausa, Dholuo, Chichewa) and created more than 2,500 hours of synthetic voice data at below 1% of the cost of real data. Fine-tuned Wav2Vec-BERT-2.0 models trained on 250h real and 250h synthetic Hausa matched a 500h real-data-only baseline, while 579h real and 450h to 993h synthetic data created the best performance. We also present gender-disaggregated ASR performance evaluation. For very low-resource languages, gains varied: Chichewa WER improved about 6.5% relative with a 1:2 real-to-synthetic ratio; a 1:1 ratio for Dholuo showed similar improvements on some evaluation data, but not on others. Investigating intercoder reliability, ASR errors and evaluation datasets revealed the need for more robust reviewer protocols and more accurate evaluation data. All data and models are publicly released to invite further work to improve synthetic data for African languages.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 38 of its 61 references that are in the map. First posted on arXiv 23 Jul 2025.
Builds on
38 of 61 references.
References · 38
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
- 2022FLEURS: Few-shot Learning Evaluation of Universal Representations of Speechcited by 469
- 2023Scaling Speech Technology to 1,000+ Languagescited by 411
- 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 356
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
- 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 278
- 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 243
- 2022Will we run out of data? Limits of LLM scaling based on human-generated datacited by 195
- 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 192
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
26 more
- 2018Model Evaluation, Model Selection, and Algorithm Selection in Machine Learningcited by 157
- 2023SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectscited by 152
- 2024How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapsecited by 79
- 2023Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMscited by 64
- 2024On the Diversity of Synthetic Data and its Impact on Training Large Language Modelscited by 59
- 2024Fairness Feedback Loops: Training on Synthetic Data Amplifies Biascited by 55
- 2020LRSpeech: Extremely Low-Resource Speech Synthesis and Recognitioncited by 43
- 2024PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Datacited by 37
- 2024Can LLM Generate Culturally Relevant Commonsense QA Data? Case Study in Indonesian and Sundanesecited by 36
- 2021Synt++: Utilizing Imperfect Synthetic Data to Improve Speech Recognitioncited by 24
- 2023Zambezi Voice: A Multilingual Speech Corpus for Zambian Languagescited by 18
- 2025Jawaher: A Multidialectal Dataset of Arabic Proverbs for LLM Benchmarkingcited by 18
- 2023CML-TTS A Multilingual Dataset for Speech Synthesis in Low-Resource Languagescited by 15
- 2024Correcting FLORES Evaluation Dataset for Four African Languagescited by 13
- 2024What is lost in Normalization? Exploring Pitfalls in Multilingual ASR Model Evaluationscited by 13
- 2024Bias Amplification: Large Language Models as Increasingly Biased Mediacited by 12
- 2024Enhancing Low-Resource ASR through Versatile TTS: Bridging the Data Gapcited by 12
- 20241000 African Voices: Advancing inclusive multi-speaker multi-accent speech synthesiscited by 9
- 2024Leveraging Synthetic Audio Data for End-to-End Low-Resource Speech Translationcited by 9
- 2022Text-To-Speech Data Augmentation for Low Resource Speech Recognitioncited by 6
- 2022Separating Grains from the Chaff: Using Data Filtering to Improve Multilingual Translation for Low-Resourced African Languagescited by 6
- 2024Diverse and Effective Synthetic Data Generation for Adaptable Zero-Shot Dialogue State Trackingcited by 6
- 2021A Toolbox for Construction and Analysis of Speech Datasetscited by 5
- 2023Text Generation with Speech Synthesis for ASR Data Augmentationcited by 5
- 2025Recognizing Every Voice: Towards Inclusive ASR for Rural Bhojpuri Womencited by 3
- 2024ANGOFA: Leveraging OFA Embedding Initialization and Synthetic Data for Angolan Language Modelcited by 2
Built on by
Citing papers per year: 2025: 3.
3 papers.
- 2025Cost Analysis of Human-corrected Transcription for Predominately Oral Languagescited by 3
- 2025Kunnafonidilaw ka Cadeau: an ASR dataset of present-day Bambaracited by 2
- 2025Opportunities and Challenges of Natural Language Processing for Low-Resource Senegalese Languages in Social Science Researchcited by 0
- 2025Opportunities and Challenges of Natural Language Processing for Low-Resource Senegalese Languages in Social Science Research24 Dec 2025
- 2025Kunnafonidilaw ka Cadeau: an ASR dataset of present-day Bambara22 Dec 2025
- 2025Cost Analysis of Human-corrected Transcription for Predominately Oral Languages14 Oct 2025