The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLP
Not on the map. Why?
Abstract (arXiv)
Despite representing nearly one-third of the world's languages, African languages remain critically underserved by modern NLP technologies, with 88% classified as severely underrepresented or completely ignored in computational linguistics. We present the African Languages Lab (All Lab), a comprehensive research initiative that addresses this technological gap through systematic data collection, model development, and capacity building. Our contributions include: (1) a quality-controlled data collection pipeline, yielding the largest validated African multi-modal speech and text dataset spanning 40 languages with 19 billion tokens of monolingual text and 12,628 hours of aligned speech data; (2) extensive experimental validation demonstrating that our dataset, combined with fine-tuning, achieves substantial improvements over baseline models, averaging +23.69 ChrF++, +0.33 COMET, and +15.34 BLEU points across 31 evaluated languages; and (3) a structured research program that has successfully mentored fifteen early-career researchers, establishing sustainable local capacity. Our comparative evaluation against Google Translate reveals competitive performance in several languages while identifying areas that require continued development.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 65 references that are in the map. First posted on arXiv 7 Oct 2025.
Builds on
40 of 65 references.
References · 40
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
- 2022A Survey on In-context Learningcited by 717
- 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
28 more
- 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 275
- 2024Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluationcited by 181
- 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
- 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
- 2019CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairscited by 136
- 2020When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Modelscited by 131
- 2023Glot500: Scaling Multilingual Corpora and Language Models to 500 Languagescited by 116
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
- 2020Low-resource Languages: A Review of Past Work and Future Challengescited by 90
- 2019Beyond BLEU: Training Neural Machine Translation with Semantic Similaritycited by 84
- 2023AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languagescited by 68
- 2022NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysiscited by 64
- 2025Can LLMs Replace Human Evaluators? An Empirical Study of LLM-as-a-Judge in Software Engineeringcited by 64
- 2020Masakhane -- Machine Translation For Africacited by 48
- 2022Towards Afrocentric NLP for African Languages: Where We Are and Where We Can Gocited by 46
- 2022AfroLM: A Self-Active Learning-based Multilingual Pretrained Language Model for 23 African Languagescited by 46
- 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Modelscited by 43
- 2022SERENGETI: Massively Multilingual Language Models for Africacited by 40
- 2021AfroMT: Pretraining Strategies and Reproducible Benchmarks for Translation of 8 African Languagescited by 24
- 2023AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languagescited by 24
- 2021AI4D -- African Language Programcited by 18
- 2021XLEnt: Mining a Large Cross-lingual Entity Dataset with Lexical-Semantic-Phonetic Word Alignmentcited by 15
- 2024Cheetah: Natural Language Generation for 517 African Languagescited by 15
- 2022Kencorpus: A Kenyan Language Corpus of Swahili, Dholuo and Luhya for Natural Language Processing Taskscited by 9
- 2020Lanfrica: A Participatory Approach to Documenting Machine Translation Research on African Languagescited by 7
- 2024State of NLP in Kenya: A Surveycited by 7
- 2024A Systematic Review of NLP for Ghanaian Languages: Datasets, Models, and a Research Roadmapcited by 5
- 2023AfroDigits: A Community-Driven Spoken Digit Dataset for African Languagescited by 4
Built on by
Not cited yet.