mlsanityData to 7 Oct 2026

The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLP

arXiv 2510.05644 ↗First posted 7 Oct 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite representing nearly one-third of the world's languages, African languages remain critically underserved by modern NLP technologies, with 88% classified as severely underrepresented or completely ignored in computational linguistics. We present the African Languages Lab (All Lab), a comprehensive research initiative that addresses this technological gap through systematic data collection, model development, and capacity building. Our contributions include: (1) a quality-controlled data collection pipeline, yielding the largest validated African multi-modal speech and text dataset spanning 40 languages with 19 billion tokens of monolingual text and 12,628 hours of aligned speech data; (2) extensive experimental validation demonstrating that our dataset, combined with fine-tuning, achieves substantial improvements over baseline models, averaging +23.69 ChrF++, +0.33 COMET, and +15.34 BLEU points across 31 evaluated languages; and (3) a structured research program that has successfully mentored fifteen early-career researchers, establishing sustainable local capacity. Our comparative evaluation against Google Translate reveals competitive performance in several languages while identifying areas that require continued development.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 65 references that are in the map. First posted on arXiv 7 Oct 2025.

Builds on

40 of 65 references.

References · 40

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  4. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  5. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  6. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  7. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  8. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  9. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  10. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  11. 2022A Survey on In-context Learningcited by 717
  12. 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
28 more
  1. 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 275
  2. 2024Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluationcited by 181
  3. 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
  4. 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
  5. 2019CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairscited by 136
  6. 2020When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Modelscited by 131
  7. 2023Glot500: Scaling Multilingual Corpora and Language Models to 500 Languagescited by 116
  8. 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
  9. 2020Low-resource Languages: A Review of Past Work and Future Challengescited by 90
  10. 2019Beyond BLEU: Training Neural Machine Translation with Semantic Similaritycited by 84
  11. 2023AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languagescited by 68
  12. 2022NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysiscited by 64
  13. 2025Can LLMs Replace Human Evaluators? An Empirical Study of LLM-as-a-Judge in Software Engineeringcited by 64
  14. 2020Masakhane -- Machine Translation For Africacited by 48
  15. 2022Towards Afrocentric NLP for African Languages: Where We Are and Where We Can Gocited by 46
  16. 2022AfroLM: A Self-Active Learning-based Multilingual Pretrained Language Model for 23 African Languagescited by 46
  17. 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Modelscited by 43
  18. 2022SERENGETI: Massively Multilingual Language Models for Africacited by 40
  19. 2021AfroMT: Pretraining Strategies and Reproducible Benchmarks for Translation of 8 African Languagescited by 24
  20. 2023AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languagescited by 24
  21. 2021AI4D -- African Language Programcited by 18
  22. 2021XLEnt: Mining a Large Cross-lingual Entity Dataset with Lexical-Semantic-Phonetic Word Alignmentcited by 15
  23. 2024Cheetah: Natural Language Generation for 517 African Languagescited by 15
  24. 2022Kencorpus: A Kenyan Language Corpus of Swahili, Dholuo and Luhya for Natural Language Processing Taskscited by 9
  25. 2020Lanfrica: A Participatory Approach to Documenting Machine Translation Research on African Languagescited by 7
  26. 2024State of NLP in Kenya: A Surveycited by 7
  27. 2024A Systematic Review of NLP for Ghanaian Languages: Datasets, Models, and a Research Roadmapcited by 5
  28. 2023AfroDigits: A Community-Driven Spoken Digit Dataset for African Languagescited by 4

Built on by

Not cited yet.