mlsanityData to 7 Oct 2026

AI4D -- African Language Program

arXiv 2104.02516 ↗First posted 6 Apr 2021cs.CLcited by 18

Not on the map. Why?

Abstract (arXiv)

Advances in speech and language technologies enable tools such as voice-search, text-to-speech, speech recognition and machine translation. These are however only available for high resource languages like English, French or Chinese. Without foundational digital resources for African languages, which are considered low-resource in the digital context, these advanced tools remain out of reach. This work details the AI4D - African Language Program, a 3-part project that 1) incentivised the crowd-sourcing, collection and curation of language datasets through an online quantitative and qualitative challenge, 2) supported research fellows for a period of 3-4 months to create datasets annotated for NLP tasks, and 3) hosted competitive Machine Learning challenges on the basis of these datasets. Key outcomes of the work so far include 1) the creation of 9+ open source, African language datasets annotated for a variety of ML tasks, and 2) the creation of baseline models for these datasets through hosting of competitive ML challenges.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 6 of its 18 references that are in the map. First posted on arXiv 6 Apr 2021.

Builds on

6 of 18 references.

References · 6

  1. 2018Datasheets for Datasetscited by 1,371
  2. 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
  3. 2020Masakhane -- Machine Translation For Africacited by 48
  4. 2020Improving Yor`ub'a Diacritic Restorationcited by 5
  5. 2020AI4D -- African Language Dataset Challengecited by 5
  6. 2020Neural Machine Translation for South Africa's Official Languagescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 4; 2024: 5; 2025: 4; 2026: 2.

18 papers.

Sort:

By area:

  1. 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 174
  2. 2022A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translationcited by 97
  3. 2022Bitext Mining Using Distilled Sentence Representations for Low-Resource Languagescited by 48
  4. 2023GlotLID: Language Identification for Low-Resource Languagescited by 37
  5. 2023AfriSpeech-200: Pan-African Accented Speech Dataset for Clinical and General Domain ASRcited by 34
  6. 2023MasakhaPOS: Part-of-Speech Tagging for Typologically Diverse African Languagescited by 23
  7. 2024GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languagescited by 15
  8. 2022Kencorpus: A Kenyan Language Corpus of Swahili, Dholuo and Luhya for Natural Language Processing Taskscited by 9
  9. 2023AfriNames: Most ASR models "butcher" African Namescited by 7
  10. 2024State of NLP in Kenya: A Surveycited by 7
  11. 2024A Systematic Review of NLP for Ghanaian Languages: Datasets, Models, and a Research Roadmapcited by 5
  12. 2024Monolingual and Multilingual Misinformation Detection for Low-Resource Languages: A Comprehensive Surveycited by 4
6 more
  1. 2025Voice of a Continent: Mapping Africa's Speech Technology Frontiercited by 4
  2. 2025Detection of Somali-written Fake News and Toxic Messages on the Social Media Using Transformer-based Language Modelscited by 0
  3. 2025Redefining technology for indigenous languagescited by 0
  4. 2025The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLPcited by 0
  5. 2026The Annotation Scarcity Paradox in Low-Resource NLP Evaluation: A Decade of Acceleration and Emerging Constraintscited by 0
  6. 2026A Survey of Text and Speech Resources for Hausa and Fongbe: Availability, Quality, and Gaps for NLP Developmentcited by 0