AI4D -- African Language Program
Not on the map. Why?
Abstract (arXiv)
Advances in speech and language technologies enable tools such as voice-search, text-to-speech, speech recognition and machine translation. These are however only available for high resource languages like English, French or Chinese. Without foundational digital resources for African languages, which are considered low-resource in the digital context, these advanced tools remain out of reach. This work details the AI4D - African Language Program, a 3-part project that 1) incentivised the crowd-sourcing, collection and curation of language datasets through an online quantitative and qualitative challenge, 2) supported research fellows for a period of 3-4 months to create datasets annotated for NLP tasks, and 3) hosted competitive Machine Learning challenges on the basis of these datasets. Key outcomes of the work so far include 1) the creation of 9+ open source, African language datasets annotated for a variety of ML tasks, and 2) the creation of baseline models for these datasets through hosting of competitive ML challenges.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 6 of its 18 references that are in the map. First posted on arXiv 6 Apr 2021.
Builds on
6 of 18 references.
References · 6
- 2018Datasheets for Datasetscited by 1,371
- 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
- 2020Masakhane -- Machine Translation For Africacited by 48
- 2020Improving Yor`ub'a Diacritic Restorationcited by 5
- 2020AI4D -- African Language Dataset Challengecited by 5
- 2020Neural Machine Translation for South Africa's Official Languagescited by 1
Built on by
Citing papers per year: 2022: 3; 2023: 4; 2024: 5; 2025: 4; 2026: 2.
18 papers.
Sort:
By area:
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 174
- 2022A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translationcited by 97
- 2022Bitext Mining Using Distilled Sentence Representations for Low-Resource Languagescited by 48
- 2023GlotLID: Language Identification for Low-Resource Languagescited by 37
- 2023AfriSpeech-200: Pan-African Accented Speech Dataset for Clinical and General Domain ASRcited by 34
- 2023MasakhaPOS: Part-of-Speech Tagging for Typologically Diverse African Languagescited by 23
- 2024GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languagescited by 15
- 2022Kencorpus: A Kenyan Language Corpus of Swahili, Dholuo and Luhya for Natural Language Processing Taskscited by 9
- 2023AfriNames: Most ASR models "butcher" African Namescited by 7
- 2024State of NLP in Kenya: A Surveycited by 7
- 2024A Systematic Review of NLP for Ghanaian Languages: Datasets, Models, and a Research Roadmapcited by 5
- 2024Monolingual and Multilingual Misinformation Detection for Low-Resource Languages: A Comprehensive Surveycited by 4
6 more
- 2025Voice of a Continent: Mapping Africa's Speech Technology Frontiercited by 4
- 2025Detection of Somali-written Fake News and Toxic Messages on the Social Media Using Transformer-based Language Modelscited by 0
- 2025Redefining technology for indigenous languagescited by 0
- 2025The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLPcited by 0
- 2026The Annotation Scarcity Paradox in Low-Resource NLP Evaluation: A Decade of Acceleration and Emerging Constraintscited by 0
- 2026A Survey of Text and Speech Resources for Hausa and Fongbe: Availability, Quality, and Gaps for NLP Developmentcited by 0
- 2026The Annotation Scarcity Paradox in Low-Resource NLP Evaluation: A Decade of Acceleration and Emerging Constraints18 May 2026
- 2026A Survey of Text and Speech Resources for Hausa and Fongbe: Availability, Quality, and Gaps for NLP Development13 Apr 2026
- 2025The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLP7 Oct 2025
- 2025Voice of a Continent: Mapping Africa's Speech Technology Frontier24 May 2025
- 2025Redefining technology for indigenous languages2 Apr 2025
- 2025Detection of Somali-written Fake News and Toxic Messages on the Social Media Using Transformer-based Language Models23 Mar 2025
- 2024GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languages31 Oct 2024
- 2024Monolingual and Multilingual Misinformation Detection for Low-Resource Languages: A Comprehensive Survey24 Oct 2024
- 2024State of NLP in Kenya: A Survey13 Oct 2024
- 2024A Systematic Review of NLP for Ghanaian Languages: Datasets, Models, and a Research Roadmap10 May 2024
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning9 Feb 2024
- 2023GlotLID: Language Identification for Low-Resource Languages24 Oct 2023
6 more
- 2023AfriSpeech-200: Pan-African Accented Speech Dataset for Clinical and General Domain ASR30 Sep 2023
- 2023AfriNames: Most ASR models "butcher" African Names1 Jun 2023
- 2023MasakhaPOS: Part-of-Speech Tagging for Typologically Diverse African Languages23 May 2023
- 2022Kencorpus: A Kenyan Language Corpus of Swahili, Dholuo and Luhya for Natural Language Processing Tasks25 Aug 2022
- 2022Bitext Mining Using Distilled Sentence Representations for Low-Resource Languages25 May 2022
- 2022A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translation4 May 2022
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 174
- 2022A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translationcited by 97
- 2022Bitext Mining Using Distilled Sentence Representations for Low-Resource Languagescited by 48
- 2023GlotLID: Language Identification for Low-Resource Languagescited by 37
- 2023AfriSpeech-200: Pan-African Accented Speech Dataset for Clinical and General Domain ASRcited by 34
- 2023MasakhaPOS: Part-of-Speech Tagging for Typologically Diverse African Languagescited by 23
- 2024GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languagescited by 15
- 2022Kencorpus: A Kenyan Language Corpus of Swahili, Dholuo and Luhya for Natural Language Processing Taskscited by 9
- 2023AfriNames: Most ASR models "butcher" African Namescited by 7
- 2024State of NLP in Kenya: A Surveycited by 7
- 2024A Systematic Review of NLP for Ghanaian Languages: Datasets, Models, and a Research Roadmapcited by 5
- 2024Monolingual and Multilingual Misinformation Detection for Low-Resource Languages: A Comprehensive Surveycited by 4
12 most cited of 17 All 17 (JSON)
- 2026The Annotation Scarcity Paradox in Low-Resource NLP Evaluation: A Decade of Acceleration and Emerging Constraints18 May 2026
- 2026A Survey of Text and Speech Resources for Hausa and Fongbe: Availability, Quality, and Gaps for NLP Development13 Apr 2026
- 2025The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLP7 Oct 2025
- 2025Voice of a Continent: Mapping Africa's Speech Technology Frontier24 May 2025
- 2025Redefining technology for indigenous languages2 Apr 2025
- 2024GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languages31 Oct 2024
- 2024Monolingual and Multilingual Misinformation Detection for Low-Resource Languages: A Comprehensive Survey24 Oct 2024
- 2024State of NLP in Kenya: A Survey13 Oct 2024
- 2024A Systematic Review of NLP for Ghanaian Languages: Datasets, Models, and a Research Roadmap10 May 2024
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning9 Feb 2024
- 2023GlotLID: Language Identification for Low-Resource Languages24 Oct 2023
- 2023AfriSpeech-200: Pan-African Accented Speech Dataset for Clinical and General Domain ASR30 Sep 2023
12 newest of 17 All 17 (JSON)