Investigating an approach for low resource language dataset creation, curation and classification: Setswana and Sepedi
Not on the map. Why?
Abstract (arXiv)
The recent advances in Natural Language Processing have been a boon for well-represented languages in terms of available curated data and research resources. One of the challenges for low-resourced languages is clear guidelines on the collection, curation and preparation of datasets for different use-cases. In this work, we take on the task of creation of two datasets that are focused on news headlines (i.e short text) for Setswana and Sepedi and creation of a news topic classification task. We document our work and also present baselines for classification. We investigate an approach on data augmentation, better suited to low resource languages, to improve the performance of the classifiers
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 3; 2024: 2; 2025: 2; 2026: 1.
15 papers.
Sort:
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languagescited by 142
- 2022Building Machine Translation Systems for the Next Thousand Languagescited by 69
- 2022Listening to Affected Communities to Define Extreme Speech: Dataset and Experimentscited by 21
- 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Aheadcited by 15
- 2023Preparing the Vuk'uzenzele and ZA-gov-multilingual South African multilingual corporacited by 12
- 2025SMOL: Professionally translated parallel data for 115 under-represented languagescited by 11
- 2022Kencorpus: A Kenyan Language Corpus of Swahili, Dholuo and Luhya for Natural Language Processing Taskscited by 9
- 2024Socially Responsible Data for Large Multilingual Language Modelscited by 7
- 2023PuoBERTa: Training and evaluation of a curated language model for Setswanacited by 6
- 2021Training Cross-Lingual embeddings for Setswana and Sepedicited by 5
- 2022LR-Sum: Summarization for Less-Resourced Languagescited by 5
- 2023Izindaba-Tindzaba: Machine learning news categorisation for Long and Short Text for isiZulu and Siswaticited by 2
3 more
- 2024Pula: Training Large Language Models for Setswanacited by 2
- 2021Building Representative Corpora from Illiterate Communities: A Review of Challenges and Mitigation Strategies for Developing Countriescited by 0
- 2026The Influence of Iconicity in Transfer Learning for Sign Language Recognitioncited by 0
- 2026The Influence of Iconicity in Transfer Learning for Sign Language Recognition9 Feb 2026
- 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Ahead27 May 2025
- 2025SMOL: Professionally translated parallel data for 115 under-represented languages17 Feb 2025
- 2024Socially Responsible Data for Large Multilingual Language Models8 Sep 2024
- 2024Pula: Training Large Language Models for Setswana5 Aug 2024
- 2023PuoBERTa: Training and evaluation of a curated language model for Setswana13 Oct 2023
- 2023Izindaba-Tindzaba: Machine learning news categorisation for Long and Short Text for isiZulu and Siswati12 Jun 2023
- 2023Preparing the Vuk'uzenzele and ZA-gov-multilingual South African multilingual corpora7 Mar 2023
- 2022LR-Sum: Summarization for Less-Resourced Languages19 Dec 2022
- 2022Kencorpus: A Kenyan Language Corpus of Swahili, Dholuo and Luhya for Natural Language Processing Tasks25 Aug 2022
- 2022Building Machine Translation Systems for the Next Thousand Languages9 May 2022
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages18 Apr 2022
3 more
- 2022Listening to Affected Communities to Define Extreme Speech: Dataset and Experiments22 Mar 2022
- 2021Training Cross-Lingual embeddings for Setswana and Sepedi11 Nov 2021
- 2021Building Representative Corpora from Illiterate Communities: A Review of Challenges and Mitigation Strategies for Developing Countries4 Feb 2021
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languagescited by 142
- 2022Building Machine Translation Systems for the Next Thousand Languagescited by 69
- 2022Listening to Affected Communities to Define Extreme Speech: Dataset and Experimentscited by 21
- 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Aheadcited by 15
- 2023Preparing the Vuk'uzenzele and ZA-gov-multilingual South African multilingual corporacited by 12
- 2025SMOL: Professionally translated parallel data for 115 under-represented languagescited by 11
- 2022Kencorpus: A Kenyan Language Corpus of Swahili, Dholuo and Luhya for Natural Language Processing Taskscited by 9
- 2024Socially Responsible Data for Large Multilingual Language Modelscited by 7
- 2023PuoBERTa: Training and evaluation of a curated language model for Setswanacited by 6
- 2021Training Cross-Lingual embeddings for Setswana and Sepedicited by 5
- 2022LR-Sum: Summarization for Less-Resourced Languagescited by 5
- 2023Izindaba-Tindzaba: Machine learning news categorisation for Long and Short Text for isiZulu and Siswaticited by 2
12 most cited of 15 All 15 (JSON)
- 2026The Influence of Iconicity in Transfer Learning for Sign Language Recognition9 Feb 2026
- 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Ahead27 May 2025
- 2025SMOL: Professionally translated parallel data for 115 under-represented languages17 Feb 2025
- 2024Socially Responsible Data for Large Multilingual Language Models8 Sep 2024
- 2024Pula: Training Large Language Models for Setswana5 Aug 2024
- 2023PuoBERTa: Training and evaluation of a curated language model for Setswana13 Oct 2023
- 2023Izindaba-Tindzaba: Machine learning news categorisation for Long and Short Text for isiZulu and Siswati12 Jun 2023
- 2023Preparing the Vuk'uzenzele and ZA-gov-multilingual South African multilingual corpora7 Mar 2023
- 2022LR-Sum: Summarization for Less-Resourced Languages19 Dec 2022
- 2022Kencorpus: A Kenyan Language Corpus of Swahili, Dholuo and Luhya for Natural Language Processing Tasks25 Aug 2022
- 2022Building Machine Translation Systems for the Next Thousand Languages9 May 2022
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages18 Apr 2022
12 newest of 15 All 15 (JSON)