mlsanityData to 14 Oct 2026

Preparing the Vuk'uzenzele and ZA-gov-multilingual South African multilingual corpora

arXiv 2303.03750 ↗First posted 7 Mar 2023cs.CLcited by 12

Not on the map. Why?

Abstract (arXiv)

This paper introduces two multilingual government themed corpora in various South African languages. The corpora were collected by gathering the South African Government newspaper (Vuk'uzenzele), as well as South African government speeches (ZA-gov-multilingual), that are translated into all 11 South African official languages. The corpora can be used for a myriad of downstream NLP tasks. The corpora were created to allow researchers to study the language used in South African government publications, with a focus on understanding how South African government officials communicate with their constituents. In this paper we highlight the process of gathering, cleaning and making available the corpora. We create parallel sentence corpora for Neural Machine Translation (NMT) tasks using Language-Agnostic Sentence Representations (LASER) embeddings. With these aligned sentences we then provide NMT benchmarks for 9 indigenous languages by fine-tuning a massively multilingual pre-trained language model.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 7 Mar 2023.

Builds on

13 of 27 references.

References · 13

  1. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  2. 2020Beyond English-Centric Multilingual Machine Translationcited by 561
  3. 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
  4. 2022A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translationcited by 98
  5. 2022Some Languages are More Equal than Others: Probing Deeper into the Linguistic Disparity in the NLP Worldcited by 55
  6. 2017Learning Joint Multilingual Sentence Representations with Neural Machine Translationcited by 52
  7. 2018Co-training Embeddings of Knowledge Graphs and Entity Descriptions for Cross-lingual Entity Alignmentcited by 49
  8. 2017The Parallel Meaning Bank: Towards a Multilingual Corpus of Translations Annotated with Compositional Meaning Representationscited by 42
  9. 2018A Corpus for Multilingual Document Classification in Eight Languagescited by 42
  10. 2019A Focus on Neural Machine Translation for African Languagescited by 15
  11. 2020Investigating an approach for low resource language dataset creation, curation and classification: Setswana and Sepedicited by 15
  12. 2021An Unsupervised Method for Building Sentence Simplification Corpora in Multiple Languagescited by 14
1 more
  1. 2019Multilingual Named Entity Recognition Using Pretrained Embeddings, Attention Mechanism and NCRFcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 5; 2025: 3; 2026: 1.

12 papers.

  1. 2023GlotLID: Language Identification for Low-Resource Languagescited by 39
  2. 2024GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languagescited by 16
  3. 2025BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Datacited by 10
  4. 2024Toucan: Many-to-Many Translation for 150 African Language Pairscited by 8
  5. 2023PuoBERTa: Training and evaluation of a curated language model for Setswanacited by 6
  6. 2024TIGQA:An Expert Annotated Question Answering Dataset in Tigrinyacited by 5
  7. 2026OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Reportcited by 5
  8. 2025The Esethu Framework: Reimagining Sustainable Dataset Governance and Curation for Low-Resource Languagescited by 4
  9. 2025Swivuriso: The South African Next Voices Multilingual Speech Datasetcited by 3
  10. 2023MphayaNER: Named Entity Recognition for Tshivendacited by 2
  11. 2024Pula: Training Large Language Models for Setswanacited by 2
  12. 2024From N-grams to Pre-trained Multilingual Models For Language Identificationcited by 2