mlsanityData to 7 Oct 2026

Open but Incompatible: A License Compatibility Analysis of Corpora for Low-Resource African Languages

arXiv 2606.28867 ↗First posted 27 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Creative Commons licenses dominate African NLP corpus releases, but their compatibility rules are rarely applied. CC-BY-SA and CC-BY-NC cannot be combined in a single published dataset; a NoDerivs clause silently prohibits tokenisation and annotation. This paper audits the license provenance of over twenty corpus families used in African NLP, constructs a six-tier compatibility matrix, and applies it to three case-study languages: Kituba/Munukutuba, Zarma, and Moore. Four failure modes are documented with primary-source evidence: outright prohibition (JW300, removed from OPUS after a legal audit confirmed Terms of Service violation); composite license misrepresentation (WAXAL, whose CC-BY 4.0 claim is contradicted by its own HuggingFace dataset card); a NoDerivs clause hidden behind a CC-BY label (Tanzil); and data persistence failure (the Congolese Radio Corpus, where 402 of 405 source URLs are now dead). A pre-annotation due diligence checklist and a survey of legally clean enrichment opportunities close the paper.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 34 references that are in the map. First posted on arXiv 27 Jun 2026.

Builds on

10 of 34 references.

References · 10

  1. 2018Datasheets for Datasetscited by 1,371
  2. 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 481
  3. 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
  4. 2019CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEBcited by 177
  5. 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
  6. 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
  7. 2020The Tatoeba Translation Challenge -- Realistic Data Sets for Low Resource and Multilingual MTcited by 127
  8. 2022Data Governance in the Age of Large-Scale Data-Driven Language Technologycited by 32
  9. 2025Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Trainingcited by 19
  10. 2026WAXAL: A Large-Scale Multilingual African Language Speech Corpuscited by 10

Built on by

Not cited yet.