Open but Incompatible: A License Compatibility Analysis of Corpora for Low-Resource African Languages
Not on the map. Why?
Abstract (arXiv)
Creative Commons licenses dominate African NLP corpus releases, but their compatibility rules are rarely applied. CC-BY-SA and CC-BY-NC cannot be combined in a single published dataset; a NoDerivs clause silently prohibits tokenisation and annotation. This paper audits the license provenance of over twenty corpus families used in African NLP, constructs a six-tier compatibility matrix, and applies it to three case-study languages: Kituba/Munukutuba, Zarma, and Moore. Four failure modes are documented with primary-source evidence: outright prohibition (JW300, removed from OPUS after a legal audit confirmed Terms of Service violation); composite license misrepresentation (WAXAL, whose CC-BY 4.0 claim is contradicted by its own HuggingFace dataset card); a NoDerivs clause hidden behind a CC-BY label (Tanzil); and data persistence failure (the Congolese Radio Corpus, where 402 of 405 source URLs are now dead). A pre-annotation due diligence checklist and a survey of legally clean enrichment opportunities close the paper.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 34 references that are in the map. First posted on arXiv 27 Jun 2026.
Builds on
10 of 34 references.
References · 10
- 2018Datasheets for Datasetscited by 1,371
- 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 481
- 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
- 2019CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEBcited by 177
- 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
- 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
- 2020The Tatoeba Translation Challenge -- Realistic Data Sets for Low Resource and Multilingual MTcited by 127
- 2022Data Governance in the Age of Large-Scale Data-Driven Language Technologycited by 32
- 2025Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Trainingcited by 19
- 2026WAXAL: A Large-Scale Multilingual African Language Speech Corpuscited by 10
Built on by
Not cited yet.