mlsanityData to 13 Oct 2026

Beyond Catalogue Counts: the Dataset Visibility Asymmetry in Low-Resource Multilingual NLP

arXiv 2605.17442 ↗First posted 17 May 2026cs.CL cs.AI cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Multilingual NLP often relies on dataset counts from centralized catalogues to characterize which languages are resource-rich or resource-poor. However, these catalogues record only one layer of dataset visibility: what has been registered or institutionally distributed. They do not necessarily reflect which datasets are created, cited, or reused in the research literature. To examine this gap, we combine a catalogue-based baseline with literature-backed evidence of dataset circulation. We introduce the Resource Density Index (RDI), defined as the number of catalogued datasets per one million speakers, and compute it for the 200 most widely spoken languages in Ethnologue. Among them, 118 languages (59%) have an average RDI of zero across the LRE Map and the Linguistic Data Consortium (LDC), and another 23 fall below 0.1, corresponding to at most one catalogued dataset per ten million speakers. We then apply an LLM-assisted citation-mining pipeline over the Semantic Scholar corpus to these 141 low-visibility languages. After manual validation and consolidation, we identify 609 unique datasets across 53 languages, of which 356 remain openly accessible through working public links. These results reveal a substantial visibility gap: many large-speaker languages appear data-poor in catalogue records yet show clear evidence of dataset activity in the research literature. Our findings suggest that multilingual data scarcity should be understood not only as a production problem, but also as a question of documentation, discoverability, and long-term accessibility. Code and data are publicly available at (https://github.com/zhiyintan/dataset-visibility-asymmetry).

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 11 of its 23 references that are in the map. First posted on arXiv 17 May 2026.

Builds on

11 of 23 references.

References · 11

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,831
  2. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  3. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 792
  4. 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 259
  5. 2020A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarioscited by 170
  6. 2022Some Languages are More Equal than Others: Probing Deeper into the Linguistic Disparity in the NLP Worldcited by 55
  7. 2022NusaCrowd: Open Source Initiative for Indonesian NLP Resourcescited by 38
  8. 2022Beyond Counting Datasets: A Survey of Multilingual Dataset Construction and Necessary Resourcescited by 25
  9. 2024The Zeno's Paradox of `Low-Resource' Languagescited by 12
  10. 2020Lanfrica: A Participatory Approach to Documenting Machine Translation Research on African Languagescited by 7
  11. 2026Multi-Disciplinary Dataset Discovery from Citation-Verified Literature Contextscited by 4

Built on by

Not cited yet.