mlsanityData to 14 Oct 2026

Structural Silence: When AI Infrastructure Fails Speakers of Underrepresented Languages

arXiv 2608.12278 ↗First posted 12 Aug 2026cs.CL cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Artificial intelligence tools for education and language support are increasingly framed as scalable responses to access gaps in under-resourced communities. Yet the infrastructure underlying these tools, including training corpora, tokenization schemes, evaluation benchmarks, and deployment architectures, can systematically disadvantage speakers of underrepresented languages before a model is trained. This paper examines these structural barriers through Bengali, one of the world's most widely spoken languages, focusing on AI-assisted education in low-connectivity environments. We identify four interlocking failures: a severe web presence gap, with Bengali accounting for less than 0.5% of global web content despite representing nearly 4% of the global population; a 67:1 training-token deficit between English and Bengali in major multilingual corpora; a tokenization penalty associated with Bengali's alphasyllabary script that compounds the data deficit through higher token fertility; and connectivity exclusion, with individual internet penetration at 36.5% in rural areas compared with 71.4% in urban areas. These failures reflect longstanding resource-allocation decisions, institutional priorities, and design defaults that did not center underrepresented languages in mainstream AI development. We argue that dataset scarcity should be understood as a structural barrier rather than an isolated technical limitation, and that offline-first design should be treated as an equity-oriented infrastructure strategy. We conclude with directions for linguistics and AI research aimed at reducing these structural inequalities.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 25 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

10 of 25 references.

References · 10

  1. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  2. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  3. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
  4. 2021BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Banglacited by 125
  5. 2024IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languagescited by 52
  6. 2024Goldfish: Monolingual Language Models for 350 Languagescited by 29
  7. 2023BenLLMEval: A Comprehensive Evaluation into the Potentials and Pitfalls of Large Language Models on Bengali NLPcited by 23
  8. 2025Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Trainingcited by 20
  9. 2025Script Fragmentation and Format: What Drives the English-Bengali Performance Gap in Open LLMs?cited by 9
  10. 2025The Teacher's Dilemma: Balancing Trade-Offs in Programming Education for Emergent Bilingual Studentscited by 1

Built on by

Not cited yet.