mlsanityData to 7 Oct 2026

Towards Open-Ended Discovery for Low-Resource NLP

arXiv 2510.01220 ↗First posted 22 Sep 2025cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Natural Language Processing (NLP) for low-resource languages remains fundamentally constrained by the lack of textual corpora, standardized orthographies, and scalable annotation pipelines. While recent advances in large language models have improved cross-lingual transfer, they remain inaccessible to underrepresented communities due to their reliance on massive, pre-collected data and centralized infrastructure. In this position paper, we argue for a paradigm shift toward open-ended, interactive language discovery, where AI systems learn new languages dynamically through dialogue rather than static datasets. We contend that the future of language technology, particularly for low-resource and under-documented languages, must move beyond static data collection pipelines toward interactive, uncertainty-driven discovery, where learning emerges dynamically from human-machine collaboration instead of being limited to pre-existing datasets. We propose a framework grounded in joint human-machine uncertainty, combining epistemic uncertainty from the model with hesitation cues and confidence signals from human speakers to guide interaction, query selection, and memory retention. This paper is a call to action: we advocate a rethinking of how AI engages with human knowledge in under-documented languages, moving from extractive data collection toward participatory, co-adaptive learning processes that respect and empower communities while discovering and preserving the world's linguistic diversity. This vision aligns with principles of human-centered AI, emphasizing interactive, cooperative model building between AI systems and speakers.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 51 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

32 of 51 references.

References · 32

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Scaling Laws for Neural Language Modelscited by 6,411
  4. 2017On Calibration of Modern Neural Networkscited by 4,860
  5. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  6. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  7. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  8. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  9. 2017Deep Bayesian Active Learning with Image Datacited by 812
  10. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  11. 2019Green AIcited by 620
  12. 2015Weight Uncertainty in Neural Networkscited by 554
20 more
  1. 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 428
  2. 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
  3. 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
  4. 2020Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertaintycited by 128
  5. 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
  6. 2021Re-imagining Algorithmic Fairness in India and Beyondcited by 102
  7. 2023CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotationcited by 93
  8. 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 86
  9. 2024Open-Endedness is Essential for Artificial Superhuman Intelligencecited by 79
  10. 2022AfroLM: A Self-Active Learning-based Multilingual Pretrained Language Model for 23 African Languagescited by 46
  11. 2023Human Uncertainty in Concept-Based AI Systemscited by 39
  12. 2021Stochastic Batch Acquisition: A Simple Baseline for Deep Active Learningcited by 36
  13. 2023AfriSpeech-200: Pan-African Accented Speech Dataset for Clinical and General Domain ASRcited by 34
  14. 2020FFR v1.1: Fon-French Neural Machine Translationcited by 16
  15. 2021OkwuGb'e: End-to-End Speech Recognition for Fon and Igbocited by 13
  16. 2025Automated Capability Discovery via Foundation Model Self-Explorationcited by 8
  17. 2023AfriNames: Most ASR models "butcher" African Namescited by 7
  18. 2021Crowdsourced Phrase-Based Tokenization for Low-Resourced Neural Machine Translation: The Case of Fon Languagecited by 6
  19. 2021AfriVEC: Word Embedding Models for African Languages. Case Study of Fon and Nobiincited by 3
  20. 2025Uncertainty Estimation by Human Perception versus Neural Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.