Towards Open-Ended Discovery for Low-Resource NLP
Not on the map. Why?
Abstract (arXiv)
Natural Language Processing (NLP) for low-resource languages remains fundamentally constrained by the lack of textual corpora, standardized orthographies, and scalable annotation pipelines. While recent advances in large language models have improved cross-lingual transfer, they remain inaccessible to underrepresented communities due to their reliance on massive, pre-collected data and centralized infrastructure. In this position paper, we argue for a paradigm shift toward open-ended, interactive language discovery, where AI systems learn new languages dynamically through dialogue rather than static datasets. We contend that the future of language technology, particularly for low-resource and under-documented languages, must move beyond static data collection pipelines toward interactive, uncertainty-driven discovery, where learning emerges dynamically from human-machine collaboration instead of being limited to pre-existing datasets. We propose a framework grounded in joint human-machine uncertainty, combining epistemic uncertainty from the model with hesitation cues and confidence signals from human speakers to guide interaction, query selection, and memory retention. This paper is a call to action: we advocate a rethinking of how AI engages with human knowledge in under-documented languages, moving from extractive data collection toward participatory, co-adaptive learning processes that respect and empower communities while discovering and preserving the world's linguistic diversity. This vision aligns with principles of human-centered AI, emphasizing interactive, cooperative model building between AI systems and speakers.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 51 references that are in the map. First posted on arXiv 22 Sep 2025.
Builds on
32 of 51 references.
References · 32
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2017Deep Bayesian Active Learning with Image Datacited by 812
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
- 2019Green AIcited by 620
- 2015Weight Uncertainty in Neural Networkscited by 554
20 more
- 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 428
- 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
- 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
- 2020Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertaintycited by 128
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2021Re-imagining Algorithmic Fairness in India and Beyondcited by 102
- 2023CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotationcited by 93
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 86
- 2024Open-Endedness is Essential for Artificial Superhuman Intelligencecited by 79
- 2022AfroLM: A Self-Active Learning-based Multilingual Pretrained Language Model for 23 African Languagescited by 46
- 2023Human Uncertainty in Concept-Based AI Systemscited by 39
- 2021Stochastic Batch Acquisition: A Simple Baseline for Deep Active Learningcited by 36
- 2023AfriSpeech-200: Pan-African Accented Speech Dataset for Clinical and General Domain ASRcited by 34
- 2020FFR v1.1: Fon-French Neural Machine Translationcited by 16
- 2021OkwuGb'e: End-to-End Speech Recognition for Fon and Igbocited by 13
- 2025Automated Capability Discovery via Foundation Model Self-Explorationcited by 8
- 2023AfriNames: Most ASR models "butcher" African Namescited by 7
- 2021Crowdsourced Phrase-Based Tokenization for Low-Resourced Neural Machine Translation: The Case of Fon Languagecited by 6
- 2021AfriVEC: Word Embedding Models for African Languages. Case Study of Fon and Nobiincited by 3
- 2025Uncertainty Estimation by Human Perception versus Neural Modelscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.