Low-resource Languages: A Review of Past Work and Future Challenges
Not on the map. Why?
Abstract (arXiv)
A current problem in NLP is massaging and processing low-resource languages which lack useful training attributes such as supervised data, number of native speakers or experts, etc. This review paper concisely summarizes previous groundbreaking achievements made towards resolving this problem, and analyzes potential improvements in the context of the overall future research direction.
Key facts. Cited by 91 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 8; 2023: 12; 2024: 32; 2025: 31; 2026: 5.
91 papers.
Sort:
By area:
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languagescited by 146
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 109
- 2025Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Surveycited by 39
- 2024The Future of Large Language Model Pre-training is Federatedcited by 30
- 2024Goldfish: Monolingual Language Models for 350 Languagescited by 29
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Researchcited by 27
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chatcited by 23
- 2024Open Ko-LLM Leaderboard: Evaluating Large Language Models in Korean with Ko-H5 Benchmarkcited by 23
- 2022MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented Dialoguecited by 15
- 2023Automated stance detection in complex topics and small languages: the challenging case of immigration in polarizing news mediacited by 14
- 2023Allophant: Cross-lingual Phoneme Recognition with Articulatory Attributescited by 13
- 2023Scaling Laws Do Not Scalecited by 13
38 more
- 2025LLMs can be easily Confused by Instructional Distractionscited by 13
- 2022JamPatoisNLI: A Jamaican Patois Natural Language Inference Datasetcited by 11
- 2023Massively Multilingual Corpus of Sentiment Datasets and Multi-faceted Sentiment Classification Benchmarkcited by 10
- 2025The Multilingual Divide and Its Impact on Global AI Safetycited by 10
- 2023NLEBench+NorGLM: A Comprehensive Empirical Analysis and Benchmark Dataset for Generative Language Models in Norwegiancited by 9
- 2024TransMI: A Framework to Create Strong Baselines from Multilingual Pretrained Language Models for Transliterated Datacited by 9
- 2024When Every Token Counts: Optimal Segmentation for Low-Resource Language Modelscited by 8
- 2025TiEBe: Tracking Language Model Recall of Notable Worldwide Events Through Timecited by 8
- 2025Overcoming Data Scarcity in Generative Language Modelling for Low-Resource Languages: A Systematic Reviewcited by 8
- 2024Cultural Fidelity in Large-Language Models: An Evaluation of Online Language Resources as a Driver of Model Performance in Value Representationcited by 7
- 2024Multistage Fine-tuning Strategies for Automatic Speech Recognition in Low-resource Languagescited by 6
- 2024A Systematic Review of NLP for Ghanaian Languages: Datasets, Models, and a Research Roadmapcited by 5
- 2024Worldwide Federated Training of Language Modelscited by 5
- 2024Cross-lingual transfer of multilingual models on low resource African Languagescited by 5
- 2024DEPT: Decoupled Embeddings for Pre-training Language Modelscited by 5
- 2024CHAI for LLMs: Improving Code-Mixed Translation in Large Language Models through Reinforcement Learning with AI Feedbackcited by 5
- 2024Foundation Models for Low-Resource Language Education (Vision Paper)cited by 5
- 2022Applying wav2vec2 for Speech Recognition on Bengali Common Voices Datasetcited by 4
- 2023Sinhala-English Parallel Word Dictionary Datasetcited by 4
- 2024Comparing LLM prompting with Cross-lingual transfer performance on Indigenous and Low-resource Brazilian Languagescited by 4
- 2024Monolingual and Multilingual Misinformation Detection for Low-Resource Languages: A Comprehensive Surveycited by 4
- 2021Morpheme Boundary Detection & Grammatical Feature Prediction for Gujarati : Dataset & Modelcited by 3
- 2025Is It Navajo? Accurate Language Detection in Endangered Athabaskan Languagescited by 3
- 2022Automatic Speech Recognition of Low-Resource Languages Based on Chukchicited by 2
- 2024Symbolic Autoencoding for Self-Supervised Sequence Learningcited by 2
- 2024101 Billion Arabic Words Datasetcited by 2
- 2024Universal Cross-Lingual Text Classificationcited by 2
- 2024Breaking the Programming Language Barrier: Multilingual Prompting to Empower Non-Native English Learnerscited by 2
- 2024Overview of the First Workshop on Language Models for Low-Resource Languages (LoResLM 2025)cited by 2
- 2025LAG-MMLU: Benchmarking Frontier LLM Understanding in Latvian and Giriamacited by 2
- 2025An evaluation of LLMs and Google Translate for translation of selected Indian languages via sentiment and semantic analysescited by 2
- 2025L3Cube-MahaEmotions: A Marathi Emotion Recognition Dataset with Synthetic Annotations using CoTR prompting and Large Language Modelscited by 2
- 2025MERLIN: Multi-Stage Curriculum Alignment for Multilingual Encoder-LLM Integration in Cross-Lingual Reasoningcited by 2
- 2025Tokenization Disparities as Infrastructure Bias: How Subword Systems Create Inequities in LLM Access and Efficiencycited by 2
- 2025Zero-Shot Performance Prediction for Probabilistic Scaling Lawscited by 2
- 2022Effective Transfer Learning for Low-Resource Natural Language Understandingcited by 1
- 2023Investigating Lexical Sharing in Multilingual Machine Translation for Indian Languagescited by 1
- 2023Semantically-Prompted Language Models Improve Visual Descriptionscited by 1
50 most cited of 91 All 91 (JSON)
- 2026Enhancing Zero-Shot Domain Transfer in Low-Resource Sentiment Analysis: A Case Study in Marathi11 Oct 2026
- 2026Enhancing speech representation learning with cross-modal knowledge transfer with HGNN under low resource settings: the case study of Yemba19 Sep 2026
- 2026A Modular Part-of-Speech Tagger for Scottish Gaelic using spaCy5 Aug 2026
- 2026Towards Digital Preservation of Efik: TTS for a Low-Resource African Language5 Jul 2026
- 2026Natural Language Processing: A Comprehensive Practical Guide from Tokenisation to RLHF5 May 2026
- 2025OmniMER: Auxiliary-Enhanced LLM Adaptation for Indonesian Multimodal Emotion Recognition22 Dec 2025
- 2025NSL-MT: Linguistically Informed Negative Samples for Efficient Machine Translation in Low-Resource Languages12 Nov 2025
- 2025Zero-Shot Performance Prediction for Probabilistic Scaling Laws19 Oct 2025
- 2025Tokenization Disparities as Infrastructure Bias: How Subword Systems Create Inequities in LLM Access and Efficiency14 Oct 2025
- 2025PromptGuard at BLP-2025 Task 1: A Few-Shot Classification Framework Using Majority Voting and Keyword Similarity for Bengali Hate Speech Detection10 Oct 2025
- 2025The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLP7 Oct 2025
- 2025MERLIN: Multi-Stage Curriculum Alignment for Multilingual Encoder-LLM Integration in Cross-Lingual Reasoning9 Sep 2025
38 more
- 2025QCSE: A Pretrained Quantum Context-Sensitive Word Embedding for Natural Language Processing6 Sep 2025
- 2025L3Cube-IndicHeadline-ID: A Dataset for Headline Identification and Semantic Evaluation in Low-Resource Indian Languages2 Sep 2025
- 2025Benchmarking Sociolinguistic Diversity in Swahili NLP: A Taxonomy-Guided Approach6 Aug 2025
- 2025Bridging the Gap with Retrieval-Augmented Generation: Making Prosthetic Device User Manuals Available in Marginalised Languages30 Jun 2025
- 2025Prompt, Translate, Fine-Tune, Re-Initialize, or Instruction-Tune? Adapting LLMs for In-Context Learning in Low-Resource Languages23 Jun 2025
- 2025FormosanBench: Benchmarking Low-Resource Austronesian Languages in the Era of Large Language Models12 Jun 2025
- 2025QUST_NLP at SemEval-2025 Task 7: A Three-Stage Retrieval Framework for Monolingual and Crosslingual Fact-Checked Claim Retrieval12 Jun 2025
- 2025L3Cube-MahaEmotions: A Marathi Emotion Recognition Dataset with Synthetic Annotations using CoTR prompting and Large Language Models1 Jun 2025
- 2025The Multilingual Divide and Its Impact on Global AI Safety27 May 2025
- 2025An End-to-End Approach for Child Reading Assessment in the Xhosa Language23 May 2025
- 2025Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Survey21 May 2025
- 2025Enhanced Urdu Intent Detection with Large Language Models and Prototype-Informed Predictive Pipelines8 May 2025
- 2025Overcoming Data Scarcity in Generative Language Modelling for Low-Resource Languages: A Systematic Review7 May 2025
- 2025Evaluating Vision Language Model Adaptations for Radiology Report Generation in Low-Resource Languages2 May 2025
- 2025Better To Ask in English? Evaluating Factual Accuracy of Multilingual LLMs in English and Low-Resource Languages28 Apr 2025
- 2025An evaluation of LLMs and Google Translate for translation of selected Indian languages via sentiment and semantic analyses27 Mar 2025
- 2025Synthetic Function Demonstrations Improve Generation in Low-Resource Programming Languages24 Mar 2025
- 2025ParsiPy: NLP Toolkit for Historical Persian Texts in Python22 Mar 2025
- 2025LAG-MMLU: Benchmarking Frontier LLM Understanding in Latvian and Giriama14 Mar 2025
- 2025NaijaNLP: A Survey of Nigerian Low-Resource Languages27 Feb 2025
- 2025Using Machine Learning to Detect Fraudulent SMSs in Chichewa24 Feb 2025
- 2025LLMs can be easily Confused by Instructional Distractions5 Feb 2025
- 2025Is It Navajo? Accurate Language Detection in Endangered Athabaskan Languages27 Jan 2025
- 2025TiEBe: Tracking Language Model Recall of Notable Worldwide Events Through Time13 Jan 2025
- 2024Overview of the First Workshop on Language Models for Low-Resource Languages (LoResLM 2025)20 Dec 2024
- 2024Language verY Rare for All18 Dec 2024
- 2024Breaking the Programming Language Barrier: Multilingual Prompting to Empower Non-Native English Learners17 Dec 2024
- 2024When Every Token Counts: Optimal Segmentation for Low-Resource Language Models9 Dec 2024
- 2024Foundation Models for Low-Resource Language Education (Vision Paper)6 Dec 2024
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Research30 Nov 2024
- 2024NushuRescue: Revitalization of the Endangered Nushu Language with AI29 Nov 2024
- 2024LIMBA: An Open-Source Framework for the Preservation and Valorization of Low-Resource Languages using Generative Models20 Nov 2024
- 2024CHAI for LLMs: Improving Code-Mixed Translation in Large Language Models through Reinforcement Learning with AI Feedback13 Nov 2024
- 2024Collaborative Participatory Research with LLM Agents in South Asia: An Empirically-Grounded Methodological Initiative and Agenda from Field Evidence in Sri Lanka13 Nov 2024
- 2024Toward Cultural Interpretability: A Linguistic Anthropological Framework for Describing and Evaluating Large Language Models (LLMs)7 Nov 2024
- 2024Multistage Fine-tuning Strategies for Automatic Speech Recognition in Low-resource Languages7 Nov 2024
- 2024A Multilingual Sentiment Lexicon for Low-Resource Language Translation using Large Languages Models and Explainable AI6 Nov 2024
- 2024Retrieval-enriched zero-shot image classification in low-resource domains1 Nov 2024
50 newest of 91 All 91 (JSON)
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chatcited by 23
- 2024Collaborative Participatory Research with LLM Agents in South Asia: An Empirically-Grounded Methodological Initiative and Agenda from Field Evidence in Sri Lankacited by 0
- 2024Collaborative Participatory Research with LLM Agents in South Asia: An Empirically-Grounded Methodological Initiative and Agenda from Field Evidence in Sri Lanka13 Nov 2024
- 2024Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chat30 Jan 2024
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languagescited by 146
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 109
- 2025Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Surveycited by 39
- 2024The Future of Large Language Model Pre-training is Federatedcited by 30
- 2024Goldfish: Monolingual Language Models for 350 Languagescited by 29
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Researchcited by 27
- 2024Open Ko-LLM Leaderboard: Evaluating Large Language Models in Korean with Ko-H5 Benchmarkcited by 23
- 2022MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented Dialoguecited by 15
- 2023Automated stance detection in complex topics and small languages: the challenging case of immigration in polarizing news mediacited by 14
- 2023Allophant: Cross-lingual Phoneme Recognition with Articulatory Attributescited by 13
- 2023Scaling Laws Do Not Scalecited by 13
- 2025LLMs can be easily Confused by Instructional Distractionscited by 13
12 most cited of 84 All 84 (JSON)
- 2026Enhancing Zero-Shot Domain Transfer in Low-Resource Sentiment Analysis: A Case Study in Marathi11 Oct 2026
- 2026Enhancing speech representation learning with cross-modal knowledge transfer with HGNN under low resource settings: the case study of Yemba19 Sep 2026
- 2026A Modular Part-of-Speech Tagger for Scottish Gaelic using spaCy5 Aug 2026
- 2026Towards Digital Preservation of Efik: TTS for a Low-Resource African Language5 Jul 2026
- 2025OmniMER: Auxiliary-Enhanced LLM Adaptation for Indonesian Multimodal Emotion Recognition22 Dec 2025
- 2025NSL-MT: Linguistically Informed Negative Samples for Efficient Machine Translation in Low-Resource Languages12 Nov 2025
- 2025Zero-Shot Performance Prediction for Probabilistic Scaling Laws19 Oct 2025
- 2025Tokenization Disparities as Infrastructure Bias: How Subword Systems Create Inequities in LLM Access and Efficiency14 Oct 2025
- 2025PromptGuard at BLP-2025 Task 1: A Few-Shot Classification Framework Using Majority Voting and Keyword Similarity for Bengali Hate Speech Detection10 Oct 2025
- 2025The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLP7 Oct 2025
- 2025QCSE: A Pretrained Quantum Context-Sensitive Word Embedding for Natural Language Processing6 Sep 2025
- 2025L3Cube-IndicHeadline-ID: A Dataset for Headline Identification and Semantic Evaluation in Low-Resource Indian Languages2 Sep 2025
12 newest of 84 All 84 (JSON)