Left Behind: Cross-Lingual Transfer as a Bridge for Low-Resource Languages in Large Language Models
Not on the map. Why?
Abstract (arXiv)
We investigate how large language models perform on low-resource languages by benchmarking eight LLMs across five experimental conditions in English, Kazakh, and Mongolian. Using 50 hand-crafted questions spanning factual, reasoning, technical, and culturally grounded categories, we evaluate 2,000 responses on accuracy, fluency, and completeness. We find a consistent performance gap of 13.8-16.7 percentage points between English and low-resource language conditions, with models maintaining surface-level fluency while producing significantly less accurate content. Cross-lingual transfer-prompting models to reason in English before translating back-yields selective gains for bilingual architectures (+2.2pp to +4.3pp) but provides no benefit to English-dominant models. Our results demonstrate that current LLMs systematically underserve low-resource language communities, and that effective mitigation strategies are architecture-dependent rather than universal.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 9 references that are in the map. First posted on arXiv 22 Mar 2026.
Builds on
7 of 9 references.
References · 7
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
- 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 295
- 2023MEGA: Multilingual Evaluation of Generative AIcited by 293
- 2024MM-Eval: A Hierarchical Benchmark for Modern Mongolian Evaluation in LLMscited by 2
Built on by
Not cited yet.