Why Do Multilingual Reasoning Gaps Emerge in Reasoning Language Models?
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, yet they still exhibit a multilingual reasoning gap, performing better in high-resource languages than in low-resource ones. While recent efforts have been made to address this gap, its underlying causes remain largely unexplored. In this work, we show that this gap primarily stems from failures in language understanding-specifically, the model's inability to translate multilingual inputs into the language dominating its reasoning traces (typically English). As identifying understanding failures can enable targeted mitigation of the gap, we evaluate a range of detection methods and find that understanding failures are detectable to a meaningful extent, with supervised approaches performing best. Building on this, we propose Selective Translation, a strategy that incorporates an English translation into the initial reasoning trace only when an understanding failure is detected. Experimental results using Qwen3-4B show that Selective Translation substantially bridges the multilingual reasoning gap, achieving near full-translation performance while translating only about 20% of inputs. Together, our results show that failures in language understanding are the primary driver of the multilingual reasoning gap and can be detected and selectively mitigated, clarifying its origin and suggesting a path toward more equitable multilingual reasoning. Our code and data are publicly available at https://github.com/deokhk/RLM_analysis
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 36 of its 42 references that are in the map. First posted on arXiv 31 Oct 2025.
Builds on
36 of 42 references.
Closest ancestors · 9
Same direction, newest first
- 2025Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning7 Jul
- 2025AbstentionBench: Reasoning LLMs Fail on Unanswerable Questions10 Jun
- 2025Multilingual Test-Time Scaling via Initial Thought Transfer21 May
- 2025Language Mixing in Reasoning Language Models: Patterns, Impact, and Internal Causes20 May
- 2025Crosslingual Reasoning through Test-Time Scaling8 May
- 2025Could Thinking Multilingually Empower LLM Reasoning?16 Apr
- 2025MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation13 Mar
- 2024Question Translation Training for Better Multilingual Reasoning15 Jan
- 2024MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization12 Jan
Other references · 27
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
- 2016Bag of Tricks for Efficient Text Classificationcited by 876
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
- 2023Large Language Modelscited by 780
- 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 530
- 2020How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answeringcited by 445
- 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 420
- 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 384
15 more
- 2016FastText.zip: Compressing text classification modelscited by 335
- 2024Don't Hallucinate, Abstain: Identifying LLM Knowledge Gaps via Multi-LLM Collaborationcited by 180
- 2025Reasoning Models Know When They're Right: Probing Hidden States for Self-Verificationcited by 159
- 2023Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across Languagescited by 97
- 2025PolyMath: Evaluating Mathematical Reasoning in Multilingual Contextscited by 56
- 2024Uncertainty-Based Abstention in LLMs Improves Safety and Reduces Hallucinationscited by 54
- 2025mmBERT: A Modern Multilingual Encoder with Annealed Language Learningcited by 45
- 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gapcited by 43
- 2025Linguistic Generalizability of Test-Time Scaling in Mathematical Reasoningcited by 37
- 2024Is Translation All You Need? A Study on Solving Multilingual Tasks with Large Language Modelscited by 31
- 2024P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMscited by 29
- 2024Language Imbalance Driven Rewarding for Multilingual Self-improvingcited by 28
- 2025Can We Predict Alignment Before Models Finish Thinking? Towards Monitoring Misaligned Reasoning Modelscited by 17
- 2024Teaching LLMs to Abstain across Languages via Multilingual Feedbackcited by 14
- 2025Making Qwen3 Think in Korean with Reinforcement Learningcited by 5
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026Crosslingual On-Policy Self-Distillation for Multilingual Reasoningcited by 10
- 2026Large Reasoning Models Are (Not Yet) Multilingual Latent Reasonerscited by 9
- 2026TAPO: Translation Augmented Policy Optimization for Multilingual Mathematical Reasoningcited by 6
- 2026What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Featurescited by 4
- 2026Med-CoReasoner: Reducing Language Disparities in Medical Reasoning via Language-Informed Co-Reasoningcited by 2
- 2026Rethinking the Multilingual Reasoning Gap with Layer Swapcited by 2
- 2026Learning to Route Languages for Multilingual Policy Optimizationcited by 1
- 2026Learning When to Translate for Multilingual Reasoningcited by 1
- 2026Beyond Input Understanding: Diagnosing Multilingual Mathematical Reasoning with Directed Acyclic Trace Graphscited by 0
- 2026Native Multilingual Chain-of-Thought Reasoning in Low-Resource Southeast Asian Languagescited by 0
- 2026Enhancing Low-Resource Language Reasoning via High-Resource Language Feature Transfercited by 0
- 2026Rewrite What Matters: Adaptive Multilingual Query Rewriting for Reasoning via Agentic Reinforcement Learningcited by 0
- 2026Rewrite What Matters: Adaptive Multilingual Query Rewriting for Reasoning via Agentic Reinforcement Learning4 Oct 2026
- 2026Enhancing Low-Resource Language Reasoning via High-Resource Language Feature Transfer31 Aug 2026
- 2026Native Multilingual Chain-of-Thought Reasoning in Low-Resource Southeast Asian Languages1 Aug 2026
- 2026Learning When to Translate for Multilingual Reasoning1 Jun 2026
- 2026Beyond Input Understanding: Diagnosing Multilingual Mathematical Reasoning with Directed Acyclic Trace Graphs26 May 2026
- 2026Rethinking the Multilingual Reasoning Gap with Layer Swap26 May 2026
- 2026Learning to Route Languages for Multilingual Policy Optimization25 May 2026
- 2026Crosslingual On-Policy Self-Distillation for Multilingual Reasoning10 May 2026
- 2026What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Features6 Apr 2026
- 2026TAPO: Translation Augmented Policy Optimization for Multilingual Mathematical Reasoning26 Mar 2026
- 2026Med-CoReasoner: Reducing Language Disparities in Medical Reasoning via Language-Informed Co-Reasoning13 Jan 2026
- 2026Large Reasoning Models Are (Not Yet) Multilingual Latent Reasoners6 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Language Matters: How Do Multilingual Input and Reasoning Paths Affect Large Reasoning Models?
- 2025A Survey of Multilingual Reasoning in Language Models
- 2026Scaling Multilingual Safety and Reasoning Evaluation through Reasoning-Guided Translation
- 2025When Less Language is More: Language-Reasoning Disentanglement Makes LLMs Better Multilingual Reasoners
- 2025When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracy
- 2024Eliciting Better Multilingual Structured Reasoning from LLMs through Code
- 2023Breaking the Language Barrier: Improving Cross-Lingual Reasoning with Structured Self-Attention
- 2025Beg to Differ: Understanding Reasoning-Answer Misalignment Across Languages