mlsanityData to 14 Oct 2026

Why Do Multilingual Reasoning Gaps Emerge in Reasoning Language Models?

arXiv 2510.27269 ↗First posted 31 Oct 2025cs.CL cs.AI cs.LGcited by 12

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, yet they still exhibit a multilingual reasoning gap, performing better in high-resource languages than in low-resource ones. While recent efforts have been made to address this gap, its underlying causes remain largely unexplored. In this work, we show that this gap primarily stems from failures in language understanding-specifically, the model's inability to translate multilingual inputs into the language dominating its reasoning traces (typically English). As identifying understanding failures can enable targeted mitigation of the gap, we evaluate a range of detection methods and find that understanding failures are detectable to a meaningful extent, with supervised approaches performing best. Building on this, we propose Selective Translation, a strategy that incorporates an English translation into the initial reasoning trace only when an understanding failure is detected. Experimental results using Qwen3-4B show that Selective Translation substantially bridges the multilingual reasoning gap, achieving near full-translation performance while translating only about 20% of inputs. Together, our results show that failures in language understanding are the primary driver of the multilingual reasoning gap and can be detected and selectively mitigated, clarifying its origin and suggesting a path toward more equitable multilingual reasoning. Our code and data are publicly available at https://github.com/deokhk/RLM_analysis

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 36 of its 42 references that are in the map. First posted on arXiv 31 Oct 2025.

Builds on

36 of 42 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning7 Jul
  2. 2025AbstentionBench: Reasoning LLMs Fail on Unanswerable Questions10 Jun
  3. 2025Multilingual Test-Time Scaling via Initial Thought Transfer21 May
  4. 2025Language Mixing in Reasoning Language Models: Patterns, Impact, and Internal Causes20 May
  5. 2025Crosslingual Reasoning through Test-Time Scaling8 May
  6. 2025Could Thinking Multilingually Empower LLM Reasoning?16 Apr
  7. 2025MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation13 Mar
  8. 2024Question Translation Training for Better Multilingual Reasoning15 Jan
  9. 2024MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization12 Jan

Other references · 27

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  2. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  3. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  4. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  5. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
  6. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  7. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  8. 2023Large Language Modelscited by 780
  9. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 530
  10. 2020How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answeringcited by 445
  11. 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 420
  12. 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 384
15 more
  1. 2016FastText.zip: Compressing text classification modelscited by 335
  2. 2024Don't Hallucinate, Abstain: Identifying LLM Knowledge Gaps via Multi-LLM Collaborationcited by 180
  3. 2025Reasoning Models Know When They're Right: Probing Hidden States for Self-Verificationcited by 159
  4. 2023Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across Languagescited by 97
  5. 2025PolyMath: Evaluating Mathematical Reasoning in Multilingual Contextscited by 56
  6. 2024Uncertainty-Based Abstention in LLMs Improves Safety and Reduces Hallucinationscited by 54
  7. 2025mmBERT: A Modern Multilingual Encoder with Annealed Language Learningcited by 45
  8. 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gapcited by 43
  9. 2025Linguistic Generalizability of Test-Time Scaling in Mathematical Reasoningcited by 37
  10. 2024Is Translation All You Need? A Study on Solving Multilingual Tasks with Large Language Modelscited by 31
  11. 2024P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMscited by 29
  12. 2024Language Imbalance Driven Rewarding for Multilingual Self-improvingcited by 28
  13. 2025Can We Predict Alignment Before Models Finish Thinking? Towards Monitoring Misaligned Reasoning Modelscited by 17
  14. 2024Teaching LLMs to Abstain across Languages via Multilingual Feedbackcited by 14
  15. 2025Making Qwen3 Think in Korean with Reinforcement Learningcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Language Matters: How Do Multilingual Input and Reasoning Paths Affect Large Reasoning Models?
  2. 2025A Survey of Multilingual Reasoning in Language Models
  3. 2026Scaling Multilingual Safety and Reasoning Evaluation through Reasoning-Guided Translation
  4. 2025When Less Language is More: Language-Reasoning Disentanglement Makes LLMs Better Multilingual Reasoners
  5. 2025When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracy
  6. 2024Eliciting Better Multilingual Structured Reasoning from LLMs through Code
  7. 2023Breaking the Language Barrier: Improving Cross-Lingual Reasoning with Structured Self-Attention
  8. 2025Beg to Differ: Understanding Reasoning-Answer Misalignment Across Languages