mlsanityData to 14 Oct 2026

Language Matters: How Do Multilingual Input and Reasoning Paths Affect Large Reasoning Models?

arXiv 2505.17407 ↗First posted 23 May 2025cs.CLcited by 20

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large reasoning models (LRMs) have demonstrated impressive performance across a range of reasoning tasks, yet little is known about their internal reasoning processes in multilingual settings. We begin with a critical question: it In which language do these models reason when solving problems presented in different languages? Our findings reveal that, despite multilingual training, LRMs tend to default to reasoning in high-resource languages (e.g., English) at test time, regardless of the input language. When constrained to reason in the same language as the input, model performance declines, especially for low-resource languages. In contrast, reasoning in high-resource languages generally preserves performance. We conduct extensive evaluations across reasoning-intensive tasks (MMMLU, MATH-500) and non-reasoning benchmarks (CulturalBench, LMSYS-toxic), showing that the effect of language choice varies by task type: input-language reasoning degrades performance on reasoning tasks but benefits cultural tasks, while safety evaluations exhibit language-specific behavior. By exposing these linguistic biases in LRMs, our work highlights a critical step toward developing more equitable models that serve users across diverse linguistic backgrounds.

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 18 of its 24 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

18 of 24 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Analogical Reasoning Inside Large Language Models: Concept Vectors and the Limits of Abstraction5 Mar
  2. 2025Do Multilingual LLMs Think In English?21 Feb

Other references · 16

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  4. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  5. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  6. 2025s1: Simple test-time scalingcited by 1,341
  7. 2024OpenAI o1 System Cardcited by 1,244
  8. 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 735
  9. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
  10. 2025LIMO: Less is More for Reasoningcited by 498
  11. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
  12. 2025Reasoning Models Don't Always Say What They Thinkcited by 415
4 more
  1. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
  2. 2023SafetyBench: Evaluating the Safety of Large Language Modelscited by 199
  3. 2024The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalitiescited by 69
  4. 2024CulturalBench: A Robust, Diverse, and Challenging Cultural Benchmark by Human-AI CulturalTeamingcited by 30

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 17.

20 papers.

Sort:

By area:

  1. 2025Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learningcited by 18
  2. 2026Crosslingual On-Policy Self-Distillation for Multilingual Reasoningcited by 10
  3. 2026Large Reasoning Models Are (Not Yet) Multilingual Latent Reasonerscited by 9
  4. 2026Gained in Translation: Privileged Pairwise Judges Enhance Multilingual Reasoningcited by 6
  5. 2026TAPO: Translation Augmented Policy Optimization for Multilingual Mathematical Reasoningcited by 6
  6. 2026ReasonXL: Shifting LLM Reasoning Language Without Sacrificing Performancecited by 5
  7. 2026What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Featurescited by 4
  8. 2025The Reasoning Lingua Franca: A Double-Edged Sword for Multilingual AIcited by 3
  9. 2025Cross-Lingual Prompt Steerability: Towards Accurate and Robust LLM Behavior across Languagescited by 3
  10. 2026MGSM-Pro: A Simple Strategy for Robust Multilingual Mathematical Reasoning Evaluationcited by 3
  11. 2026Med-CoReasoner: Reducing Language Disparities in Medical Reasoning via Language-Informed Co-Reasoningcited by 2
  12. 2026Think Multilingual, Not Harder: A Data-Efficient Framework for Teaching Reasoning Models to Code-Switchcited by 2
8 more
  1. 2026Efficient Multilingual Reasoning Transfer via Progressive Code-Switchingcited by 2
  2. 2026Learning When to Translate for Multilingual Reasoningcited by 1
  3. 2026Beyond Input Understanding: Diagnosing Multilingual Mathematical Reasoning with Directed Acyclic Trace Graphscited by 0
  4. 2026AdaMame: A Training Recipe for Adaptive Multilingual Reasoningcited by 0
  5. 2026MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoningcited by 0
  6. 2026RP-OPSD: Reasoning-Pivot-Guided On-Policy Self-Distillation for Multilingual Reasoning Transfercited by 0
  7. 2026GRPO Beyond English: A Large-Scale Study of GRPO in Non-English and Multilingual Settingscited by 0
  8. 2026Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Rethinking the Multilingual Reasoning Gap with Layer Swap
  2. 2025When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracy
  3. 2025A Survey of Multilingual Reasoning in Language Models
  4. 2025Why Do Multilingual Reasoning Gaps Emerge in Reasoning Language Models?
  5. 2024Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Survey
  6. 2025A Comprehensive Evaluation of Multilingual Chain-of-Thought Reasoning: Performance, Consistency, and Faithfulness Across Languages
  7. 2025Language Mixing in Reasoning Language Models: Patterns, Impact, and Internal Causes
  8. 2025When Less Language is More: Language-Reasoning Disentanglement Makes LLMs Better Multilingual Reasoners