Language Matters: How Do Multilingual Input and Reasoning Paths Affect Large Reasoning Models?
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large reasoning models (LRMs) have demonstrated impressive performance across a range of reasoning tasks, yet little is known about their internal reasoning processes in multilingual settings. We begin with a critical question: it In which language do these models reason when solving problems presented in different languages? Our findings reveal that, despite multilingual training, LRMs tend to default to reasoning in high-resource languages (e.g., English) at test time, regardless of the input language. When constrained to reason in the same language as the input, model performance declines, especially for low-resource languages. In contrast, reasoning in high-resource languages generally preserves performance. We conduct extensive evaluations across reasoning-intensive tasks (MMMLU, MATH-500) and non-reasoning benchmarks (CulturalBench, LMSYS-toxic), showing that the effect of language choice varies by task type: input-language reasoning degrades performance on reasoning tasks but benefits cultural tasks, while safety evaluations exhibit language-specific behavior. By exposing these linguistic biases in LRMs, our work highlights a critical step toward developing more equitable models that serve users across diverse linguistic backgrounds.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 18 of its 24 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
18 of 24 references.
Closest ancestors · 2
Same direction, newest first
- 2025Analogical Reasoning Inside Large Language Models: Concept Vectors and the Limits of Abstraction5 Mar
- 2025Do Multilingual LLMs Think In English?21 Feb
Other references · 16
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2025s1: Simple test-time scalingcited by 1,341
- 2024OpenAI o1 System Cardcited by 1,244
- 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 735
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
- 2025LIMO: Less is More for Reasoningcited by 498
- 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
- 2025Reasoning Models Don't Always Say What They Thinkcited by 415
4 more
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
- 2023SafetyBench: Evaluating the Safety of Large Language Modelscited by 199
- 2024The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalitiescited by 69
- 2024CulturalBench: A Robust, Diverse, and Challenging Cultural Benchmark by Human-AI CulturalTeamingcited by 30
Built on by
Citing papers per year: 2025: 3; 2026: 17.
20 papers.
Sort:
By area:
- 2025Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learningcited by 18
- 2026Crosslingual On-Policy Self-Distillation for Multilingual Reasoningcited by 10
- 2026Large Reasoning Models Are (Not Yet) Multilingual Latent Reasonerscited by 9
- 2026Gained in Translation: Privileged Pairwise Judges Enhance Multilingual Reasoningcited by 6
- 2026TAPO: Translation Augmented Policy Optimization for Multilingual Mathematical Reasoningcited by 6
- 2026ReasonXL: Shifting LLM Reasoning Language Without Sacrificing Performancecited by 5
- 2026What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Featurescited by 4
- 2025The Reasoning Lingua Franca: A Double-Edged Sword for Multilingual AIcited by 3
- 2025Cross-Lingual Prompt Steerability: Towards Accurate and Robust LLM Behavior across Languagescited by 3
- 2026MGSM-Pro: A Simple Strategy for Robust Multilingual Mathematical Reasoning Evaluationcited by 3
- 2026Med-CoReasoner: Reducing Language Disparities in Medical Reasoning via Language-Informed Co-Reasoningcited by 2
- 2026Think Multilingual, Not Harder: A Data-Efficient Framework for Teaching Reasoning Models to Code-Switchcited by 2
8 more
- 2026Efficient Multilingual Reasoning Transfer via Progressive Code-Switchingcited by 2
- 2026Learning When to Translate for Multilingual Reasoningcited by 1
- 2026Beyond Input Understanding: Diagnosing Multilingual Mathematical Reasoning with Directed Acyclic Trace Graphscited by 0
- 2026AdaMame: A Training Recipe for Adaptive Multilingual Reasoningcited by 0
- 2026MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoningcited by 0
- 2026RP-OPSD: Reasoning-Pivot-Guided On-Policy Self-Distillation for Multilingual Reasoning Transfercited by 0
- 2026GRPO Beyond English: A Large-Scale Study of GRPO in Non-English and Multilingual Settingscited by 0
- 2026Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoningcited by 0
- 2026Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoning9 Sep 2026
- 2026GRPO Beyond English: A Large-Scale Study of GRPO in Non-English and Multilingual Settings13 Aug 2026
- 2026RP-OPSD: Reasoning-Pivot-Guided On-Policy Self-Distillation for Multilingual Reasoning Transfer6 Aug 2026
- 2026MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoning13 Jul 2026
- 2026Efficient Multilingual Reasoning Transfer via Progressive Code-Switching1 Jul 2026
- 2026AdaMame: A Training Recipe for Adaptive Multilingual Reasoning13 Jun 2026
- 2026Learning When to Translate for Multilingual Reasoning1 Jun 2026
- 2026Beyond Input Understanding: Diagnosing Multilingual Mathematical Reasoning with Directed Acyclic Trace Graphs26 May 2026
- 2026Crosslingual On-Policy Self-Distillation for Multilingual Reasoning10 May 2026
- 2026Think Multilingual, Not Harder: A Data-Efficient Framework for Teaching Reasoning Models to Code-Switch16 Apr 2026
- 2026ReasonXL: Shifting LLM Reasoning Language Without Sacrificing Performance14 Apr 2026
- 2026What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Features6 Apr 2026
8 more
- 2026TAPO: Translation Augmented Policy Optimization for Multilingual Mathematical Reasoning26 Mar 2026
- 2026MGSM-Pro: A Simple Strategy for Robust Multilingual Mathematical Reasoning Evaluation29 Jan 2026
- 2026Gained in Translation: Privileged Pairwise Judges Enhance Multilingual Reasoning26 Jan 2026
- 2026Med-CoReasoner: Reducing Language Disparities in Medical Reasoning via Language-Informed Co-Reasoning13 Jan 2026
- 2026Large Reasoning Models Are (Not Yet) Multilingual Latent Reasoners6 Jan 2026
- 2025Cross-Lingual Prompt Steerability: Towards Accurate and Robust LLM Behavior across Languages2 Dec 2025
- 2025The Reasoning Lingua Franca: A Double-Edged Sword for Multilingual AI23 Oct 2025
- 2025Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learning8 Oct 2025
- 2025Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learningcited by 18
- 2026Crosslingual On-Policy Self-Distillation for Multilingual Reasoningcited by 10
- 2026Large Reasoning Models Are (Not Yet) Multilingual Latent Reasonerscited by 9
- 2026Gained in Translation: Privileged Pairwise Judges Enhance Multilingual Reasoningcited by 6
- 2026TAPO: Translation Augmented Policy Optimization for Multilingual Mathematical Reasoningcited by 6
- 2026ReasonXL: Shifting LLM Reasoning Language Without Sacrificing Performancecited by 5
- 2026What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Featurescited by 4
- 2025The Reasoning Lingua Franca: A Double-Edged Sword for Multilingual AIcited by 3
- 2026MGSM-Pro: A Simple Strategy for Robust Multilingual Mathematical Reasoning Evaluationcited by 3
- 2026Med-CoReasoner: Reducing Language Disparities in Medical Reasoning via Language-Informed Co-Reasoningcited by 2
- 2026Think Multilingual, Not Harder: A Data-Efficient Framework for Teaching Reasoning Models to Code-Switchcited by 2
- 2026Efficient Multilingual Reasoning Transfer via Progressive Code-Switchingcited by 2
12 most cited of 19 All 19 (JSON)
- 2026Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoning9 Sep 2026
- 2026GRPO Beyond English: A Large-Scale Study of GRPO in Non-English and Multilingual Settings13 Aug 2026
- 2026RP-OPSD: Reasoning-Pivot-Guided On-Policy Self-Distillation for Multilingual Reasoning Transfer6 Aug 2026
- 2026MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoning13 Jul 2026
- 2026Efficient Multilingual Reasoning Transfer via Progressive Code-Switching1 Jul 2026
- 2026AdaMame: A Training Recipe for Adaptive Multilingual Reasoning13 Jun 2026
- 2026Learning When to Translate for Multilingual Reasoning1 Jun 2026
- 2026Beyond Input Understanding: Diagnosing Multilingual Mathematical Reasoning with Directed Acyclic Trace Graphs26 May 2026
- 2026Crosslingual On-Policy Self-Distillation for Multilingual Reasoning10 May 2026
- 2026Think Multilingual, Not Harder: A Data-Efficient Framework for Teaching Reasoning Models to Code-Switch16 Apr 2026
- 2026ReasonXL: Shifting LLM Reasoning Language Without Sacrificing Performance14 Apr 2026
- 2026What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Features6 Apr 2026
12 newest of 19 All 19 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking the Multilingual Reasoning Gap with Layer Swap
- 2025When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracy
- 2025A Survey of Multilingual Reasoning in Language Models
- 2025Why Do Multilingual Reasoning Gaps Emerge in Reasoning Language Models?
- 2024Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Survey
- 2025A Comprehensive Evaluation of Multilingual Chain-of-Thought Reasoning: Performance, Consistency, and Faithfulness Across Languages
- 2025Language Mixing in Reasoning Language Models: Patterns, Impact, and Internal Causes
- 2025When Less Language is More: Language-Reasoning Disentanglement Makes LLMs Better Multilingual Reasoners