Efficient Multilingual Reasoning Transfer via Progressive Code-Switching
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large reasoning models (LRMs) have achieved strong reasoning capabilities in English, yet their performance degrades significantly when required to reason in other languages. A natural solution is to transfer the model's English reasoning ability to target languages. However, existing transfer approaches typically rely on distilled target-language reasoning traces from stronger LRMs or online supervision from external judge models, which are costly and difficult to scale. In this paper, we propose PCS (Progressive Code-Switching), a more efficient transfer framework that requires only lightweight translation without any stronger model for distillation or judging. PCS first constructs code-switched reasoning traces by translating a subset of English reasoning steps into the target language, and uses them to initialize the model's code-switching ability via supervised fine-tuning. It then applies reinforcement learning with a step-level language consistency curriculum, progressively raising the target-language ratio until the model reasons entirely in the target language. This progressive design provides a smooth transfer path that avoids the instability and performance degradation commonly observed when directly enforcing target-language reasoning. Experiments on multiple benchmarks and five typologically diverse languages show that PCS substantially narrows the performance gap between target-language and English reasoning, yielding more language-consistent reasoning while maintaining competitive accuracy.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 18 of its 24 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
18 of 24 references.
Closest ancestors · 8
Same direction, newest first
- 2025Unlocking Multilingual Reasoning Capability of LLMs and LVLMs through Representation Engineering28 Nov
- 2025Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learning8 Oct
- 2025Pushing on Multilingual Reasoning Models with Language-Mixed Chain-of-Thought5 Oct
- 2025Language Matters: How Do Multilingual Input and Reasoning Paths Affect Large Reasoning Models?23 May
- 2025Qwen3 Technical Report14 May
- 2025AM-Thinking-v1: Advancing the Frontier of Reasoning at 32B Scale13 May
- 2025MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation13 Mar
- 2024MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization12 Jan
Other references · 10
- 2024OpenAI o1 System Cardcited by 1,244
- 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 281
- 2025Magistralcited by 60
- 2025PolyMath: Evaluating Mathematical Reasoning in Multilingual Contextscited by 56
- 2024mCoT: Multilingual Instruction Tuning for Reasoning Consistency in Language Modelscited by 33
- 2024Code-Switching Curriculum Learning for Multilingual Transfer in LLMscited by 27
- 2024MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignmentcited by 25
- 2025MMATH: A Multilingual Benchmark for Mathematical Reasoningcited by 17
- 2026CURE-Med: Curriculum-Informed Reinforcement Learning for Multilingual Medical Reasoningcited by 9
- 2026TranslateGemma Technical Reportcited by 7
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance
- 2026Learning When to Translate for Multilingual Reasoning
- 2025Parallel Scaling Law: Unveiling Reasoning Generalization through A Cross-Linguistic Perspective
- 2025Aligning Multilingual Reasoning with Verifiable Semantics from a High-Resource Expert Model
- 2026Cross-lingual Self-Consistency for Multilingual Reasoning with Language Models
- 2025The Impact of Language Mixing on Bilingual LLM Reasoning
- 2026R3S: Refining and Recovering Reinforcement Signals for Multilingual Understanding and Reasoning
- 2026Think Multilingual, Not Harder: A Data-Efficient Framework for Teaching Reasoning Models to Code-Switch