mlsanityData to 14 Oct 2026

Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoning

arXiv 2609.10445 ↗First posted 9 Sep 2026cs.CLcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Reasoning language models have made substantial advances on a variety of complex tasks, yet their capabilities remain overwhelmingly English-centric: models primarily reason in English regardless of the language they are prompted in. This is inaccessible for non-English-speaking users, risks losing the intent of the original question, and forgoes knowledge more readily expressed in the target language. In this work, we advance L2 reasoning, the ability of a model to reason consistently in the language of the user's prompt, thus building an in-language bridge between the prompt and the answer. We approach this problem from a data-centric angle, investigating how to optimize data composition and scheduling in SFT for reasoning generalization. Building Tiny Aya L2-Thinker at 3.35B scale, we achieve an L2 reasoning rate above 93% across 60 languages on 6 benchmarks spanning math, commonsense reasoning, instruction following, open-ended generation, and cultural reasoning while keeping performance strong. We show the path to generalizing L2 reasoning to held-out languages goes through broader language coverage, readily available multilingual non-reasoning data, and a sufficient English reasoning backbone. These findings indicate that reasoning is a language-agnostic behavior that can be transferred across typologically diverse languages through careful data mixing and without requiring reasoning supervision in every target language. We release our model weights and multilingual reasoning data to support further research on accessible, in-language reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 49 of its 92 references that are in the map. First posted on arXiv 9 Sep 2026.

Builds on

49 of 92 references.

Closest ancestors · 22

Same direction, newest first

  1. 2026ReasonOps: Operator Segmentation for LLM Reasoning Traces28 May
  2. 2026Rethinking the Multilingual Reasoning Gap with Layer Swap26 May
  3. 2026ReasonXL: Shifting LLM Reasoning Language Without Sacrificing Performance14 Apr
  4. 2026What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Features6 Apr
  5. 2025Global PIQA: Evaluating Commonsense Reasoning Across 100+ Languages and Cultures28 Oct
  6. 2025The Reasoning Lingua Franca: A Double-Edged Sword for Multilingual AI23 Oct
  7. 2025Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement Learning8 Oct
  8. 2025Pushing on Multilingual Reasoning Models with Language-Mixed Chain-of-Thought5 Oct
  9. 2025Parallel Scaling Law: Unveiling Reasoning Generalization through A Cross-Linguistic Perspective2 Oct
  10. 2025MERLIN: Multi-Stage Curriculum Alignment for Multilingual Encoder-LLM Integration in Cross-Lingual Reasoning9 Sep
  11. 2025Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning7 Jul
  12. 2025Cross-lingual Collapse: How Language-Centric Foundation Models Shape Reasoning in Large Language Models6 Jun
10 more
  1. 2025OpenThoughts: Data Recipes for Reasoning Models4 Jun
  2. 2025Language Matters: How Do Multilingual Input and Reasoning Paths Affect Large Reasoning Models?23 May
  3. 2025Qwen3 Technical Report14 May
  4. 2025AM-Thinking-v1: Advancing the Frontier of Reasoning at 32B Scale13 May
  5. 2025Crosslingual Reasoning through Test-Time Scaling8 May
  6. 2025LayAlign: Enhancing Multilingual Reasoning in Large Language Models via Layer-Wise Adaptive Fusion and Alignment Strategy17 Feb
  7. 2024DeepSeek-V3 Technical Report27 Dec
  8. 2024LangBridge: Multilingual Reasoning Without Multilingual Supervision19 Jan
  9. 2024Question Translation Training for Better Multilingual Reasoning15 Jan
  10. 2023Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting11 May

Other references · 27

  1. 2025Gemma 3 Technical Reportcited by 1,824
  2. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  3. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  4. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  5. 2025Reasoning Models Don't Always Say What They Thinkcited by 415
  6. 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 177
  7. 2025Llama-Nemotron: Efficient Reasoning Modelscited by 158
  8. 2025Olmo 3cited by 129
  9. 2025NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Modelcited by 108
  10. 2025Magistralcited by 60
  11. 2024mCoT: Multilingual Instruction Tuning for Reasoning Consistency in Language Modelscited by 33
  12. 2025Language-Specific Latent Process Hinders Cross-Lingual Performancecited by 21
15 more
  1. 2025MMATH: A Multilingual Benchmark for Mathematical Reasoningcited by 17
  2. 2026Tiny Aya: Bridging Scale and Multilingual Depthcited by 15
  3. 2025The Multilingual Divide and Its Impact on Global AI Safetycited by 10
  4. 2026CURE-Med: Curriculum-Informed Reinforcement Learning for Multilingual Medical Reasoningcited by 9
  5. 2025Making Qwen3 Think in Korean with Reinforcement Learningcited by 5
  6. 2025The Art of Asking: Multilingual Prompt Optimization for Synthetic Datacited by 5
  7. 2026Understanding Reasoning from Pretraining to Post-Trainingcited by 5
  8. 2025Scale or Reason? A Compute-Equivalent Analysis of Reasoning Distillationcited by 3
  9. 2026ExpLang: Improved Exploration and Exploitation in LLM Reasoning with On-Policy Thinking Language Selectioncited by 3
  10. 2024KCIF: Knowledge-Conditioned Instruction Followingcited by 2
  11. 2025Marco-Bench-MIF: On Multilingual Instruction-Following Capability of Large Language Modelscited by 2
  12. 2025Multilingual Medical Reasoning for Question Answering with Large Language Modelscited by 2
  13. 2026Round-Trip Translation Reveals What Frontier Multilingual Benchmarks Misscited by 2
  14. 2026Think Multilingual, Not Harder: A Data-Efficient Framework for Teaching Reasoning Models to Code-Switchcited by 2
  15. 2026The Culture Funnel: You Can't Align What isn't in the Datacited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Eliciting Better Multilingual Structured Reasoning from LLMs through Code
  2. 2025When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracy
  3. 2022Language Models are Multilingual Chain-of-Thought Reasoners
  4. 2025A Survey of Multilingual Reasoning in Language Models
  5. 2025MultiNRC: A Challenging and Native Multilingual Reasoning Evaluation Benchmark for LLMs
  6. 2025EfficientXLang: Towards Improving Token Efficiency Through Cross-Lingual Reasoning
  7. 2026Beyond Input Understanding: Diagnosing Multilingual Mathematical Reasoning with Directed Acyclic Trace Graphs
  8. 2026AdaMame: A Training Recipe for Adaptive Multilingual Reasoning