Multilingual Reasoning Gym: Multilingual Scaling of Procedural Reasoning Environments
Not on the map. Why?
Abstract (arXiv)
We present the Multilingual Reasoning Gym, an extension of Reasoning Gym (Stojanovski et al., 2025), that procedurally generates verifiable reasoning problems across 14 languages. We translate templates for 94 tasks with native-speaker validation in 10 languages and targeted code or template adaptations to ensure linguistic naturalness. The Multilingual Reasoning Gym preserves the core benefits of the procedural generation approach used in the original Reasoning Gym, such as virtually unlimited problem instance generation and adjustable difficulty, and remains directly usable for Reinforcement Learning from Verifiable Rewards and evaluation settings. Problems in the Multilingual Reasoning Gym are parallel across languages, enabling crosslingually parallel data generation at massive scale due to the procedural nature of the environments. We release our implementation to support research into multilingual reasoning models.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 10 of its 13 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
10 of 13 references.
References · 10
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
- 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
- 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 138
- 2023Investigating Data Contamination in Modern Benchmarks for Large Language Modelscited by 136
- 2025REASONING GYM: Reasoning Environments for Reinforcement Learning with Verifiable Rewardscited by 121
- 2025PolyMath: Evaluating Mathematical Reasoning in Multilingual Contextscited by 52
- 2025Linguistic Generalizability of Test-Time Scaling in Mathematical Reasoningcited by 33
- 2025AutoLogi: Automated Generation of Logic Puzzles for Evaluating Reasoning Abilities of Large Language Modelscited by 29
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Featurescited by 4
- 2026Skill Issue: Are Skills Language-Invariant in LLMs?cited by 1
- 2026XLGoBench: Detecting cross-lingual skill gaps with algorithmic taskscited by 0
- 2026NOLLI: A Difficulty-Calibrated Puzzle Benchmark for Diagnosing the English-Korean Performance Gapcited by 0
- 2026GRPO Beyond English: A Large-Scale Study of GRPO in Non-English and Multilingual Settingscited by 0
- 2026Skill Issue: Are Skills Language-Invariant in LLMs?26 Aug 2026
- 2026GRPO Beyond English: A Large-Scale Study of GRPO in Non-English and Multilingual Settings13 Aug 2026
- 2026NOLLI: A Difficulty-Calibrated Puzzle Benchmark for Diagnosing the English-Korean Performance Gap5 Aug 2026
- 2026XLGoBench: Detecting cross-lingual skill gaps with algorithmic tasks29 May 2026
- 2026What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Features6 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Cross-lingual Self-Consistency for Multilingual Reasoning with Language Models
- 2026LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance
- 2025Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning
- 2026Rethinking the Multilingual Reasoning Gap with Layer Swap
- 2025Aligning Multilingual Reasoning with Verifiable Semantics from a High-Resource Expert Model
- 2026What Does Post-Training Change in Multilingual Reasoning?
- 2025Parallel Scaling Law: Unveiling Reasoning Generalization through A Cross-Linguistic Perspective
- 2025AdaMCoT: Rethinking Cross-Lingual Factual Reasoning through Adaptive Multilingual Chain-of-Thought