MiroMind-M1: An Open-Source Advancement in Mathematical Reasoning via Context-Aware Multi-Stage Policy Optimization
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Large language models have recently evolved from fluent text generation to advanced reasoning across diverse domains, giving rise to reasoning language models. Among these domains, mathematical reasoning serves as a representative benchmark as it requires precise multi-step logic and abstract reasoning, which can be generalized to other tasks. While closed-source RLMs such as GPT-o3 demonstrate impressive reasoning capabilities, their proprietary nature limits transparency and reproducibility. Although many open-source projects aim to close this gap, most of them lack sufficient openness by omitting critical resources such as datasets and detailed training configurations, which hinders reproducibility. To contribute toward greater transparency in RLM development, we introduce the MiroMind-M1 series, a set of fully open-source RLMs built on the Qwen-2.5 backbone that match or exceed the performance of existing open-source RLMs. Specifically, our models are trained in two stages: SFT on a carefully curated corpus of 719K math-reasoning problems with verified CoT trajectories, followed by RLVR on 62K challenging and verifiable problems. To enhance the robustness and efficiency of the RLVR process, we introduce Context-Aware Multi-Stage Policy Optimization, an algorithm that integrates length-progressive training with an adaptive repetition penalty to encourage context-aware RL training. Our model achieves state-of-the-art or competitive performance and superior token efficiency among Qwen-2.5-based open-source 7B and 32B models on the AIME24, AIME25, and MATH benchmarks. To facilitate reproducibility, we release the complete stack: models (MiroMind-M1-SFT-7B, MiroMind-M1-RL-7B, MiroMind-M1-RL-32B); datasets (MiroMind-M1-SFT-719K, MiroMind-M1-RL-62K); and all training and evaluation configurations. We hope these resources will support further research and foster community advancement.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 53 references that are in the map. First posted on arXiv 19 Jul 2025.
Builds on
41 of 53 references.
Closest ancestors · 2
Same direction, newest first
- 2024HARP: A challenging human-annotated math reasoning benchmark11 Dec
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models5 Feb
Other references · 39
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023Let's Verify Step by Stepcited by 3,598
27 more
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,276
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
- 2025SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wildcited by 505
- 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 450
- 2024Measuring short-form factuality in large language modelscited by 345
- 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 308
- 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 291
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
- 2025VAPO: Efficient and Reliable Reinforcement Learning for Advanced Reasoning Taskscited by 281
- 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoningcited by 261
- 2025Logic-RL: Unleashing LLM Reasoning with Rule-Based Reinforcement Learningcited by 260
- 2025Light-R1: Curriculum SFT, DPO and RL for Long COT from Scratch and Beyondcited by 175
- 2024Long-form factuality in large language modelscited by 146
- 2025MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttrainingcited by 117
- 2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Codingcited by 115
- 2025Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Modelscited by 104
- 2025What's Behind PPO's Collapse in Long-CoT? Value Optimization Holds the Secretcited by 95
- 2025Not All Rollouts are Useful: Down-Sampling Rollouts in LLM Reinforcement Learningcited by 84
- 2025PlanGenLLMs: A Modern Survey of LLM Planning Capabilitiescited by 82
- 20251.4 Million Open-Source Distilled Reasoning Dataset to Empower Large Language Model Trainingcited by 49
- 2025100 Days After DeepSeek-R1: A Survey on Replication Studies and More Directions for Reasoning Language Modelscited by 29
- 2025AM-Thinking-v1: Advancing the Frontier of Reasoning at 32B Scalecited by 29
- 2025DeepDistill: Enhancing LLM Reasoning Capabilities via Large-Scale Difficulty-Graded Data Trainingcited by 17
- 2025Reasoning Does Not Necessarily Improve Role-Playing Abilitycited by 14
Built on by
Citing papers per year: 2025: 7; 2026: 5.
12 papers.
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 175
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipecited by 37
- 2025OpenDataArena: A Fair and Open Arena for Benchmarking Post-Training Dataset Valuecited by 15
- 2026Distribution-Aligned Sequence Distillation for Superior Long-CoT Reasoningcited by 13
- 2025First Try Matters: Revisiting the Role of Reflection in Reasoning Modelscited by 12
- 2025Closing the Data Loop: Using OpenDataArena to Engineer Superior Training Datasetscited by 4
- 2025Pinpointing crucial steps: Attribution-based Credit Assignment for Verifiable Reinforcement Learningcited by 3
- 2026AGORA: An Archive-Grounded Benchmark for Agentic Workplace Document Reasoningcited by 3
- 2026Tracing the Roots: A Multi-Agent Framework for Uncovering Data Lineage in Post-Training LLMscited by 2
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolutioncited by 1
- 2025Input-Time Scaling: Adding Noise and Irrelevance into Less-Is-More Drastically Improves Reasoning Performance and Efficiencycited by 0
- 2026Attention Amnesia in Hybrid LLMs: When CoT Fine-Tuning Breaks Long-Range Recall, and How to Fix Itcited by 0
- 2026AGORA: An Archive-Grounded Benchmark for Agentic Workplace Document Reasoning23 Jun 2026
- 2026Attention Amnesia in Hybrid LLMs: When CoT Fine-Tuning Breaks Long-Range Recall, and How to Fix It9 Jun 2026
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution25 May 2026
- 2026Tracing the Roots: A Multi-Agent Framework for Uncovering Data Lineage in Post-Training LLMs12 Apr 2026
- 2026Distribution-Aligned Sequence Distillation for Superior Long-CoT Reasoning14 Jan 2026
- 2025Closing the Data Loop: Using OpenDataArena to Engineer Superior Training Datasets30 Dec 2025
- 2025OpenDataArena: A Fair and Open Arena for Benchmarking Post-Training Dataset Value16 Dec 2025
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe20 Nov 2025
- 2025Pinpointing crucial steps: Attribution-based Credit Assignment for Verifiable Reinforcement Learning10 Oct 2025
- 2025First Try Matters: Revisiting the Role of Reflection in Reasoning Models9 Oct 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Models10 Sep 2025
- 2025Input-Time Scaling: Adding Noise and Irrelevance into Less-Is-More Drastically Improves Reasoning Performance and Efficiency19 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025THOR: Tool-Integrated Hierarchical Optimization via RL for Mathematical Reasoning
- 2025JT-Math: A Multi-Stage Framework for Advanced Mathematical Reasoning in Large Language Models
- 2026Mathematical Reasoning in Large Language Models: Benchmarks, Architectures, Evaluation, and Open Challenges
- 2026PCL-Reasoner-V1.5: Advancing Math Reasoning with Offline Reinforcement Learning
- 2025Effective Learning for Small Reasoning Models: An Empirical Study on 0.5B Reasoning LLMs
- 2026General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks
- 2025Motif-2-12.7B-Reasoning: A Practitioner's Guide to RL Training Recipes
- 2026More Accurate or More Efficient? Evaluating Locally Deployed Compact Open-Weight Language Models for Mathematical Reasoning