mlsanityData to 7 Oct 2026

OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset

arXiv 2402.10176 ↗First posted 15 Feb 2024cs.CL cs.AI cs.LGcited by 143

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Recent work has shown the immense potential of synthetically generated datasets for training large language models (LLMs), especially for acquiring targeted skills. Current large-scale math instruction tuning datasets such as MetaMathQA (Yu et al., 2024) and MAmmoTH (Yue et al., 2024) are constructed using outputs from closed-source LLMs with commercially restrictive licenses. A key reason limiting the use of open-source LLMs in these data generation pipelines has been the wide gap between the mathematical skills of the best closed-source LLMs, such as GPT-4, and the best open-source LLMs. Building on the recent progress in open-source LLMs, our proposed prompting novelty, and some brute-force scaling, we construct OpenMathInstruct-1, a math instruction tuning dataset with 1.8M problem-solution pairs. The dataset is constructed by synthesizing code-interpreter solutions for GSM8K and MATH, two popular math reasoning benchmarks, using the recently released and permissively licensed Mixtral model. Our best model, OpenMath-CodeLlama-70B, trained on a subset of OpenMathInstruct-1, achieves a score of 84.6% on GSM8K and 50.7% on MATH, which is competitive with the best gpt-distilled models. We release our code, models, and the OpenMathInstruct-1 dataset under a commercially permissive license.

Key facts. Cited by 143 papers in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 31 of its 40 references that are in the map. First posted on arXiv 15 Feb 2024.

Builds on

31 of 40 references.

Closest ancestors · 9

Same direction, newest first

  1. 2024MARIO: MAth Reasoning with code Interpreter Output -- A Reproducible Pipeline16 Jan
  2. 2023TinyGSM: achieving >80% on GSM8k with small language models14 Dec
  3. 2023MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning5 Oct
  4. 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving29 Sep
  5. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct18 Aug
  6. 2023Solving Challenging Math Word Problems Using GPT-4 Code Interpreter with Code-based Self-Verification15 Aug
  7. 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Models3 Aug
  8. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoning29 Sep
  9. 2022Solving Quantitative Reasoning Problems with Language Models29 Jun

Other references · 22

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  6. 2023Let's Verify Step by Stepcited by 3,598
  7. 2023Code Llama: Open Foundation Models for Codecited by 2,105
  8. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  9. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  10. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
  11. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
  12. 2022Galactica: A Large Language Model for Sciencecited by 736
10 more
  1. 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 724
  2. 2022Large Language Models Can Self-Improvecited by 656
  3. 2022PAL: Program-aided Language Modelscited by 635
  4. 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
  5. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 483
  6. 2023TinyStories: How Small Can Language Models Be and Still Speak Coherent English?cited by 425
  7. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 369
  8. 2021A Diverse Corpus for Evaluating and Developing English Math Word Problem Solverscited by 314
  9. 2023How is ChatGPT's behavior changing over time?cited by 265
  10. 2019NeMo: a toolkit for building AI applications using Neural Modulescited by 230

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 60; 2025: 58; 2026: 25.

143 papers.

Sort:

By area:

  1. 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMscited by 265
  2. 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoningcited by 261
  3. 2024Iterative Reasoning Preference Optimizationcited by 244
  4. 2024OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Datacited by 194
  5. 2024Advancing LLM Reasoning Generalists with Preference Treescited by 191
  6. 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetcited by 165
  7. 2024Recursive Introspection: Teaching Language Model Agents How to Self-Improvecited by 162
  8. 2024MAmmoTH2: Scaling Instructions from the Webcited by 143
  9. 2025A Minimalist Approach to LLM Reasoning: from Rejection Sampling to Reinforcecited by 141
  10. 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 134
  11. 2025Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretrainingcited by 123
  12. 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
38 more
  1. 2024DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solvingcited by 92
  2. 2024LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoningcited by 90
  3. 2025Eagle 2: Building Post-Training Data Strategies from Scratch for Frontier Vision-Language Modelscited by 69
  4. 2025Self-rewarding correction for mathematical reasoningcited by 67
  5. 2024Building Math Agents with Multi-Turn Iterative Preference Learningcited by 66
  6. 2024Unlocking the Capabilities of Thought: A Reasoning Boundary Framework to Quantify and Optimize Chain-of-Thoughtcited by 56
  7. 2024A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challengescited by 55
  8. 2025Beyond Pass@1: Self-Play with Variational Problem Synthesis Sustains RLVRcited by 53
  9. 2025A Survey on Large Language Models for Mathematical Reasoningcited by 52
  10. 2025FLEX: Continuous Agent Evolution via Forward Learning from Experiencecited by 51
  11. 2024Consent in Crisis: The Rapid Decline of the AI Data Commonscited by 45
  12. 2024JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis Modelscited by 44
  13. 2025ToolOrchestra: Elevating Intelligence via Efficient Model and Tool Orchestrationcited by 44
  14. 2024Improving LLM Reasoning through Scaling Inference Computation with Collaborative Verificationcited by 40
  15. 2025SwS: Self-aware Weakness-driven Problem Synthesis in Reinforcement Learning for LLM Reasoningcited by 39
  16. 2024Entropy-Regularized Process Reward Modelcited by 38
  17. 2024SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literaturecited by 37
  18. 2024AI-Assisted Generation of Difficult Math Questionscited by 37
  19. 2025Reverse-Engineered Reasoning for Open-Ended Generationcited by 32
  20. 2024Self-Explore: Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewardscited by 31
  21. 2024Code Pretraining Improves Entity Tracking Abilities of Language Modelscited by 31
  22. 2024GeoGPT4V: Towards Geometric Multi-modal Large Language Models with Geometric Image Generationcited by 31
  23. 2024Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Modelscited by 31
  24. 2024LiteSearch: Efficacious Tree Search for LLMcited by 30
  25. 2025Leveraging Online Olympiad-Level Math Problems for LLMs Training and Contamination-Resistant Evaluationcited by 29
  26. 2025Nemotron-CrossThink: Scaling Self-Learning beyond Math Reasoningcited by 29
  27. 2024MathChat: Benchmarking Mathematical Reasoning and Instruction Following in Multi-Turn Interactionscited by 26
  28. 2024BlueLM-V-3B: Algorithm and System Co-Design for Multimodal Large Language Models on Mobile Devicescited by 25
  29. 2025To Code or not to Code? Adaptive Tool Integration for Math Language Models via Expectation-Maximizationcited by 25
  30. 2024Skywork-Math: Data Scaling Laws for Mathematical Reasoning in Large Language Models -- The Story Goes Oncited by 24
  31. 2024Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase Pretrainingcited by 24
  32. 2025Understanding the Uncertainty of LLM Explanations: A Perspective Based on Reasoning Topologycited by 24
  33. 2025Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoningcited by 24
  34. 2025Nemotron-Math: Efficient Long-Context Distillation of Mathematical Reasoning from Multi-Mode Supervisioncited by 22
  35. 2024Evaluating Robustness of Reward Models for Mathematical Reasoningcited by 21
  36. 2024Aloe: A Family of Fine-tuned Open Healthcare LLMscited by 20
  37. 2024Mixture of Parrots: Experts improve memorization more than reasoningcited by 20
  38. 2025FastMCTS: A Simple Sampling Strategy for Data Synthesiscited by 16

50 most cited of 143 All 143 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025MegaMath: Pushing the Limits of Open Math Corpora
  2. 2025Evaluation of LLMs for mathematical problem solving
  3. 2024MathScale: Scaling Instruction Tuning for Mathematical Reasoning
  4. 2024ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipeline
  5. 2024PARAMANU-GANITA: Can Small Math Language Models Rival with Large Language Models on Mathematical Reasoning?
  6. 2025Mathematical Computation and Reasoning Errors by Large Language Models
  7. 2025Do LLMs Overthink Basic Math Reasoning? Benchmarking the Accuracy-Efficiency Tradeoff in Language Models
  8. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermism