mlsanityData to 7 Oct 2026

A Primer in Post-Training Reasoning Data: What We Know About How It Works

arXiv 2606.02113 ↗First posted 1 Jun 2026cs.CL cs.AIcited by 1

On the map: LLM reasoning → Reinforcement learning for reasoning

Abstract (arXiv)

Post-training has become a primary driver of recent progress in large reasoning models, and reasoning data are often the key variable determining whether this stage succeeds. Work on post-training reasoning data has grown rapidly, yet this literature remains scattered across dataset papers, reinforcement-learning recipes, reward-model studies, benchmarks, and frontier system reports. This paper is the first primer to synthesize over 150 key public studies and system reports on post-training reasoning data. We organize the field around four questions: what data objects exist, what makes them useful, how they are constructed, and how they scale. Together, this organization provides an attribution framework for future reasoning-data releases and post-training recipes.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 109 of its 134 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

109 of 134 references.

Closest ancestors · 23

Same direction, newest first

  1. 2026LLMs Gaming Verifiers: RLVR can Lead to Reward Hacking16 Apr
  2. 2026CoVerRL: Breaking the Consensus Trap in Label-Free Reasoning via Generator-Verifier Co-Evolution18 Mar
  3. 2025Scaling Behaviors of LLM Reinforcement Learning Post-Training: An Empirical Study in Mathematical Reasoning29 Sep
  4. 2025GRPO is Secretly a Process Reward Model25 Sep
  5. 2025MiGrATe: Mixed-Policy GRPO for Adaptation at Test-Time12 Aug
  6. 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMs17 Jun
  7. 2025Spurious Rewards: Rethinking Training Signals in RLVR12 Jun
  8. 2025From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning28 May
  9. 2025TinyV: Reducing False Negatives in Verification Improves RL for LLM Reasoning20 May
  10. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Data6 May
  11. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?18 Apr
  12. 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning15 Apr
11 more
  1. 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Model31 Mar
  2. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scale18 Mar
  3. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRs3 Mar
  4. 2025Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models24 Feb
  5. 2025The Lessons of Developing Process Reward Models in Mathematical Reasoning13 Jan
  6. 2025PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models6 Jan
  7. 2024ProcessBench: Identifying Process Errors in Mathematical Reasoning9 Dec
  8. 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervision5 Jun
  9. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations14 Dec
  10. 2023Let's Verify Step by Step31 May
  11. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Model29 May

Other references · 86

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  7. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  9. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  10. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  11. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  12. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
38 more
  1. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  2. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  3. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  4. 2025s1: Simple test-time scalingcited by 1,311
  5. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  6. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  7. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  8. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  9. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  10. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  11. 2022Scaling Laws for Reward Model Overoptimizationcited by 1,056
  12. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
  13. 2021Measuring Coding Challenge Competence With APPScited by 879
  14. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  15. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
  16. 2020Fact or Fiction: Verifying Scientific Claimscited by 546
  17. 2025LIMO: Less is More for Reasoningcited by 488
  18. 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 475
  19. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 460
  20. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
  21. 2024Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Modelscited by 431
  22. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
  23. 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 394
  24. 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 385
  25. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
  26. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
  27. 2023JudgeLM: Fine-tuned Large Language Models are Scalable Judgescited by 351
  28. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 348
  29. 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
  30. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
  31. 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 272
  32. 2025MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attentioncited by 248
  33. 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 242
  34. 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 232
  35. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
  36. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
  37. 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 199
  38. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 188

50 most cited of 86 All 86 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Select and Improve: Understanding the Mechanics of Post-Training for Reasoning
  2. 2026Towards a Mechanistic Understanding of Large Reasoning Models: A Survey of Training, Inference, and Failures
  3. 2025On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models
  4. 2025Front-Loading Reasoning: The Synergy between Pretraining and Post-Training Data
  5. 2025Distributional Biases in Post-Training: A Markovian Analysis of Reasoning Trajectories
  6. 2026Understanding Reasoning from Pretraining to Post-Training
  7. 2026How Reasoning Evolves from Post-Training Data: An Empirical Study Using Chess
  8. 2026Beyond Reward Engineering: A Data Recipe for Long-Context Reinforcement Learning