A Primer in Post-Training Reasoning Data: What We Know About How It Works
On the map: LLM reasoning → Reinforcement learning for reasoning
Abstract (arXiv)
Post-training has become a primary driver of recent progress in large reasoning models, and reasoning data are often the key variable determining whether this stage succeeds. Work on post-training reasoning data has grown rapidly, yet this literature remains scattered across dataset papers, reinforcement-learning recipes, reward-model studies, benchmarks, and frontier system reports. This paper is the first primer to synthesize over 150 key public studies and system reports on post-training reasoning data. We organize the field around four questions: what data objects exist, what makes them useful, how they are constructed, and how they scale. Together, this organization provides an attribution framework for future reasoning-data releases and post-training recipes.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 109 of its 134 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
109 of 134 references.
Closest ancestors · 23
Same direction, newest first
- 2026LLMs Gaming Verifiers: RLVR can Lead to Reward Hacking16 Apr
- 2026CoVerRL: Breaking the Consensus Trap in Label-Free Reasoning via Generator-Verifier Co-Evolution18 Mar
- 2025Scaling Behaviors of LLM Reinforcement Learning Post-Training: An Empirical Study in Mathematical Reasoning29 Sep
- 2025GRPO is Secretly a Process Reward Model25 Sep
- 2025MiGrATe: Mixed-Policy GRPO for Adaptation at Test-Time12 Aug
- 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMs17 Jun
- 2025Spurious Rewards: Rethinking Training Signals in RLVR12 Jun
- 2025From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning28 May
- 2025TinyV: Reducing False Negatives in Verification Improves RL for LLM Reasoning20 May
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Data6 May
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?18 Apr
- 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning15 Apr
11 more
- 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Model31 Mar
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scale18 Mar
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRs3 Mar
- 2025Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models24 Feb
- 2025The Lessons of Developing Process Reward Models in Mathematical Reasoning13 Jan
- 2025PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models6 Jan
- 2024ProcessBench: Identifying Process Errors in Mathematical Reasoning9 Dec
- 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervision5 Jun
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations14 Dec
- 2023Let's Verify Step by Step31 May
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Model29 May
Other references · 86
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
38 more
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2025s1: Simple test-time scalingcited by 1,311
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,056
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
- 2020Fact or Fiction: Verifying Scientific Claimscited by 546
- 2025LIMO: Less is More for Reasoningcited by 488
- 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 475
- 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 460
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
- 2024Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Modelscited by 431
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
- 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 394
- 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 385
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
- 2023JudgeLM: Fine-tuned Large Language Models are Scalable Judgescited by 351
- 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 348
- 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
- 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
- 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 272
- 2025MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attentioncited by 248
- 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 242
- 2021CUAD: An Expert-Annotated NLP Dataset for Legal Contract Reviewcited by 232
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
- 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 199
- 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 188
50 most cited of 86 All 86 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Select and Improve: Understanding the Mechanics of Post-Training for Reasoning
- 2026Towards a Mechanistic Understanding of Large Reasoning Models: A Survey of Training, Inference, and Failures
- 2025On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models
- 2025Front-Loading Reasoning: The Synergy between Pretraining and Post-Training Data
- 2025Distributional Biases in Post-Training: A Markovian Analysis of Reasoning Trajectories
- 2026Understanding Reasoning from Pretraining to Post-Training
- 2026How Reasoning Evolves from Post-Training Data: An Empirical Study Using Chess
- 2026Beyond Reward Engineering: A Data Recipe for Long-Context Reinforcement Learning