mlsanityData to 14 Oct 2026

Reasoning Core: Designing Broad Procedural Data for Completion-Supervised Reasoning Training

arXiv 2608.05148 ↗First posted 5 Aug 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Procedural generators produce useful verifiable reasoning problems at scale, but have received less attention as data for completion-supervised fine-tuning. We introduce Reasoning Core, a collection of 50 generators spanning mathematics, logic, planning, state tracking, formal languages, structured data, games, causality, and code, with semantic scorers, difficulty controls, and task evaluators. Under a matched completion-supervised protocol, we compare Reasoning Core with Procedural Warmup, Reasoning Gym, and SynLogic across four base-model settings and multiple training durations. In the primary 3B comparison, Reasoning Core achieves the highest mean scores on DROP, LogiQA, and ARC-Challenge, exceeding both the baseline without procedural data and all three alternative procedural collections. Task-level analyses show that semantic validity alone does not ensure training utility, highlighting compact targets and calibrated difficulty as important design factors. We ran audits combining model-assisted review, human adjudication, and regression testing. Applied throughout Reasoning Core development and to the other collections, they reveal subtle mismatches among generation, rendering, targets, and scoring, a reminder that procedural generation alone does not guarantee correctness. The library, generated datasets, and audit material are publicly available.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 23 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

19 of 23 references.

References · 19

  1. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  2. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
  3. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
  4. 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
  5. 2019Leveraging Procedural Generation to Benchmark Reinforcement Learningcited by 483
  6. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 234
  7. 2025ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoningcited by 201
  8. 2024BALROG: Benchmarking Agentic LLM and VLM Reasoning On Gamescited by 146
  9. 2025REASONING GYM: Reasoning Environments for Reinforcement Learning with Verifiable Rewardscited by 130
  10. 2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Codingcited by 119
  11. 2023Physics of Language Models: Part 1, Learning Hierarchical Language Structurescited by 83
  12. 2019Increasing Generality in Machine Learning through Procedural Content Generationcited by 59
7 more
  1. 2025SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyondcited by 50
  2. 2025From f(x) and g(x) to f(g(x)): LLMs Learn New Skills in RL by Composing Old Onescited by 42
  3. 2025Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biasescited by 37
  4. 2025RL Squeezes, SFT Expands: A Comparative Study of Reasoning LLMscited by 34
  5. 2025Front-Loading Reasoning: The Synergy between Pretraining and Post-Training Datacited by 27
  6. 2022Insights into Pre-training via Simpler Synthetic Taskscited by 26
  7. 2026Procedural Pretraining: Warming Up Language Models with Abstract Datacited by 10

Built on by

Not cited yet.