Reasoning Core: A Scalable Procedural Data Generation Suite for Symbolic Pre-training and Post-Training
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Training on verifiable symbolic data is a promising way to expand the reasoning frontier of language models beyond what standard pre-training corpora provide. Yet existing procedural generators often rely on fixed puzzles or templates and do not deliver the distributional breadth needed at scale. We introduce Reasoning Core, a scalable suite that procedurally generates verifiable symbolic reasoning data across core formal domains: PDDL planning over randomized domains, first-order logic with equality, context-free grammar parsing and generation, causal reasoning over random Bayesian networks, and systems of equations. Each task is paired with an external solver for rigorous verification and admits continuous difficulty control for curriculum design. Examples can optionally include solver-derived reasoning traces, enabling supervised training from the earliest pre-training stages, and the same interface provides verifiable reward functions for reinforcement learning. Our experiments show that mixing Reasoning Core data into pre-training improves downstream reasoning while preserving, or slightly improving, language modeling quality. Zero-shot evaluations confirm these tasks challenge frontier models such as GPT-5. The code and data are publicly available under the MIT license.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 29 of its 49 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
29 of 49 references.
Closest ancestors · 5
Same direction, newest first
- 2025Front-Loading Reasoning: The Synergy between Pretraining and Post-Training Data26 Sep
- 2025Sudoku-Bench: Evaluating creative reasoning with Sudoku variants22 May
- 2025FOL-Traces: Verified First-Order Logic Reasoning Traces at Scale20 May
- 2025Logic Haystacks: Probing LLMs Long-Context Logical Reasoning (Without Easily Identifiable Unrelated Padding)24 Feb
- 2025ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoning3 Feb
Other references · 24
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2024OpenAI o1 System Cardcited by 1,220
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
- 2025ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Modelscited by 187
- 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 171
- 2025REASONING GYM: Reasoning Environments for Reinforcement Learning with Verifiable Rewardscited by 121
- 2025Olmo 3cited by 95
- 2023Physics of Language Models: Part 1, Learning Hierarchical Language Structurescited by 83
- 2025On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Modelscited by 64
12 more
- 2025Do Large Language Model Benchmarks Test Reliability?cited by 50
- 2025SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyondcited by 47
- 2025From f(x) and g(x) to f(g(x)): LLMs Learn New Skills in RL by Composing Old Onescited by 40
- 2025Seq vs Seq: An Open Suite of Paired Encoders and Decoderscited by 34
- 2025RL Squeezes, SFT Expands: A Comparative Study of Reasoning LLMscited by 32
- 2024Instruct-SkillMix: A Powerful Pipeline for LLM Instruction Tuningcited by 27
- 2025NeSyGeo: A Neuro-Symbolic Framework for Multimodal Geometric Reasoning Data Generationcited by 10
- 2026Procedural Pretraining: Warming Up Language Models with Abstract Datacited by 10
- 2024PDDLFuse: A Tool for Generating Diverse Planning Domainscited by 3
- 2025Saturation-Driven Dataset Generation for LLM Mathematical Reasoning in the TPTP Ecosystemcited by 2
- 2024Automatic Generation of Python Programs Using Context-Free Grammarscited by 1
- 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoningcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Reasoning Core: A Scalable RL Environment for LLM Symbolic Reasoning
- 2026ORACLE: Optimizing Reasoning Abilities of Large Language Models via Constraint-Led Synthetic Data Elicitation
- 2025CoreThink: A Symbolic Reasoning Layer to reason over Long Horizon Tasks with LLMs
- 2026ArgGYM: A Procedural, Engine-Verified Benchmark for Structured Defeasible Reasoning
- 2025Motif-2-12.7B-Reasoning: A Practitioner's Guide to RL Training Recipes
- 2025SLR: Automated Synthesis for Scalable Logical Reasoning
- 2026ReSyn: Autonomously Scaling Synthetic Environments for Reasoning Models
- 2026Procedural Knowledge at Scale Improves Reasoning