Saturation-Driven Dataset Generation for LLM Mathematical Reasoning in the TPTP Ecosystem
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
The scarcity of high-quality, logically sound data is a critical bottleneck for advancing the mathematical reasoning of Large Language Models (LLMs). Our work confronts this challenge by turning decades of automated theorem proving research into a scalable data engine. Rather than relying on error-prone LLMs or complex proof-assistant syntax like Lean and Isabelle, our framework leverages E-prover's saturation capabilities on the vast TPTP axiom library to derive a massive, guaranteed-valid corpus of theorems. Our pipeline is principled and simple: saturate axioms, filter for "interesting" theorems, and generate tasks. With no LLMs in the loop, we eliminate factual errors by construction. This purely symbolic data is then transformed into three difficulty-controlled challenges: entailment verification, premise selection, and proof reconstruction. Our zero-shot experiments on frontier models reveal a clear weakness: performance collapses on tasks requiring deep, structural reasoning. Our framework provides both the diagnostic tool to measure this gap and a scalable source of symbolic training data to address it. We make the code and data publicly available. https://github.com/sileod/reasoning_core https://hf.co/datasets/reasoning-core/rc1
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 21 references that are in the map. First posted on arXiv 8 Sep 2025.
Builds on
9 of 21 references.
Closest ancestors · 2
Same direction, newest first
- 2024Neuro-Symbolic Data Generation for Math Reasoning6 Dec
- 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Experts3 Jul
Other references · 7
- 2022Autoformalization with Large Language Modelscited by 263
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 234
- 2022HyperTree Proof Search for Neural Theorem Provingcited by 197
- 2016DeepMath - Deep Sequence Models for Premise Selectioncited by 81
- 2020Learning to Prove Theorems by Learning to Generate Theoremscited by 43
- 2020Learning to Prove from Synthetic Theoremscited by 13
- 2025Generating Millions Of Lean Theorems With Proofs By Exploring State Transition Graphscited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Spark-Prover-X1: Formal Theorem Proving Through Diverse Data Training
- 2025Towards Advanced Mathematical Reasoning for LLMs via First-Order Logic Theorem Proving
- 2025DeepTheorem: Advancing LLM Reasoning for Theorem Proving Through Natural Language and Reinforcement Learning
- 2025LLM-based Automated Theorem Proving Hinges on Scalable Synthetic Data Generation
- 2025Beyond Correctness: Exposing LLM-generated Logical Flaws in Reasoning via Multi-step Automated Theorem Proving
- 2025ProofCompass: Enhancing Specialized Provers with LLM Guidance
- 2025SATBench: Benchmarking LLMs' Logical Reasoning via Automated Puzzle Generation from SAT Formulas
- 2025Putnam-AXIOM: A Functional and Static Benchmark for Measuring Higher Level Mathematical Reasoning in LLMs