Rethinking Supervision Granularity: Segment-Level Learning for LLM-Based Theorem Proving
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Automated theorem proving with large language models in Lean 4 is commonly approached through either step-level tactic prediction with tree search or whole-proof generation. These two paradigms represent opposite granularities for constructing supervised training data: the former provides dense local signals but may fragment coherent proof processes, while the latter preserves global structure but requires complex end-to-end generation. In this paper, we revisit supervision granularity as a training set construction problem over proof trajectories and propose segment-level supervision, a training data construction strategy that extracts locally coherent proof segments for training policy models. We further reuse the same strategy at inference time to trigger short rollouts for existing step-level models. When trained with segment-level supervision on STP, LeanWorkbook, and NuminaMath-LEAN, the resulting policy models achieve proof success rates of 64.84%, 60.90%, and 66.31% on miniF2F, respectively, consistently outperforming both step-level and whole-proof baselines. Goal-aware rollout further improves existing step-level provers while reducing inference costs. It increases the proof success rate of BFS-Prover-V2-7B from 68.77% to 70.74% and that of InternLM2.5-StepProver from 59.59% to 60.33%, showing that appropriate supervision granularity better aligns model learning with proof structure and search. Code and models are available at https://github.com/NJUDeepEngine/SEG-ATP.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 27 of its 33 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
27 of 33 references.
Closest ancestors · 12
Same direction, newest first
- 2025Towards Robust Mathematical Reasoning3 Nov
- 2025ReForm: Reflective Autoformalization with Prospective Bounded Sequence Optimization28 Oct
- 2025Hilbert: Recursively Building Formal Proofs with Informal Reasoning26 Sep
- 2025Scaling up Multi-Turn Off-Policy RL and Multi-Agent Tree Search for LLM Step-Provers8 Sep
- 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Proving31 Jul
- 2025Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Models13 Jun
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition30 Apr
- 2025STP: Self-play LLM Theorem Provers with Iterative Conjecturing and Proving31 Jan
- 2024HunyuanProver: A Scalable Data Synthesis Framework and Guided Tree Search for Automated Theorem Proving30 Dec
- 2024Lean-STaR: Learning to Interleave Thinking and Proving14 Jul
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models5 Feb
- 2020Generative Language Modeling for Automated Theorem Proving7 Sep
Other references · 15
- 2025Qwen3 Technical Reportcited by 8,820
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
- 2025OpenAI GPT-5 System Cardcited by 989
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 234
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 197
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 154
- 2022Formal Mathematics Statement Curriculum Learningcited by 142
- 2026Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMscited by 137
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 133
- 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 132
3 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Spark-Prover-X1: Formal Theorem Proving Through Diverse Data Training
- 2025DeepTheorem: Advancing LLM Reasoning for Theorem Proving Through Natural Language and Reinforcement Learning
- 2025LeanProgress: Guiding Search for Neural Theorem Proving via Proof Progress Prediction
- 2025LeanConjecturer: Automatic Generation of Mathematical Conjectures for Theorem Proving
- 2024Formal Theorem Proving by Rewarding LLMs to Decompose Proofs Hierarchically
- 2025ProofOptimizer: Training Language Models to Simplify Proofs without Human Demonstrations
- 2025Seed-Prover 1.5: Mastering Undergraduate-Level Theorem Proving via Learning from Experience
- 2025LLM-based Automated Theorem Proving Hinges on Scalable Synthetic Data Generation