Seed-Prover 1.5: Mastering Undergraduate-Level Theorem Proving via Learning from Experience
Not on the map. Why?
Abstract (arXiv)
Large language models have recently made significant progress to generate rigorous mathematical proofs. In contrast, utilizing LLMs for theorem proving in formal languages (such as Lean) remains challenging and computationally expensive, particularly when addressing problems at the undergraduate level and beyond. In this work, we present Seed-Prover 1.5, a formal theorem-proving model trained via large-scale agentic reinforcement learning, alongside an efficient test-time scaling (TTS) workflow. Through extensive interactions with Lean and other tools, the model continuously accumulates experience during the RL process, substantially enhancing the capability and efficiency of formal theorem proving. Furthermore, leveraging recent advancements in natural language proving, our TTS workflow efficiently bridges the gap between natural and formal languages. Compared to state-of-the-art methods, Seed-Prover 1.5 achieves superior performance with a smaller compute budget. It solves 88% of PutnamBench (undergraduate-level), 80% of Fate-H (graduate-level), and 33% of Fate-X (PhD-level) problems. Notably, using our system, we solved 11 out of 12 problems from Putnam 2025 within 9 hours. Our findings suggest that scaling learning from experience, driven by high-quality formal feedback, holds immense potential for the future of formal mathematical reasoning.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 25 of its 30 references that are in the map. First posted on arXiv 19 Dec 2025.
Builds on
25 of 30 references.
References · 25
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
- 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
- 2022Autoformalization with Large Language Modelscited by 252
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 189
- 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 173
- 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
- 2022Formal Mathematics Statement Curriculum Learningcited by 141
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 126
- 2024Lean Workbook: A large-scale Lean problem set formalized from natural language math problemscited by 115
- 2025Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Modelscited by 104
13 more
- 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Provingcited by 96
- 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoningcited by 84
- 2025BFS-Prover: Scalable Best-First Tree Search for LLM-based Automatic Theorem Provingcited by 82
- 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 79
- 2025Hilbert: Recursively Building Formal Proofs with Informal Reasoningcited by 55
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2025CombiBench: Benchmarking LLM Capability for Combinatorial Mathematicscited by 28
- 2025Leanabell-Prover-V2: Verifier-integrated Reasoning for Formal Theorem Proving via Reinforcement Learningcited by 26
- 2025Scaling up Multi-Turn Off-Policy RL and Multi-Agent Tree Search for LLM Step-Proverscited by 26
- 2025FATE: A Formal Benchmark Series for Frontier Algebra of Multiple Difficulty Levelscited by 23
- 2025CriticLean: Critic-Guided Reinforcement Learning for Mathematical Formalizationcited by 15
- 2025StepFun-Prover Preview: Let's Think and Verify Step by Stepcited by 12
- 2025Intern-S1-MO: Long-horizon Reasoning Agent for Olympiad?Level Mathematical Problem Solvingcited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 35.
36 papers.
Sort:
By area:
- 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematicscited by 43
- 2026Automated Conjecture Resolution with Formal Verificationcited by 21
- 2026A Minimal Agent for Automated Theorem Provingcited by 13
- 2026AI co-mathematician: Accelerating mathematicians with agentic AIcited by 13
- 2026Goedel-Code-Prover: Hierarchical Proof Search for Open State-of-the-Art Code Verificationcited by 10
- 2026R-Diverse: Mitigating Diversity Illusion in Self-Play LLM Trainingcited by 9
- 2026Scaling Self-Play with Self-Guidancecited by 9
- 2026LeanSearch v2: Global Premise Retrieval for Lean 4 Theorem Provingcited by 7
- 2026Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinementcited by 7
- 2026RMA: an Agentic System for Research-Level Mathematical Problemscited by 6
- 2026Formal Conjectures: An Open and Evolving Benchmark for Verified Discovery in Mathematicscited by 5
- 2025LeanCat: A Benchmark Suite for Formal Category Theory in Lean (Part I: 1-Categories)cited by 4
24 more
- 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysiscited by 4
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematicscited by 4
- 2026NC2C: Automated Convexification of Generic Non-Convex Optimization Problemscited by 2
- 2026Towards Solving the Gilbert-Pollak Conjecture via Large Language Modelscited by 2
- 2026Agentic AI for Scalable and Robust Optical Systems Controlcited by 2
- 2026Let Geometry GUIDE: Layer-wise Unrolling of Geometric Priors in Multimodal LLMscited by 2
- 2026Breaking the Capability Ceiling of LLM Post-Training by Reintroducing Markov Statescited by 1
- 2026Shaping Schema via Language Representation as the Next Frontier for LLM Intelligence Expandingcited by 1
- 2026STAR-P'olyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervisioncited by 1
- 2026Lean4Agent: Formal Modeling and Verification for Agent Workflow and Trajectorycited by 1
- 2026MA-ProofBench: A Two-Tiered Evaluation of LLMs for Theorem Proving in Mathematical Analysiscited by 1
- 2026Escaping the Self-Confirmation Trap: An Execute-Distill-Verify Paradigm for Agentic Experience Learningcited by 1
- 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalizationcited by 1
- 2026ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent Systemcited by 1
- 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Languagecited by 1
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Provingcited by 1
- 2026An Information-Theoretic Criterion for Efficient Data Synthesiscited by 0
- 2026Entropy Is Not Enough: Unlocking Effective Reinforcement Learning for Visual Reasoning via Vision-Anchored Token Selectioncited by 0
- 2026ComBench: A Benchmark for Rigorous Proof Reasoning and Constructive Realization in Olympiad-Level Combinatoricscited by 0
- 2026FaithSieve: Fine-Grained Evaluation of Math Proofs with Faithful Formal Evidencecited by 0
- 2026Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verificationcited by 0
- 2026When Does Structured Knowledge Help Neural Theorem Proving?cited by 0
- 2026FORALL-LEAN-AGENT for Auditable Reasoning in Formal Mathematics and Software Verificationcited by 0
- 2026Cost-Efficient Theorem Proving via Agent Orchestration in Program Verificationcited by 0
- 2026Cost-Efficient Theorem Proving via Agent Orchestration in Program Verification7 Oct 2026
- 2026FORALL-LEAN-AGENT for Auditable Reasoning in Formal Mathematics and Software Verification1 Oct 2026
- 2026When Does Structured Knowledge Help Neural Theorem Proving?28 Sep 2026
- 2026Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification10 Sep 2026
- 2026FaithSieve: Fine-Grained Evaluation of Math Proofs with Faithful Formal Evidence26 Aug 2026
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Proving25 Aug 2026
- 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Language17 Jul 2026
- 2026ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent System15 Jul 2026
- 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalization13 Jul 2026
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics30 Jun 2026
- 2026Escaping the Self-Confirmation Trap: An Execute-Distill-Verify Paradigm for Agentic Experience Learning23 Jun 2026
- 2026MA-ProofBench: A Two-Tiered Evaluation of LLMs for Theorem Proving in Mathematical Analysis11 Jun 2026
24 more
- 2026ComBench: A Benchmark for Rigorous Proof Reasoning and Constructive Realization in Olympiad-Level Combinatorics9 Jun 2026
- 2026Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinement4 Jun 2026
- 2026Lean4Agent: Formal Modeling and Verification for Agent Workflow and Trajectory2 Jun 2026
- 2026Entropy Is Not Enough: Unlocking Effective Reinforcement Learning for Visual Reasoning via Vision-Anchored Token Selection2 Jun 2026
- 2026RMA: an Agentic System for Research-Level Mathematical Problems20 May 2026
- 2026STAR-P'olyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervision19 May 2026
- 2026Formal Conjectures: An Open and Evolving Benchmark for Verified Discovery in Mathematics13 May 2026
- 2026LeanSearch v2: Global Premise Retrieval for Lean 4 Theorem Proving13 May 2026
- 2026An Information-Theoretic Criterion for Efficient Data Synthesis11 May 2026
- 2026Shaping Schema via Language Representation as the Next Frontier for LLM Intelligence Expanding10 May 2026
- 2026AI co-mathematician: Accelerating mathematicians with agentic AI7 May 2026
- 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis27 Apr 2026
- 2026Scaling Self-Play with Self-Guidance22 Apr 2026
- 2026Let Geometry GUIDE: Layer-wise Unrolling of Geometric Priors in Multimodal LLMs7 Apr 2026
- 2026Automated Conjecture Resolution with Formal Verification4 Apr 2026
- 2026Breaking the Capability Ceiling of LLM Post-Training by Reintroducing Markov States20 Mar 2026
- 2026Goedel-Code-Prover: Hierarchical Proof Search for Open State-of-the-Art Code Verification18 Mar 2026
- 2026A Minimal Agent for Automated Theorem Proving27 Feb 2026
- 2026Agentic AI for Scalable and Robust Optical Systems Control23 Feb 2026
- 2026R-Diverse: Mitigating Diversity Illusion in Self-Play LLM Training13 Feb 2026
- 2026Towards Solving the Gilbert-Pollak Conjecture via Large Language Models29 Jan 2026
- 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematics20 Jan 2026
- 2026NC2C: Automated Convexification of Generic Non-Convex Optimization Problems8 Jan 2026
- 2025LeanCat: A Benchmark Suite for Formal Category Theory in Lean (Part I: 1-Categories)31 Dec 2025
- 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematicscited by 43
- 2026A Minimal Agent for Automated Theorem Provingcited by 13
- 2026AI co-mathematician: Accelerating mathematicians with agentic AIcited by 13
- 2026Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinementcited by 7
- 2026RMA: an Agentic System for Research-Level Mathematical Problemscited by 6
- 2026Agentic AI for Scalable and Robust Optical Systems Controlcited by 2
- 2026Lean4Agent: Formal Modeling and Verification for Agent Workflow and Trajectorycited by 1
- 2026Escaping the Self-Confirmation Trap: An Execute-Distill-Verify Paradigm for Agentic Experience Learningcited by 1
- 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Languagecited by 1
- 2026FORALL-LEAN-AGENT for Auditable Reasoning in Formal Mathematics and Software Verificationcited by 0
- 2026Cost-Efficient Theorem Proving via Agent Orchestration in Program Verificationcited by 0
- 2026Cost-Efficient Theorem Proving via Agent Orchestration in Program Verification7 Oct 2026
- 2026FORALL-LEAN-AGENT for Auditable Reasoning in Formal Mathematics and Software Verification1 Oct 2026
- 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Language17 Jul 2026
- 2026Escaping the Self-Confirmation Trap: An Execute-Distill-Verify Paradigm for Agentic Experience Learning23 Jun 2026
- 2026Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinement4 Jun 2026
- 2026Lean4Agent: Formal Modeling and Verification for Agent Workflow and Trajectory2 Jun 2026
- 2026RMA: an Agentic System for Research-Level Mathematical Problems20 May 2026
- 2026AI co-mathematician: Accelerating mathematicians with agentic AI7 May 2026
- 2026A Minimal Agent for Automated Theorem Proving27 Feb 2026
- 2026Agentic AI for Scalable and Robust Optical Systems Control23 Feb 2026
- 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematics20 Jan 2026
- 2026Automated Conjecture Resolution with Formal Verificationcited by 21
- 2026R-Diverse: Mitigating Diversity Illusion in Self-Play LLM Trainingcited by 9
- 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysiscited by 4
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematicscited by 4
- 2026STAR-P'olyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervisioncited by 1
- 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalizationcited by 1
- 2026ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent Systemcited by 1
- 2026Entropy Is Not Enough: Unlocking Effective Reinforcement Learning for Visual Reasoning via Vision-Anchored Token Selectioncited by 0
- 2026ComBench: A Benchmark for Rigorous Proof Reasoning and Constructive Realization in Olympiad-Level Combinatoricscited by 0
- 2026Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verificationcited by 0
- 2026Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification10 Sep 2026
- 2026ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent System15 Jul 2026
- 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalization13 Jul 2026
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics30 Jun 2026
- 2026ComBench: A Benchmark for Rigorous Proof Reasoning and Constructive Realization in Olympiad-Level Combinatorics9 Jun 2026
- 2026Entropy Is Not Enough: Unlocking Effective Reinforcement Learning for Visual Reasoning via Vision-Anchored Token Selection2 Jun 2026
- 2026STAR-P'olyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervision19 May 2026
- 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis27 Apr 2026
- 2026Automated Conjecture Resolution with Formal Verification4 Apr 2026
- 2026R-Diverse: Mitigating Diversity Illusion in Self-Play LLM Training13 Feb 2026
- 2026Scaling Self-Play with Self-Guidancecited by 9
- 2026An Information-Theoretic Criterion for Efficient Data Synthesiscited by 0
- 2026An Information-Theoretic Criterion for Efficient Data Synthesis11 May 2026
- 2026Scaling Self-Play with Self-Guidance22 Apr 2026
- 2026Goedel-Code-Prover: Hierarchical Proof Search for Open State-of-the-Art Code Verificationcited by 10
- 2026LeanSearch v2: Global Premise Retrieval for Lean 4 Theorem Provingcited by 7
- 2026Formal Conjectures: An Open and Evolving Benchmark for Verified Discovery in Mathematicscited by 5
- 2025LeanCat: A Benchmark Suite for Formal Category Theory in Lean (Part I: 1-Categories)cited by 4
- 2026NC2C: Automated Convexification of Generic Non-Convex Optimization Problemscited by 2
- 2026Towards Solving the Gilbert-Pollak Conjecture via Large Language Modelscited by 2
- 2026Shaping Schema via Language Representation as the Next Frontier for LLM Intelligence Expandingcited by 1
- 2026MA-ProofBench: A Two-Tiered Evaluation of LLMs for Theorem Proving in Mathematical Analysiscited by 1
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Provingcited by 1
- 2026FaithSieve: Fine-Grained Evaluation of Math Proofs with Faithful Formal Evidencecited by 0
- 2026When Does Structured Knowledge Help Neural Theorem Proving?cited by 0
- 2026When Does Structured Knowledge Help Neural Theorem Proving?28 Sep 2026
- 2026FaithSieve: Fine-Grained Evaluation of Math Proofs with Faithful Formal Evidence26 Aug 2026
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Proving25 Aug 2026
- 2026MA-ProofBench: A Two-Tiered Evaluation of LLMs for Theorem Proving in Mathematical Analysis11 Jun 2026
- 2026Formal Conjectures: An Open and Evolving Benchmark for Verified Discovery in Mathematics13 May 2026
- 2026LeanSearch v2: Global Premise Retrieval for Lean 4 Theorem Proving13 May 2026
- 2026Shaping Schema via Language Representation as the Next Frontier for LLM Intelligence Expanding10 May 2026
- 2026Goedel-Code-Prover: Hierarchical Proof Search for Open State-of-the-Art Code Verification18 Mar 2026
- 2026Towards Solving the Gilbert-Pollak Conjecture via Large Language Models29 Jan 2026
- 2026NC2C: Automated Convexification of Generic Non-Convex Optimization Problems8 Jan 2026
- 2025LeanCat: A Benchmark Suite for Formal Category Theory in Lean (Part I: 1-Categories)31 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition
- 2025Spark-Prover-X1: Formal Theorem Proving Through Diverse Data Training
- 2026LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
- 2025DeepTheorem: Advancing LLM Reasoning for Theorem Proving Through Natural Language and Reinforcement Learning
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data
- 2024LeanAgent: Lifelong Learning for Formal Theorem Proving
- 2025Theorem Prover as a Judge for Synthetic Data Generation
- 2025Leanabell-Prover: Posttraining Scaling in Formal Reasoning