mlsanityData to 7 Oct 2026

Seed-Prover 1.5: Mastering Undergraduate-Level Theorem Proving via Learning from Experience

arXiv 2512.17260 ↗First posted 19 Dec 2025cs.CLcited by 36

Not on the map. Why?

Abstract (arXiv)

Large language models have recently made significant progress to generate rigorous mathematical proofs. In contrast, utilizing LLMs for theorem proving in formal languages (such as Lean) remains challenging and computationally expensive, particularly when addressing problems at the undergraduate level and beyond. In this work, we present Seed-Prover 1.5, a formal theorem-proving model trained via large-scale agentic reinforcement learning, alongside an efficient test-time scaling (TTS) workflow. Through extensive interactions with Lean and other tools, the model continuously accumulates experience during the RL process, substantially enhancing the capability and efficiency of formal theorem proving. Furthermore, leveraging recent advancements in natural language proving, our TTS workflow efficiently bridges the gap between natural and formal languages. Compared to state-of-the-art methods, Seed-Prover 1.5 achieves superior performance with a smaller compute budget. It solves 88% of PutnamBench (undergraduate-level), 80% of Fate-H (graduate-level), and 33% of Fate-X (PhD-level) problems. Notably, using our system, we solved 11 out of 12 problems from Putnam 2025 within 9 hours. Our findings suggest that scaling learning from experience, driven by high-quality formal feedback, holds immense potential for the future of formal mathematical reasoning.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 25 of its 30 references that are in the map. First posted on arXiv 19 Dec 2025.

Builds on

25 of 30 references.

References · 25

  1. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
  2. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
  3. 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
  4. 2022Autoformalization with Large Language Modelscited by 252
  5. 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 189
  6. 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 173
  7. 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
  8. 2022Formal Mathematics Statement Curriculum Learningcited by 141
  9. 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
  10. 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 126
  11. 2024Lean Workbook: A large-scale Lean problem set formalized from natural language math problemscited by 115
  12. 2025Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Modelscited by 104
13 more
  1. 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Provingcited by 96
  2. 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoningcited by 84
  3. 2025BFS-Prover: Scalable Best-First Tree Search for LLM-based Automatic Theorem Provingcited by 82
  4. 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 79
  5. 2025Hilbert: Recursively Building Formal Proofs with Informal Reasoningcited by 55
  6. 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
  7. 2025CombiBench: Benchmarking LLM Capability for Combinatorial Mathematicscited by 28
  8. 2025Leanabell-Prover-V2: Verifier-integrated Reasoning for Formal Theorem Proving via Reinforcement Learningcited by 26
  9. 2025Scaling up Multi-Turn Off-Policy RL and Multi-Agent Tree Search for LLM Step-Proverscited by 26
  10. 2025FATE: A Formal Benchmark Series for Frontier Algebra of Multiple Difficulty Levelscited by 23
  11. 2025CriticLean: Critic-Guided Reinforcement Learning for Mathematical Formalizationcited by 15
  12. 2025StepFun-Prover Preview: Let's Think and Verify Step by Stepcited by 12
  13. 2025Intern-S1-MO: Long-horizon Reasoning Agent for Olympiad?Level Mathematical Problem Solvingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 35.

36 papers.

Sort:

By area:

  1. 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematicscited by 43
  2. 2026Automated Conjecture Resolution with Formal Verificationcited by 21
  3. 2026A Minimal Agent for Automated Theorem Provingcited by 13
  4. 2026AI co-mathematician: Accelerating mathematicians with agentic AIcited by 13
  5. 2026Goedel-Code-Prover: Hierarchical Proof Search for Open State-of-the-Art Code Verificationcited by 10
  6. 2026R-Diverse: Mitigating Diversity Illusion in Self-Play LLM Trainingcited by 9
  7. 2026Scaling Self-Play with Self-Guidancecited by 9
  8. 2026LeanSearch v2: Global Premise Retrieval for Lean 4 Theorem Provingcited by 7
  9. 2026Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinementcited by 7
  10. 2026RMA: an Agentic System for Research-Level Mathematical Problemscited by 6
  11. 2026Formal Conjectures: An Open and Evolving Benchmark for Verified Discovery in Mathematicscited by 5
  12. 2025LeanCat: A Benchmark Suite for Formal Category Theory in Lean (Part I: 1-Categories)cited by 4
24 more
  1. 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysiscited by 4
  2. 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematicscited by 4
  3. 2026NC2C: Automated Convexification of Generic Non-Convex Optimization Problemscited by 2
  4. 2026Towards Solving the Gilbert-Pollak Conjecture via Large Language Modelscited by 2
  5. 2026Agentic AI for Scalable and Robust Optical Systems Controlcited by 2
  6. 2026Let Geometry GUIDE: Layer-wise Unrolling of Geometric Priors in Multimodal LLMscited by 2
  7. 2026Breaking the Capability Ceiling of LLM Post-Training by Reintroducing Markov Statescited by 1
  8. 2026Shaping Schema via Language Representation as the Next Frontier for LLM Intelligence Expandingcited by 1
  9. 2026STAR-P'olyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervisioncited by 1
  10. 2026Lean4Agent: Formal Modeling and Verification for Agent Workflow and Trajectorycited by 1
  11. 2026MA-ProofBench: A Two-Tiered Evaluation of LLMs for Theorem Proving in Mathematical Analysiscited by 1
  12. 2026Escaping the Self-Confirmation Trap: An Execute-Distill-Verify Paradigm for Agentic Experience Learningcited by 1
  13. 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalizationcited by 1
  14. 2026ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent Systemcited by 1
  15. 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Languagecited by 1
  16. 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Provingcited by 1
  17. 2026An Information-Theoretic Criterion for Efficient Data Synthesiscited by 0
  18. 2026Entropy Is Not Enough: Unlocking Effective Reinforcement Learning for Visual Reasoning via Vision-Anchored Token Selectioncited by 0
  19. 2026ComBench: A Benchmark for Rigorous Proof Reasoning and Constructive Realization in Olympiad-Level Combinatoricscited by 0
  20. 2026FaithSieve: Fine-Grained Evaluation of Math Proofs with Faithful Formal Evidencecited by 0
  21. 2026Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verificationcited by 0
  22. 2026When Does Structured Knowledge Help Neural Theorem Proving?cited by 0
  23. 2026FORALL-LEAN-AGENT for Auditable Reasoning in Formal Mathematics and Software Verificationcited by 0
  24. 2026Cost-Efficient Theorem Proving via Agent Orchestration in Program Verificationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition
  2. 2025Spark-Prover-X1: Formal Theorem Proving Through Diverse Data Training
  3. 2026LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
  4. 2025DeepTheorem: Advancing LLM Reasoning for Theorem Proving Through Natural Language and Reinforcement Learning
  5. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data
  6. 2024LeanAgent: Lifelong Learning for Formal Theorem Proving
  7. 2025Theorem Prover as a Judge for Synthetic Data Generation
  8. 2025Leanabell-Prover: Posttraining Scaling in Formal Reasoning