DreamProver: Evolving Transferable Lemma Libraries via a Wake-Sleep Theorem-Proving Agent
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
We introduce DreamProver, an agentic framework that leverages a "wake-sleep" program induction paradigm to discover reusable lemmas for formal theorem proving. Existing approaches either rely on fixed lemma libraries, which limit adaptability, or synthesize highly specific intermediate lemmas tailored to individual theorems, thereby lacking generality. DreamProver addresses this gap through an iterative two-stage process. In the wake stage, DreamProver attempts to prove theorems from a training set using the current lemma library while proposing new candidate lemmas. In the "sleep" stage, it abstracts, refines, and consolidates these candidates to compress and optimize the library. Through this alternating cycle, DreamProver progressively evolves a compact set of high-level, transferable lemmas that can be effectively used to prove unseen theorems in related domains. Experimental results demonstrate that DreamProver substantially improves proof success rates across a diverse set of mathematical benchmarks, while also producing more concise proofs and reducing computational cost.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 39 of its 75 references that are in the map. First posted on arXiv 29 Apr 2026.
Builds on
39 of 75 references.
References · 39
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 287
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 234
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 197
- 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 180
- 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 165
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 154
- 2022UniGeo: Unifying Geometry Logical Reasoning via Reformulating Mathematical Expressioncited by 137
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 133
- 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 109
- 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Provingcited by 101
27 more
- 2025BFS-Prover: Scalable Best-First Tree Search for LLM-based Automatic Theorem Provingcited by 84
- 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 81
- 2025STP: Self-play LLM Theorem Provers with Iterative Conjecturing and Provingcited by 79
- 2023LOTUS: Continual Imitation Learning for Robot Manipulation Through Unsupervised Skill Discoverycited by 67
- 2025Hilbert: Recursively Building Formal Proofs with Informal Reasoningcited by 60
- 2022Top-Down Synthesis for Library Learningcited by 58
- 2025Aristotle: IMO-level Automated Theorem Provingcited by 58
- 2024A Survey on Deep Learning for Theorem Provingcited by 57
- 2024QueST: Self-Supervised Skill Abstractions for Learning Continuous Controlcited by 53
- 2023LILO: Learning Interpretable Libraries by Compressing and Documenting Codecited by 49
- 2025FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Modelscited by 48
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2024InternLM2.5-StepProver: Advancing Automated Theorem Proving via Critic-Guided Searchcited by 34
- 2024A Semantic Search Engine for Mathlib4cited by 31
- 2025Scaling up Multi-Turn Off-Policy RL and Multi-Agent Tree Search for LLM Step-Proverscited by 28
- 2024Proving Theorems Recursivelycited by 26
- 2024Formal Theorem Proving by Rewarding LLMs to Decompose Proofs Hierarchicallycited by 22
- 2025Autoformalization in the Era of Large Language Models: A Surveycited by 21
- 2024Proving Olympiad Algebraic Inequalities without Human Demonstrationscited by 20
- 2024Incremental Learning of Retrievable Skills For Efficient Continual Task Adaptationcited by 19
- 2025Proving Olympiad Inequalities by Synergizing LLMs and Symbolic Reasoningcited by 17
- 2025Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Modelscited by 17
- 2025Lean Finder: Semantic Search for Mathlib That Understands User Intentscited by 8
- 2025LeanGeo: Formalizing Competitional Geometry problems in Leancited by 7
- 2025FormalML: A Benchmark for Evaluating Formal Subgoal Completion in Machine Learning Theorycited by 5
- 2024Learning Planning Abstractions from Languagecited by 3
- 2025LLM Library Learning Fails: A LEGO-Prover Case Studycited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026VALG: An Agentic System for ML Theory Researchcited by 2
- 2026Continual Learning in Transitioncited by 0
- 2026ProofEvolve: Neuro-Symbolic Evolution for Formal Automated Theorem Provingcited by 0
- 2026Cost-Efficient Theorem Proving via Agent Orchestration in Program Verificationcited by 0
- 2026Humanize Olympiad Agents: A Multi-Session Workflow for Olympiad Problem Solving with Solve, Review, Wiki, Verifycited by 0
- 2026Humanize Olympiad Agents: A Multi-Session Workflow for Olympiad Problem Solving with Solve, Review, Wiki, Verify9 Oct 2026
- 2026Cost-Efficient Theorem Proving via Agent Orchestration in Program Verification7 Oct 2026
- 2026ProofEvolve: Neuro-Symbolic Evolution for Formal Automated Theorem Proving26 Aug 2026
- 2026VALG: An Agentic System for ML Theory Research13 Aug 2026
- 2026Continual Learning in Transition6 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinement
- 2026OProver: A Unified Framework for Agentic Formal Theorem Proving
- 2026Automated Lemma Discovery in Agentic Program Verification
- 2026Optimizing the Cost-Quality Tradeoff of Agentic Theorem Provers in Lean
- 2026LAMP: Lean-based Agentic framework with MCP and Proof Repair
- 2025Safe: Enhancing Mathematical Reasoning in Large Language Models via Retrospective Step-aware Formal Verification
- 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofs
- 2026Agentic Proving for Program Verification