mlsanityData to 7 Oct 2026

Self-Modifying Lean Proof Agents with Verifier-Grounded Benchmark Coevolution

arXiv 2607.17352 ↗First posted 19 Jul 2026cs.AI cs.LG quant-phcited by 1

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Designing effective Lean proof agents is a central challenge in formal mathematical reasoning. Beyond building stronger provers, recent work emphasizes the workflow around Lean: how an agent decomposes proof obligations, uses tools and compiler feedback, diagnoses failures, repairs proofs, and maintains structured proof context. Motivated by code-level self-evolving agents, we study whether such workflows can be evolved rather than hand-designed. We present a self-evolving Lean proof agent in which a small fixed, trusted runtime wraps a fully mutable workspace: the proof workflow, prompts, and tools. Unlike most self-evolving systems, which optimize against a fixed external benchmark, our system coevolves the agent and its benchmark. Between generations, the highest-scoring agent (the champion) revises the active task distribution through a mastery-throttled curriculum update that introduces harder proof obligations only after the current level is mastered, and a single-anchor recalibration re-runs the champion on the updated benchmark to keep scores comparable as difficulty rises. All evolution stays inside a Lean-grounded verification loop: however the agent rewrites itself, a success counts only when its behavior yields Lean-verified proofs under a trusted snapshot, and each attempt must emit a machine-readable, Lean-grounded proof context whose representation may evolve but whose groundedness is enforced. We run the coevolving trajectory and a fixed-benchmark baseline for 15 active generations and compare them on a held-out miniF2F test split. The best coevolving agent reaches a 45.1% held-out solve rate, versus 12.7% for the seed and 32.0% for the best fixed-benchmark agent, showing that verifier-grounded self-evolution can improve Lean proof workflows under a coevolving benchmark.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 31 of its 38 references that are in the map. First posted on arXiv 19 Jul 2026.

Builds on

31 of 38 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks2 Jun
  2. 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition30 Apr
  3. 2020Generative Language Modeling for Automated Theorem Proving7 Sep

Other references · 28

  1. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  2. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
  3. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
  4. 2024AFlow: Automating Agentic Workflow Generationcited by 395
  5. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
  6. 2024Automated Design of Agentic Systemscited by 360
  7. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
  8. 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
  9. 2020Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Designcited by 260
  10. 2023AutoAgents: A Framework for Automatic Agent Generationcited by 211
  11. 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 182
  12. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
16 more
  1. 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
  2. 2020Automatic Curriculum Learning For Deep RL: A Short Surveycited by 141
  3. 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 141
  4. 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
  5. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 128
  6. 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
  7. 2024A Survey on Self-Evolution of Large Language Modelscited by 86
  8. 2025A Self-Improving Coding Agentcited by 58
  9. 2025Multi-Agent Evolve: LLM Self-Improve through Co-evolutioncited by 58
  10. 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 52
  11. 2026Hyperagentscited by 40
  12. 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulatorscited by 34
  13. 2026The Red Queen G"odel Machine: Co-Evolving Agents and Their Evaluatorscited by 16
  14. 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factualitycited by 10
  15. 2026Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinementcited by 7
  16. 2026MAGE: Multi-Agent Self-Evolution with Co-Evolutionary Knowledge Graphscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Optimizing the Cost-Quality Tradeoff of Agentic Theorem Provers in Lean
  2. 2026SkillEvoLean: Mutation-enhanced skill evolution for Lean provers
  3. 2026FORALL-LEAN-AGENT for Auditable Reasoning in Formal Mathematics and Software Verification
  4. 2026OProver: A Unified Framework for Agentic Formal Theorem Proving
  5. 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalization
  6. 2026AIProver: Agentic Auto-Formalization of Mathematical Research via Certificate-Driven Evolving Harness
  7. 2026Lean Refactor: Multi-Objective Controllable Proof Optimization via Agentic Strategy Search
  8. 2026SorryDB: Can AI Provers Complete Real-World Lean Theorems?