SkillEvoLean: Mutation-enhanced skill evolution for Lean provers
On the map: LLM agents and tool use → Agent skill learning and evolution
Abstract (arXiv)
Skill evolution offers a promising way to improve large language model agents without updating their parameters, but its use in formal theorem proving remains underexplored. Existing methods mainly target natural-language reasoning, improving skills by analyzing successful and failed trajectories and incrementally revising solving strategies. Although the Lean verifier provides reliable execution feedback, when all sampled trajectories fail, existing skill evolution methods lack successful trajectories from which to infer effective update directions. Furthermore, these methods also focus mainly on the root instruction file, thus underexploring the evolution of reference knowledge including mathematical concepts and proving techniques. To address these limitations, we propose a mutation-enhanced skill self-evolution framework for building skill-augmented Lean provers. The framework jointly evolves a high-level solving policy and its reference knowledge through progressive and mutation-based updates. Progressive evolution derives local improvements from successful and failed trajectories, while mutation is triggered when no complete proof can be generated, sampling mathematical concepts to produce and select new skill candidates under verifier feedback. We evaluate our method on MiniF2F, PutnamBench, the 2025 International Mathematical Olympiad (IMO 2025), and the 2026 USA Mathematical Olympiad (USAMO 2026). Under the same backbone model, trajectorysampling budget, and test-time compute, our method achieves proof success rates of 100.0%, 90.6%, 4/6, and 4/6, respectively, with GPT-5.5, outperforming the baseline methods. Further analysis shows that concept-guided mutation outperforms random-text-guided mutation by 6.9 and 8.2 percentage points on MiniF2F and PutnamBench, respectively, while solving one additional problem on both IMO 2025 and USAMO 2026.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 15 of its 21 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
15 of 21 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2020Generative Language Modeling for Automated Theorem Provingcited by 379
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
- 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 189
- 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learningcited by 173
- 2022Formal Mathematics Statement Curriculum Learningcited by 141
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
- 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 130
- 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 108
- 2022Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Proverscited by 97
- 2023An In-Context Learning Agent for Formal Theorem-Provingcited by 78
2 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Self-Modifying Lean Proof Agents with Verifier-Grounded Benchmark Coevolution
- 2026Growing an Agent/Prover Interface: Evolutionary Tool Design for Cost-Efficient Theorem Proving in Rocq and Lean
- 2025Seed-Prover 1.5: Mastering Undergraduate-Level Theorem Proving via Learning from Experience
- 2026AIProver: Agentic Auto-Formalization of Mathematical Research via Certificate-Driven Evolving Harness
- 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
- 2026A Wrong Turn Does Not Ruin the Journey: Deviation-Guided Skill Self-Evolution for LLM Agents
- 2024Lean-STaR: Learning to Interleave Thinking and Proving
- 2026Optimizing the Cost-Quality Tradeoff of Agentic Theorem Provers in Lean