ImProver 2: Iteratively Self-Improving LMs for Neurosymbolic Proof Optimization
Not on the map. Why?
Abstract (arXiv)
Formal mathematics libraries are rapidly expanding, creating a growing need to refactor verified proofs for maintainability and to improve training data quality for neural provers. However, scalable proof optimization is hindered by heterogeneous and heuristically specified objectives, scarce data, and high training and inference costs. To overcome these challenges, we introduce ImProver 2, a neurosymbolic framework for automated proof optimization in Lean 4. ImProver 2 combines a data-efficient expert-iteration pipeline with a scaffold that exposes formal structure alongside lightweight informal abstractions. We further introduce a suite of metrics capturing structural proof properties. Using ImProver 2, we train a 7B-parameter model that outperforms orders-of-magnitude larger models within the same model family, and is competitive with mid-tier frontier models across metrics. We additionally demonstrate that our neurosymbolic scaffold significantly improves performance across both small and frontier models. We show that with proper scaffolding and training, small models can effectively restructure research-level proofs over complex and varied metrics, matching substantially larger systems and establishing proof optimization as a scalable, learnable task.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 35 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
12 of 35 references.
References · 12
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
- 2020Generative Language Modeling for Automated Theorem Provingcited by 388
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 154
- 2019The Lean mathematical librarycited by 134
- 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
- 2024A Survey on Deep Learning for Theorem Provingcited by 57
- 2024Data for Mathematical Copilots: Better Ways of Presenting Proofs for Machine Learningcited by 11
- 2025ProofOptimizer: Training Language Models to Simplify Proofs without Human Demonstrationscited by 11
- 2024HepLean: Digitalising high energy physicscited by 10
- 2024ImProver: Agent-Based Automated Proof Optimizationcited by 10
- 2025Natural Language Translation of Formal Proofs through Informalization of Proof Steps and Recursive Summarization along Proof Structurecited by 1
Built on by
Not cited yet.