LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
On the map: LLM reasoning → Mathematical reasoning
also in 1 more
Abstract (arXiv)
Large Language Models (LLMs) exhibit strong informal mathematical reasoning but struggle to generate mechanically verifiable proofs in formal languages like Lean. We present LEAP, an agentic framework that enables general-purpose foundation models to achieve state-of-the-art performance on automated formal theorem proving. LEAP leverages foundation model capabilities, such as informal reasoning, instruction following, and iterative self-refinement. By decomposing complex problems into smaller units, the system bridges formal proof construction with informal blueprints through continuous interaction with the Lean compiler. To provide a rigorous evaluation beyond increasingly saturated benchmarks, we introduce Lean-IMO-Bench, a benchmark of IMO-style problems formalized in Lean, with short statements yet highly non-routine and multi-step proofs across a wide range of difficulty levels. Empirically, on the latest 2025 Putnam Competition, an annual mathematics competition for undergraduate students in North America, LEAP solves all 12 problems, matching recent breakthroughs by frontier formal mathematical models. On Lean-IMO-Bench, LEAP boosts the one-shot formal solve rate of general-purpose LLMs from below 10% to 70%, notably surpassing the 48% benchmark set by a specialized, gold-medal-caliber IMO system. Furthermore, we demonstrate LEAP's research-level utility by autonomously formalizing complex proofs for open combinatorial challenges, including a verified proof for a key subproblem in Knuth's Hamiltonian decomposition of even-order Cayley graphs.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 38 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
26 of 38 references.
Closest ancestors · 7
Same direction, newest first
- 2026Advancing Mathematics Research with AI-Driven Formal Proof Search21 May
- 2025Towards Robust Mathematical Reasoning3 Nov
- 2025Hilbert: Recursively Building Formal Proofs with Informal Reasoning26 Sep
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition30 Apr
- 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learning15 Apr
- 2024Lean-STaR: Learning to Interleave Thinking and Proving14 Jul
- 2020Generative Language Modeling for Automated Theorem Proving7 Sep
Other references · 19
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
- 2022Autoformalization with Large Language Modelscited by 263
- 2022HyperTree Proof Search for Neural Theorem Provingcited by 197
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 197
- 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 165
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 154
- 2019The Lean mathematical librarycited by 134
- 2023Baldur: Whole-Proof Generation and Repair with Large Language Modelscited by 119
- 2025BFS-Prover: Scalable Best-First Tree Search for LLM-based Automatic Theorem Provingcited by 84
7 more
- 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 82
- 2015A formal proof of the Kepler conjecturecited by 42
- 2026Semi-Autonomous Mathematics Discovery with Gemini: A Case Study on the ErdHos Problemscited by 32
- 2024A Semantic Search Engine for Mathlib4cited by 31
- 2026TaoBench: Do Automated Theorem Prover LLMs Generalize Beyond MathLib?cited by 6
- 2026FormalProofBench: Can Models Write Graduate Level Math Proofs That Are Formally Verified?cited by 5
- 2019Metamath Zero: The Cartesian Theorem Provercited by 1
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 35
- 2026AutoCedar: An Agentic Framework for Verifier-Guided Access Control Policy Synthesiscited by 2
- 2026BlueprintRepair: Typed Local Edits for Failed Lean Proof Blueprintscited by 2
- 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Languagecited by 1
- 2026Self-Modifying Lean Proof Agents with Verifier-Grounded Benchmark Coevolutioncited by 1
- 2026MechGeo: Autoformalizing and Proving Euclidean Geometry in Lean 4cited by 0
- 2026SkillSpec: Intent-Masked Specification Reasoning for Agent Skill Correctnesscited by 0
- 2026When Does Structured Knowledge Help Neural Theorem Proving?cited by 0
- 2026TCSAlgBench: Benchmarking Automated Proving for Research-Level Theoretical Computer Sciencecited by 0
- 2026Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively?cited by 0
- 2026LEVER: Adaptive Cost-Aware Proof Search Over AND/OR Graphscited by 0
- 2026Humanize Olympiad Agents: A Multi-Session Workflow for Olympiad Problem Solving with Solve, Review, Wiki, Verifycited by 0
- 2026Humanize Olympiad Agents: A Multi-Session Workflow for Olympiad Problem Solving with Solve, Review, Wiki, Verify9 Oct 2026
- 2026LEVER: Adaptive Cost-Aware Proof Search Over AND/OR Graphs8 Oct 2026
- 2026Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively?30 Sep 2026
- 2026TCSAlgBench: Benchmarking Automated Proving for Research-Level Theoretical Computer Science28 Sep 2026
- 2026When Does Structured Knowledge Help Neural Theorem Proving?28 Sep 2026
- 2026SkillSpec: Intent-Masked Specification Reasoning for Agent Skill Correctness5 Sep 2026
- 2026MechGeo: Autoformalizing and Proving Euclidean Geometry in Lean 43 Aug 2026
- 2026BlueprintRepair: Typed Local Edits for Failed Lean Proof Blueprints30 Jul 2026
- 2026Self-Modifying Lean Proof Agents with Verifier-Grounded Benchmark Coevolution19 Jul 2026
- 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Language17 Jul 2026
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops8 Jul 2026
- 2026AutoCedar: An Agentic Framework for Verifier-Guided Access Control Policy Synthesis4 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics
- 2025APOLLO: Automated LLM and Lean Collaboration for Advanced Formal Reasoning
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflection
- 2024LeanAgent: Lifelong Learning for Formal Theorem Proving
- 2026Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification
- 2025FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models
- 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofs
- 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematics