mlsanityData to 14 Oct 2026

LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks

arXiv 2606.03303 ↗First posted 2 Jun 2026cs.AIcited by 12

On the map: LLM reasoning → Mathematical reasoning

also in 1 more
Abstract (arXiv)

Large Language Models (LLMs) exhibit strong informal mathematical reasoning but struggle to generate mechanically verifiable proofs in formal languages like Lean. We present LEAP, an agentic framework that enables general-purpose foundation models to achieve state-of-the-art performance on automated formal theorem proving. LEAP leverages foundation model capabilities, such as informal reasoning, instruction following, and iterative self-refinement. By decomposing complex problems into smaller units, the system bridges formal proof construction with informal blueprints through continuous interaction with the Lean compiler. To provide a rigorous evaluation beyond increasingly saturated benchmarks, we introduce Lean-IMO-Bench, a benchmark of IMO-style problems formalized in Lean, with short statements yet highly non-routine and multi-step proofs across a wide range of difficulty levels. Empirically, on the latest 2025 Putnam Competition, an annual mathematics competition for undergraduate students in North America, LEAP solves all 12 problems, matching recent breakthroughs by frontier formal mathematical models. On Lean-IMO-Bench, LEAP boosts the one-shot formal solve rate of general-purpose LLMs from below 10% to 70%, notably surpassing the 48% benchmark set by a specialized, gold-medal-caliber IMO system. Furthermore, we demonstrate LEAP's research-level utility by autonomously formalizing complex proofs for open combinatorial challenges, including a verified proof for a key subproblem in Knuth's Hamiltonian decomposition of even-order Cayley graphs.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 38 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

26 of 38 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026Advancing Mathematics Research with AI-Driven Formal Proof Search21 May
  2. 2025Towards Robust Mathematical Reasoning3 Nov
  3. 2025Hilbert: Recursively Building Formal Proofs with Informal Reasoning26 Sep
  4. 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition30 Apr
  5. 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learning15 Apr
  6. 2024Lean-STaR: Learning to Interleave Thinking and Proving14 Jul
  7. 2020Generative Language Modeling for Automated Theorem Proving7 Sep

Other references · 19

  1. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
  2. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 391
  3. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
  4. 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
  5. 2022Autoformalization with Large Language Modelscited by 263
  6. 2022HyperTree Proof Search for Neural Theorem Provingcited by 197
  7. 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 197
  8. 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 165
  9. 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 154
  10. 2019The Lean mathematical librarycited by 134
  11. 2023Baldur: Whole-Proof Generation and Repair with Large Language Modelscited by 119
  12. 2025BFS-Prover: Scalable Best-First Tree Search for LLM-based Automatic Theorem Provingcited by 84
7 more
  1. 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 82
  2. 2015A formal proof of the Kepler conjecturecited by 42
  3. 2026Semi-Autonomous Mathematics Discovery with Gemini: A Case Study on the ErdHos Problemscited by 32
  4. 2024A Semantic Search Engine for Mathlib4cited by 31
  5. 2026TaoBench: Do Automated Theorem Prover LLMs Generalize Beyond MathLib?cited by 6
  6. 2026FormalProofBench: Can Models Write Graduate Level Math Proofs That Are Formally Verified?cited by 5
  7. 2019Metamath Zero: The Cartesian Theorem Provercited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics
  2. 2025APOLLO: Automated LLM and Lean Collaboration for Advanced Formal Reasoning
  3. 2025Solving Formal Math Problems by Decomposition and Iterative Reflection
  4. 2024LeanAgent: Lifelong Learning for Formal Theorem Proving
  5. 2026Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification
  6. 2025FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models
  7. 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofs
  8. 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematics