Optimizing the Cost-Quality Tradeoff of Agentic Theorem Provers in Lean
On the map: LLM agents and tool use → Educational agents and math problem solving
Abstract (arXiv)
Large language models (LLMs) are increasingly used in workflows for generating formal proofs in Lean. These workflows often decompose problems into smaller lemmas, sample many proof attempts, and use compiler feedback to guide search. However, they can be prohibitively expensive, often spending substantial compute on attempts that ultimately fail. In this work, we address this problem with an action routing agent that consists of a data plane and a control plane. The data plane generates natural-language lemma decompositions, formalizes them in Lean, and samples proof attempts for the resulting theorem and lemma targets. The control plane observes previous failed Lean attempts, estimates both the likelihood of success and the cost of another attempt, and decides whether to continue proving the current target or restart from a new breakdown. On a subset of PutnamBench, our agent decreases the cost by 28.9% over a fixed-step baseline on average, preserving performance while using substantially less compute. These results suggest that failed Lean trajectories provide actionable signals for cost-aware resource allocation in agentic theorem proving.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Educational agents and math problem solving, one of 16 directions in LLM agents and tool use. Builds on 24 of its 31 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
24 of 31 references.
Closest ancestors · 2
Same direction, newest first
- 2026A Minimal Agent for Automated Theorem Proving27 Feb
- 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematics20 Jan
Other references · 22
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
- 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 354
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decompositioncited by 270
- 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
- 2022Formal Mathematics Statement Curriculum Learningcited by 141
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 126
- 2023AutoMix: Automatically Mixing Language Modelscited by 116
- 2026Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMscited by 115
- 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Provingcited by 96
10 more
- 2025MasRouter: Learning to Route LLMs for Multi-Agent Systemscited by 80
- 2024A Unified Approach to Routing and Cascading for LLMscited by 71
- 2024Learning to Route LLMs with Confidence Tokenscited by 66
- 2023When Does Confidence-Based Cascade Deferral Suffice?cited by 58
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2025Optimizing Model Selection for Compound AI Systemscited by 34
- 2024Optimising Calls to Large Language Models with Uncertainty-Based Two-Tier Selectioncited by 32
- 2023Tryage: Real-time, intelligent Routing of User Prompts to Large Language Modelscited by 28
- 2025FATE: A Formal Benchmark Series for Frontier Algebra of Multiple Difficulty Levelscited by 23
- 2026ACAR: Adaptive Complexity Routing for Multi-Model Ensembles with Auditable Decision Tracescited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026OProver: A Unified Framework for Agentic Formal Theorem Proving
- 2026Discover and Prove: An Open-source Agentic Framework for Hard Mode Automated Theorem Proving in Lean 4
- 2026Self-Modifying Lean Proof Agents with Verifier-Grounded Benchmark Coevolution
- 2026Lean Refactor: Multi-Objective Controllable Proof Optimization via Agentic Strategy Search
- 2026SorryDB: Can AI Provers Complete Real-World Lean Theorems?
- 2026LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
- 2026FORALL-LEAN-AGENT for Auditable Reasoning in Formal Mathematics and Software Verification
- 2024ImProver: Agent-Based Automated Proof Optimization