Beyond the Library: An Agentic Framework for Autoformalizing Research Mathematics
On the map: LLM reasoning → Mathematical reasoning
also in 1 more
Abstract (arXiv)
While Large Language Models (LLMs) have demonstrated exceptional capabilities in mathematical reasoning, they frequently produce subtle errors that evade human detection. Formal mathematical languages like Lean 4 offer mechanical proof checking, strongly motivating the need for autoformalization: the automatic translation of natural language mathematics into verifiable code. Recent trends indicate that general-purpose LLMs, heavily optimized for standard programming, now outperform smaller models explicitly fine-tuned for Lean. Leveraging this shift, we introduce *Theo*, an agentic autoformalization framework powered by general coding LLMs. At the core of our system is an orchestrator that manages a multi-agent pipeline tailored for research-level mathematics. Because cutting-edge research frequently relies on concepts outside the scope of existing libraries like Mathlib, our system dynamically extends necessary type definitions and validates them via a novel Auxiliary Lemma technique before formalizing the primary theorems. We applied our approach to PutnamBench, producing machine-checked Lean proofs for a random sample of 32 problems. Furthermore, we evaluate our system on seven research papers---five from the ACM Symposium on Theory of Computing (STOC) and two recent OpenAI manuscripts---spanning combinatorics, communication complexity, mechanism design, learning theory, number theory, discrete geometry, and graph theory. We successfully formalize their main theorems and proofs and validate the generated formalizations with human experts; notably, two developments require no axioms beyond Lean's kernel. All of our formalizations are available at https://beyondthelibrary.github.io/formal_arxiv/.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 57 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
32 of 57 references.
Closest ancestors · 12
Same direction, newest first
- 2025IndiMathBench: Autoformalizing Mathematical Reasoning Problems with a Human Touch30 Nov
- 2025Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics14 Oct
- 2025Hilbert: Recursively Building Formal Proofs with Informal Reasoning26 Sep
- 2025Seed-Prover: Deep and Broad Reasoning for Automated Theorem Proving31 Jul
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflection21 Jul
- 2025Leanabell-Prover-V2: Verifier-integrated Reasoning for Formal Theorem Proving via Reinforcement Learning11 Jul
- 2025APOLLO: Automated LLM and Lean Collaboration for Advanced Formal Reasoning9 May
- 2025DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition30 Apr
- 2025Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learning15 Apr
- 2025Leanabell-Prover: Posttraining Scaling in Formal Reasoning8 Apr
- 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Experts3 Jul
- 2024Process-Driven Autoformalization in Lean 44 Jun
Other references · 20
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 189
- 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
- 2025Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correctioncited by 140
- 2019The Lean mathematical librarycited by 127
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 126
- 2024The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Modelscited by 87
- 2025Aristotle: IMO-level Automated Theorem Provingcited by 47
- 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematicscited by 43
- 2025Seed-Prover 1.5: Mastering Undergraduate-Level Theorem Proving via Learning from Experiencecited by 36
- 2026Accelerating Scientific Research with Gemini: Case Studies and Common Techniquescited by 24
- 2025ProofBridge: Auto-Formalization of Natural Language Proofs in Lean via Joint Embeddingscited by 16
8 more
- 2026A Minimal Agent for Automated Theorem Provingcited by 13
- 2026M2F: Automated Formalization of Mathematical Literature at Scalecited by 12
- 2022Formalizing Chemical Physics using the Lean Theorem Provercited by 9
- 2026MerLean: An Agentic Framework for Autoformalization in Quantum Computationcited by 8
- 2026Learning to Repair Lean Proofs from Compiler Feedbackcited by 6
- 2026Agentic Proof Automation: A Case Studycited by 4
- 2024A Generalized Trace Reconstruction Problem: Recovering a String of Probabilitiescited by 1
- 2025Approximation guarantees of Median Mechanism in ℝdcited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026VALG: An Agentic System for ML Theory Researchcited by 1
- 2026MechGeo: Autoformalizing and Proving Euclidean Geometry in Lean 4cited by 0
- 2026Choir: An Open Protocol for Distributed Multi-Agent Autoformalizationcited by 0
- 2026TCSAlgBench: Benchmarking Automated Proving for Research-Level Theoretical Computer Sciencecited by 0
- 2026TCSAlgBench: Benchmarking Automated Proving for Research-Level Theoretical Computer Science28 Sep 2026
- 2026Choir: An Open Protocol for Distributed Multi-Agent Autoformalization25 Sep 2026
- 2026VALG: An Agentic System for ML Theory Research13 Aug 2026
- 2026MechGeo: Autoformalizing and Proving Euclidean Geometry in Lean 43 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
- 2026Formalizing Mathematics at Scale
- 2026Advancing Mathematics Research with AI-Driven Formal Proof Search
- 2025Autoformalization in the Era of Large Language Models: A Survey
- 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofs
- 2026AIProver: Agentic Auto-Formalization of Mathematical Research via Certificate-Driven Evolving Harness
- 2026ProofCouncil: An LLM Agent for Solving Open Mathematical Problems
- 2024ImProver: Agent-Based Automated Proof Optimization