Automated Conjecture Resolution with Formal Verification
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Recent advances in large language models have significantly improved their ability to perform mathematical reasoning, extending from elementary problem solving to increasingly capable performance on research-level problems. However, reliably solving and verifying such problems remains challenging due to the inherent ambiguity of natural language reasoning. In this paper, we propose an automated framework that integrates natural language reasoning with formal verification to tackle research-level mathematical problems. Our framework consists of two components: an informal reasoning agent, Rethlas, and a formal verification agent, Archon. Rethlas combines reasoning primitives with our theorem search engine, Matlas, to explore solution strategies and construct candidate proofs. Archon, equipped with LeanSearch, translates informal arguments into formalized Lean 4 projects through task decomposition, iterative refinement, and automated proof synthesis, ensuring machine-checkable correctness. Using this framework, we resolve an open problem in commutative algebra and formally verify the resulting proof in Lean 4 with essentially no human involvement. Additional case studies illustrate the capabilities of Rethlas in informal mathematical reasoning and discovery, as well as the ability of Archon to formalize research-level proofs in Lean 4. Our experiments demonstrate that strong theorem retrieval tools enable the discovery and application of cross-domain mathematical techniques, while the formal agent can autonomously fill nontrivial gaps in informal arguments. More broadly, our work illustrates a promising paradigm for mathematical research in which informal and formal reasoning systems, equipped with theorem retrieval tools, operate in tandem to produce verifiable results, reduce human effort, and support human-AI collaborative mathematical research.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 19 of its 40 references that are in the map. First posted on arXiv 4 Apr 2026.
Builds on
19 of 40 references.
Closest ancestors · 3
Same direction, newest first
- 2025Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics14 Oct
- 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI7 Nov
- 2024Herald: A Natural Language Annotated Lean 4 Dataset9 Oct
Other references · 16
- 2023GPT-4 Technical Reportcited by 18,132
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Winning Gold at IMO 2025 with a Model-Agnostic Verification-and-Refinement Pipelinecited by 79
- 2025Aristotle: IMO-level Automated Theorem Provingcited by 47
- 2026Numina-Lean-Agent: An Open and General Agentic Reasoning System for Formal Mathematicscited by 43
- 2025Seed-Prover 1.5: Mastering Undergraduate-Level Theorem Proving via Learning from Experiencecited by 36
- 2026Towards Autonomous Mathematics Researchcited by 31
- 2024A Semantic Search Engine for Mathlib4cited by 30
- 2026First Proofcited by 26
- 2026Semi-Autonomous Mathematics Discovery with Gemini: A Case Study on the ErdHos Problemscited by 24
4 more
- 2025FATE: A Formal Benchmark Series for Frontier Algebra of Multiple Difficulty Levelscited by 23
- 2025Aria: An Agent For Retrieval and Iterative Auto-Formalization via Dependency Graphcited by 18
- 2026Semi-Autonomous Formalization of the Vlasov-Maxwell-Landau Equilibriumcited by 7
- 2026Aletheia tackles FirstProof autonomouslycited by 6
Built on by
Citing papers per year: 2026: 21.
21 papers.
Sort:
By area:
- 2026LeanSearch v2: Global Premise Retrieval for Lean 4 Theorem Provingcited by 7
- 2026ProofCouncil: An LLM Agent for Solving Open Mathematical Problemscited by 6
- 2026Danus: Orchestrating Mathematical Reasoning Agents with Fact-Graph Memorycited by 5
- 2026Matlas: A Semantic Search Engine for Mathematicscited by 3
- 2026Iteris: Agentic Research Loops for Computational Mathematicscited by 2
- 2026Evaluating Research-Level Math Proofs via Strict Step-Level Verificationcited by 1
- 2026ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent Systemcited by 1
- 2026MathCoPilot: An Interactive System for Human-AI Symbiotic Paradigm of Mathematical Researchcited by 1
- 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Languagecited by 1
- 2026Albilich: Steerable Proof-State Orchestration for LLM-Based Mathematical Research with CAS Integrationcited by 1
- 2026VALG: An Agentic System for ML Theory Researchcited by 1
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Provingcited by 1
9 more
- 2026Grokability in five inequalitiescited by 0
- 2026SABER-Math: Automated Benchmark for Information Retrieval Evaluation in Mathematicscited by 0
- 2026Tangent classes of matroids and wonderful compactificationscited by 0
- 2026Andy: A Mathematical Agent for Rigorous Proof and Autonomous Researchcited by 0
- 2026Stellar Colosseum: A Many-Agent Harness for Long-Horizon Research in Mathematics and Theoretical Computer Sciencecited by 0
- 2026Choir: An Open Protocol for Distributed Multi-Agent Autoformalizationcited by 0
- 2026ProofLoom: Proof-Obligation-Driven Theory Construction for Autoformalizing Research-Level Stochastic Optimizationcited by 0
- 2026GenLimitLib: A Formal Library for Language Generation in the Limit and AI-Assisted Mathematical Researchcited by 0
- 2026Fyan: A Human--AI Harness with Semantic Auditing for Document-Level Formalizationcited by 0
- 2026Fyan: A Human--AI Harness with Semantic Auditing for Document-Level Formalization30 Sep 2026
- 2026GenLimitLib: A Formal Library for Language Generation in the Limit and AI-Assisted Mathematical Research29 Sep 2026
- 2026ProofLoom: Proof-Obligation-Driven Theory Construction for Autoformalizing Research-Level Stochastic Optimization28 Sep 2026
- 2026Choir: An Open Protocol for Distributed Multi-Agent Autoformalization25 Sep 2026
- 2026Stellar Colosseum: A Many-Agent Harness for Long-Horizon Research in Mathematics and Theoretical Computer Science14 Sep 2026
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Proving25 Aug 2026
- 2026Andy: A Mathematical Agent for Rigorous Proof and Autonomous Research15 Aug 2026
- 2026VALG: An Agentic System for ML Theory Research13 Aug 2026
- 2026Albilich: Steerable Proof-State Orchestration for LLM-Based Mathematical Research with CAS Integration30 Jul 2026
- 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Language17 Jul 2026
- 2026MathCoPilot: An Interactive System for Human-AI Symbiotic Paradigm of Mathematical Research16 Jul 2026
- 2026ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent System15 Jul 2026
9 more
- 2026ProofCouncil: An LLM Agent for Solving Open Mathematical Problems10 Jul 2026
- 2026Danus: Orchestrating Mathematical Reasoning Agents with Fact-Graph Memory7 Jul 2026
- 2026Tangent classes of matroids and wonderful compactifications7 Jul 2026
- 2026SABER-Math: Automated Benchmark for Information Retrieval Evaluation in Mathematics29 Jun 2026
- 2026Evaluating Research-Level Math Proofs via Strict Step-Level Verification9 Jun 2026
- 2026Iteris: Agentic Research Loops for Computational Mathematics1 Jun 2026
- 2026LeanSearch v2: Global Premise Retrieval for Lean 4 Theorem Proving13 May 2026
- 2026Grokability in five inequalities6 May 2026
- 2026Matlas: A Semantic Search Engine for Mathematics19 Apr 2026
- 2026ProofCouncil: An LLM Agent for Solving Open Mathematical Problemscited by 6
- 2026Iteris: Agentic Research Loops for Computational Mathematicscited by 2
- 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Languagecited by 1
- 2026VALG: An Agentic System for ML Theory Researchcited by 1
- 2026SABER-Math: Automated Benchmark for Information Retrieval Evaluation in Mathematicscited by 0
- 2026Andy: A Mathematical Agent for Rigorous Proof and Autonomous Researchcited by 0
- 2026Stellar Colosseum: A Many-Agent Harness for Long-Horizon Research in Mathematics and Theoretical Computer Sciencecited by 0
- 2026Choir: An Open Protocol for Distributed Multi-Agent Autoformalizationcited by 0
- 2026Choir: An Open Protocol for Distributed Multi-Agent Autoformalization25 Sep 2026
- 2026Stellar Colosseum: A Many-Agent Harness for Long-Horizon Research in Mathematics and Theoretical Computer Science14 Sep 2026
- 2026Andy: A Mathematical Agent for Rigorous Proof and Autonomous Research15 Aug 2026
- 2026VALG: An Agentic System for ML Theory Research13 Aug 2026
- 2026AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Language17 Jul 2026
- 2026ProofCouncil: An LLM Agent for Solving Open Mathematical Problems10 Jul 2026
- 2026SABER-Math: Automated Benchmark for Information Retrieval Evaluation in Mathematics29 Jun 2026
- 2026Iteris: Agentic Research Loops for Computational Mathematics1 Jun 2026
- 2026LeanSearch v2: Global Premise Retrieval for Lean 4 Theorem Provingcited by 7
- 2026Matlas: A Semantic Search Engine for Mathematicscited by 3
- 2026Evaluating Research-Level Math Proofs via Strict Step-Level Verificationcited by 1
- 2026MathCoPilot: An Interactive System for Human-AI Symbiotic Paradigm of Mathematical Researchcited by 1
- 2026Albilich: Steerable Proof-State Orchestration for LLM-Based Mathematical Research with CAS Integrationcited by 1
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Provingcited by 1
- 2026Grokability in five inequalitiescited by 0
- 2026Tangent classes of matroids and wonderful compactificationscited by 0
- 2026ProofLoom: Proof-Obligation-Driven Theory Construction for Autoformalizing Research-Level Stochastic Optimizationcited by 0
- 2026GenLimitLib: A Formal Library for Language Generation in the Limit and AI-Assisted Mathematical Researchcited by 0
- 2026Fyan: A Human--AI Harness with Semantic Auditing for Document-Level Formalizationcited by 0
- 2026Fyan: A Human--AI Harness with Semantic Auditing for Document-Level Formalization30 Sep 2026
- 2026GenLimitLib: A Formal Library for Language Generation in the Limit and AI-Assisted Mathematical Research29 Sep 2026
- 2026ProofLoom: Proof-Obligation-Driven Theory Construction for Autoformalizing Research-Level Stochastic Optimization28 Sep 2026
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Proving25 Aug 2026
- 2026Albilich: Steerable Proof-State Orchestration for LLM-Based Mathematical Research with CAS Integration30 Jul 2026
- 2026MathCoPilot: An Interactive System for Human-AI Symbiotic Paradigm of Mathematical Research16 Jul 2026
- 2026Tangent classes of matroids and wonderful compactifications7 Jul 2026
- 2026Evaluating Research-Level Math Proofs via Strict Step-Level Verification9 Jun 2026
- 2026LeanSearch v2: Global Premise Retrieval for Lean 4 Theorem Proving13 May 2026
- 2026Grokability in five inequalities6 May 2026
- 2026Matlas: A Semantic Search Engine for Mathematics19 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Hilbert: Recursively Building Formal Proofs with Informal Reasoning
- 2024Formal Mathematical Reasoning: A New Frontier in AI
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofs
- 2026Advancing Mathematics Research with AI-Driven Formal Proof Search
- 2025FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models
- 2026Measuring Progress in Reasoning Toward Mathematical Discovery with Automatic Verification
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier
- 2026Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification