Learning to Prove Theorems via Interacting with Proof Assistants
Not on the map. Why?
Abstract (arXiv)
Humans prove theorems by relying on substantial high-level reasoning and problem-specific insights. Proof assistants offer a formalism that resembles human mathematical reasoning, representing theorems in higher-order logic and proofs as high-level tactics. However, human experts have to construct proofs manually by entering tactics into the proof assistant. In this paper, we study the problem of using machine learning to automate the interaction with proof assistants. We construct CoqGym, a large-scale dataset and learning environment containing 71K human-written proofs from 123 projects developed with the Coq proof assistant. We develop ASTactic, a deep learning-based model that generates tactics as programs in the form of abstract syntax trees (ASTs). Experiments show that ASTactic trained on CoqGym can generate effective tactics and can be used to prove new theorems not previously provable by automated methods. Code is available at https://github.com/princeton-vl/CoqGym.
Key facts. Cited by 107 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 7; 2023: 15; 2024: 36; 2025: 20; 2026: 18.
107 papers.
Sort:
By area:
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 283
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
- 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
- 2022Formal Mathematics Statement Curriculum Learningcited by 141
- 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 130
- 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
- 2023Baldur: Whole-Proof Generation and Repair with Large Language Modelscited by 118
- 2024Lean Workbook: A large-scale Lean problem set formalized from natural language math problemscited by 115
- 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 108
38 more
- 2021NaturalProofs: Mathematical Theorem Proving in Natural Languagecited by 80
- 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 80
- 2023An In-Context Learning Agent for Formal Theorem-Provingcited by 78
- 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Expertscited by 58
- 2024A Survey on Deep Learning for Theorem Provingcited by 55
- 2024DafnyBench: A Benchmark for Formal Software Verificationcited by 54
- 2022Generating Natural Language Proofs with Verifier-Guided Searchcited by 52
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 52
- 2023Magnushammer: A Transformer-Based Approach to Premise Selectioncited by 50
- 2021LIME: Learning Inductive Bias for Primitives of Mathematical Reasoningcited by 46
- 2024AutoVerus: Automated Proof Generation for Rust Codecited by 46
- 2024Process-Driven Autoformalization in Lean 4cited by 45
- 2021TacticZero: Learning to Prove Theorems from Scratch with Deep Reinforcement Learningcited by 37
- 2024miniCTX: Neural Theorem Proving with (Long-)Contextscited by 35
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2025RealMath: A Continuous Benchmark for Evaluating Language Models on Research-Level Mathematicscited by 30
- 2024Autoformalizing Euclidean Geometrycited by 27
- 2025Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physicscited by 27
- 2024LEAN-GitHub: Compiling GitHub LEAN repositories for a versatile LEAN provercited by 25
- 2024Rango: Adaptive Retrieval-Augmented Proving for Automated Software Verificationcited by 25
- 2023Lyra: Orchestrating Dual Correction in Automated Theorem Provingcited by 24
- 2023TRIGO: Benchmarking Formal Mathematical Proof Reduction for Generative Language Modelscited by 24
- 2023Mathematical Language Models: A Surveycited by 24
- 2025Solving Inequality Proofs with Large Language Modelscited by 21
- 2024Proving Olympiad Algebraic Inequalities without Human Demonstrationscited by 20
- 2024Proof Automation with Large Language Modelscited by 20
- 2024Towards Neural Synthesis for SMT-Assisted Proof-Oriented Programmingcited by 19
- 2024miniCodeProps: a Minimal Benchmark for Proving Code Propertiescited by 18
- 2025Proving the Coding Interview: A Benchmark for Formally Verified Code Generationcited by 18
- 2021Contrastive Reinforcement Learning of Symbolic Reasoning Domainscited by 17
- 2023Can Transformers Learn to Solve Problems Recursively?cited by 17
- 2025From Informal to Formal -- Incorporating and Evaluating LLMs on Natural Language Requirements to Verifiable Formal Proofscited by 17
- 2024Graph2Tac: Online Representation Learning of Formal Math Conceptscited by 15
- 2024Pantograph: A Machine-to-Machine Interaction Interface for Advanced Theorem Proving, High Level Reasoning, and Data Extraction in Lean 4cited by 15
- 2024Transformer-Based Models Are Not Yet Perfect At Learning to Emulate Structural Recursioncited by 14
- 2025miniF2F-Lean Revisited: Reviewing Limitations and Charting a Path Forwardcited by 13
- 2025A Survey on Mathematical Reasoning and Optimization with Large Language Modelscited by 12
- 2023Leveraging Large Language Models for Automated Proof Synthesis in Rustcited by 11
50 most cited of 107 All 107 (JSON)
- 2026PROVE-RT: Generating Mechanized Theorem Prover Scripts for Real-Time Systems using LLMs13 Aug 2026
- 2026Can Open-Weight LLMs Produce Kernel-Verified Coq Proofs? A Pilot Study5 Aug 2026
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier8 Jul 2026
- 2026ITPEval: Benchmarking Formal Translation Across Interactive Theorem Provers7 Jul 2026
- 2026Harnessing Code Agents for Automatic Software Verification7 Jul 2026
- 2026Geometric Measurements of the Axiom of Choice in Neural Proof Embeddings26 Jun 2026
- 2026The Two-Hump Problem: Bridging the Difficulty Gap in Mathematical Reinforcement Learning19 Jun 2026
- 2026IsabeLLM: Automated Theorem Proving Applied to Formally Verifying Consensus16 Jun 2026
- 2026TheoremBench: Evaluating LLMs on Theorem Proving in Formal Mathematics8 Jun 2026
- 2026Inductive Deductive Synthesis: Enabling AI to Generate Formally Verified Systems22 May 2026
- 2026LiveFMBench: Unveiling the Power and Limits of Agentic Workflows in Specification Generation2 May 2026
- 2026ProofSketcher: Hybrid LLM + Lightweight Proof Checker for Reliable Math/Logic Reasoning7 Apr 2026
38 more
- 2026Automated Lemma Discovery in Agentic Program Verification23 Mar 2026
- 2026INDUCTION: Finite-Structure Concept Synthesis in First-Order Logic21 Feb 2026
- 2026ABD: Default Exception Abduction in Finite First Order Worlds21 Feb 2026
- 2026VeriSoftBench: Repository-Scale Formal Verification Benchmarks for Lean20 Feb 2026
- 2026Neural Theorem Proving for Verification Conditions: A Real-World Benchmark26 Jan 2026
- 2026Towards Automating Blockchain Consensus Verification with IsabeLLM12 Jan 2026
- 2025G"odel's Poetry16 Dec 2025
- 2025Agentic Verification of Software Systems21 Nov 2025
- 2025miniF2F-Lean Revisited: Reviewing Limitations and Charting a Path Forward5 Nov 2025
- 2025Foundation of Intelligence: Review of Math Word Problems from Human Cognition Perspective24 Oct 2025
- 2025Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics14 Oct 2025
- 2025A Case Study on the Effectiveness of LLMs in Verification with Proof Assistants26 Aug 2025
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflection21 Jul 2025
- 2025Advocate for Complete Benchmarks for Formal Reasoning with Formal/Informal Statements and Formal/Informal Proofs7 Jul 2025
- 2025Performance of LLMs on Stochastic Modeling Operations Research Problems: From Theory to Practice30 Jun 2025
- 2025Solving Inequality Proofs with Large Language Models9 Jun 2025
- 2025RocqStar: Leveraging Similarity-driven Retrieval and Agentic Systems for Rocq generation28 May 2025
- 2025RealMath: A Continuous Benchmark for Evaluating Language Models on Research-Level Mathematics18 May 2025
- 2025Hierarchical Attention Generates Better Proofs27 Apr 2025
- 2025Generative Evaluation of Complex Reasoning in Large Language Models3 Apr 2025
- 2025A Survey on Mathematical Reasoning and Optimization with Large Language Models22 Mar 2025
- 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems3 Mar 2025
- 2025Proving the Coding Interview: A Benchmark for Formally Verified Code Generation8 Feb 2025
- 2025ProofWala: A Framework for Multilingual Proof Data Synthesis and Theorem-Proving7 Feb 2025
- 2025Simplifying Formal Proof-Generating Models with ChatGPT and Basic Searching Techniques5 Feb 2025
- 2025From Informal to Formal -- Incorporating and Evaluating LLMs on Natural Language Requirements to Verifiable Formal Proofs27 Jan 2025
- 2024Formal Mathematical Reasoning: A New Frontier in AI20 Dec 2024
- 2024Rango: Adaptive Retrieval-Augmented Proving for Automated Software Verification18 Dec 2024
- 2024Application of AI to formal methods - an analysis of current trends22 Nov 2024
- 2024Learning Rules Explaining Interactive Theorem Proving Tactic Prediction2 Nov 2024
- 2024Cobblestone: A Divide-and-Conquer Approach for Automating Formal Verification25 Oct 2024
- 2024CoqPilot, a plugin for LLM-based generation of proofs25 Oct 2024
- 2024Pantograph: A Machine-to-Machine Interaction Interface for Advanced Theorem Proving, High Level Reasoning, and Data Extraction in Lean 421 Oct 2024
- 2024AlphaIntegrator: Transformer Action Search for Symbolic Integration Proofs3 Oct 2024
- 2024In-Context Learning May Not Elicit Trustworthy Reasoning: A-Not-B Errors in Pretrained Language Models23 Sep 2024
- 2024Proof Automation with Large Language Models22 Sep 2024
- 2024AutoVerus: Automated Proof Generation for Rust Code19 Sep 2024
- 2024QEDCartographer: Automating Formal Verification Using Reward-Free Reinforcement Learning17 Aug 2024
50 newest of 107 All 107 (JSON)
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 283
- 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
- 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 80
- 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Expertscited by 58
- 2024Process-Driven Autoformalization in Lean 4cited by 45
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2025RealMath: A Continuous Benchmark for Evaluating Language Models on Research-Level Mathematicscited by 30
- 2025Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physicscited by 27
- 2024LEAN-GitHub: Compiling GitHub LEAN repositories for a versatile LEAN provercited by 25
- 2023TRIGO: Benchmarking Formal Mathematical Proof Reduction for Generative Language Modelscited by 24
- 2025Solving Inequality Proofs with Large Language Modelscited by 21
- 2025From Informal to Formal -- Incorporating and Evaluating LLMs on Natural Language Requirements to Verifiable Formal Proofscited by 17
12 most cited of 17 All 17 (JSON)
- 2026ProofSketcher: Hybrid LLM + Lightweight Proof Checker for Reliable Math/Logic Reasoning7 Apr 2026
- 2025Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics14 Oct 2025
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflection21 Jul 2025
- 2025Solving Inequality Proofs with Large Language Models9 Jun 2025
- 2025RealMath: A Continuous Benchmark for Evaluating Language Models on Research-Level Mathematics18 May 2025
- 2025Generative Evaluation of Complex Reasoning in Large Language Models3 Apr 2025
- 2025A Survey on Mathematical Reasoning and Optimization with Large Language Models22 Mar 2025
- 2025From Informal to Formal -- Incorporating and Evaluating LLMs on Natural Language Requirements to Verifiable Formal Proofs27 Jan 2025
- 2024Formal Mathematical Reasoning: A New Frontier in AI20 Dec 2024
- 2024In-Context Learning May Not Elicit Trustworthy Reasoning: A-Not-B Errors in Pretrained Language Models23 Sep 2024
- 2024LEAN-GitHub: Compiling GitHub LEAN repositories for a versatile LEAN prover24 Jul 2024
- 2024TheoremLlama: Transforming General-Purpose LLMs into Lean4 Experts3 Jul 2024
12 newest of 17 All 17 (JSON)
- 2023An In-Context Learning Agent for Formal Theorem-Provingcited by 78
- 2025Agentic Verification of Software Systemscited by 5
- 2025RocqStar: Leveraging Similarity-driven Retrieval and Agentic Systems for Rocq generationcited by 3
- 2026Automated Lemma Discovery in Agentic Program Verificationcited by 2
- 2026Harnessing Code Agents for Automatic Software Verificationcited by 1
- 2024Towards Automated Functional Equation Proving: A Benchmark Dataset and A Domain-Specific In-Context Agentcited by 0
- 2026LiveFMBench: Unveiling the Power and Limits of Agentic Workflows in Specification Generationcited by 0
- 2026Harnessing Code Agents for Automatic Software Verification7 Jul 2026
- 2026LiveFMBench: Unveiling the Power and Limits of Agentic Workflows in Specification Generation2 May 2026
- 2026Automated Lemma Discovery in Agentic Program Verification23 Mar 2026
- 2025Agentic Verification of Software Systems21 Nov 2025
- 2025RocqStar: Leveraging Similarity-driven Retrieval and Agentic Systems for Rocq generation28 May 2025
- 2024Towards Automated Functional Equation Proving: A Benchmark Dataset and A Domain-Specific In-Context Agent5 Jul 2024
- 2023An In-Context Learning Agent for Formal Theorem-Proving6 Oct 2023
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
- 2024PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competitioncited by 153
- 2022Formal Mathematics Statement Curriculum Learningcited by 141
- 2023Baldur: Whole-Proof Generation and Repair with Large Language Modelscited by 118
- 2024Lean Workbook: A large-scale Lean problem set formalized from natural language math problemscited by 115
- 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 108
- 2021NaturalProofs: Mathematical Theorem Proving in Natural Languagecited by 80
- 2024A Survey on Deep Learning for Theorem Provingcited by 55
- 2024DafnyBench: A Benchmark for Formal Software Verificationcited by 54
- 2022Generating Natural Language Proofs with Verifier-Guided Searchcited by 52
12 most cited of 80 All 80 (JSON)
- 2026PROVE-RT: Generating Mechanized Theorem Prover Scripts for Real-Time Systems using LLMs13 Aug 2026
- 2026Can Open-Weight LLMs Produce Kernel-Verified Coq Proofs? A Pilot Study5 Aug 2026
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier8 Jul 2026
- 2026ITPEval: Benchmarking Formal Translation Across Interactive Theorem Provers7 Jul 2026
- 2026Geometric Measurements of the Axiom of Choice in Neural Proof Embeddings26 Jun 2026
- 2026The Two-Hump Problem: Bridging the Difficulty Gap in Mathematical Reinforcement Learning19 Jun 2026
- 2026IsabeLLM: Automated Theorem Proving Applied to Formally Verifying Consensus16 Jun 2026
- 2026TheoremBench: Evaluating LLMs on Theorem Proving in Formal Mathematics8 Jun 2026
- 2026Inductive Deductive Synthesis: Enabling AI to Generate Formally Verified Systems22 May 2026
- 2026INDUCTION: Finite-Structure Concept Synthesis in First-Order Logic21 Feb 2026
- 2026ABD: Default Exception Abduction in Finite First Order Worlds21 Feb 2026
- 2026VeriSoftBench: Repository-Scale Formal Verification Benchmarks for Lean20 Feb 2026
12 newest of 80 All 80 (JSON)