Learning to Prove Theorems by Learning to Generate Theorems
Not on the map. Why?
Abstract (arXiv)
We consider the task of automated theorem proving, a key AI task. Deep learning has shown promise for training theorem provers, but there are limited human-written theorems and proofs available for supervised learning. To address this limitation, we propose to learn a neural generator that automatically synthesizes theorems and proofs for the purpose of training a theorem prover. Experiments on real-world tasks demonstrate that synthetic data from our approach improves the theorem prover and advances the state of the art of automated theorem proving in Metamath. Code is available at https://github.com/princeton-vl/MetaGen.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 4; 2023: 8; 2024: 18; 2025: 7; 2026: 2.
43 papers.
Sort:
By area:
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
- 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
- 2021Explaining Answers with Entailment Treescited by 148
- 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 130
- 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 108
- 2021NaturalProofs: Mathematical Theorem Proving in Natural Languagecited by 80
- 2025STP: Self-play LLM Theorem Provers with Iterative Conjecturing and Provingcited by 77
- 2024A Survey on Deep Learning for Theorem Provingcited by 55
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 52
- 2024Learning Formal Mathematics From Intrinsic Motivationcited by 45
- 2024MUSTARD: Mastering Uniform Synthesis of Theorem and Proof Datacited by 43
31 more
- 2023Forward-Backward Reasoning in Large Language Models for Mathematical Verificationcited by 39
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2024LeanAgent: Lifelong Learning for Formal Theorem Provingcited by 34
- 2024CodeIt: Self-Improving Language Models with Prioritized Hindsight Replaycited by 23
- 2024Consistent Autoformalization for Constructing Mathematical Librariescited by 20
- 2023Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning modelscited by 18
- 2024Pantograph: A Machine-to-Machine Interaction Interface for Advanced Theorem Proving, High Level Reasoning, and Data Extraction in Lean 4cited by 15
- 2024Learn from Failure: Fine-Tuning LLMs with Trial-and-Error Data for Intuitionistic Propositional Logic Provingcited by 11
- 2022A Survey in Mathematical Language Processingcited by 9
- 2023Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matricescited by 9
- 2024REFACTOR: Learning to Extract Theorems from Proofscited by 9
- 2021Training a First-Order Theorem Prover from Synthetic Datacited by 8
- 2024Can Transformers Do Enumerative Geometry?cited by 8
- 2023Teaching Probabilistic Logical Reasoning to Transformerscited by 7
- 2023Learning to Compute Gr"obner Basescited by 7
- 2025Lean Finder: Semantic Search for Mathlib That Understands User Intentscited by 7
- 2024ATG: Benchmarking Automated Theorem Generation for Generative Language Modelscited by 6
- 20243D-Prover: Diversity Driven Theorem Proving With Determinantal Point Processescited by 6
- 2022Learning to Find Proofs and Theorems by Learning to Refine Search Strategies: The Case of Loop Invariant Synthesiscited by 5
- 2025Steering LLMs for Formal Theorem Provingcited by 4
- 2026Learning to Disprove: Formal Counterexample Generation with Large Language Modelscited by 4
- 2024Alchemy: Amplifying Theorem-Proving Capability through Symbolic Mutationcited by 3
- 2023Enhancing Neural Theorem Proving through Data Augmentation and Dynamic Sampling Methodcited by 2
- 2024Application of AI to formal methods - an analysis of current trendscited by 2
- 2025Building A Proof-Oriented Programmer That Is 64% Better Than GPT-4o Under Data Scarcitycited by 2
- 2025Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Provingcited by 2
- 2025Saturation-Driven Dataset Generation for LLM Mathematical Reasoning in the TPTP Ecosystemcited by 2
- 2022Learning to Prove Trigonometric Identitiescited by 1
- 2024GANsemble for Small and Imbalanced Data Sets: A Baseline for Synthetic Microplastics Datacited by 1
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontiercited by 1
- 2024EvoGPT-f: An Evolutionary GPT Framework for Benchmarking Formal Math Languagescited by 0
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier8 Jul 2026
- 2026Learning to Disprove: Formal Counterexample Generation with Large Language Models19 Mar 2026
- 2025Lean Finder: Semantic Search for Mathlib That Understands User Intents8 Oct 2025
- 2025Saturation-Driven Dataset Generation for LLM Mathematical Reasoning in the TPTP Ecosystem8 Sep 2025
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflection21 Jul 2025
- 2025Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Proving12 Mar 2025
- 2025Steering LLMs for Formal Theorem Proving21 Feb 2025
- 2025Building A Proof-Oriented Programmer That Is 64% Better Than GPT-4o Under Data Scarcity17 Feb 2025
- 2025STP: Self-play LLM Theorem Provers with Iterative Conjecturing and Proving31 Jan 2025
- 2024Application of AI to formal methods - an analysis of current trends22 Nov 2024
- 2024Pantograph: A Machine-to-Machine Interaction Interface for Advanced Theorem Proving, High Level Reasoning, and Data Extraction in Lean 421 Oct 2024
- 2024Alchemy: Amplifying Theorem-Proving Capability through Symbolic Mutation21 Oct 2024
31 more
- 20243D-Prover: Diversity Driven Theorem Proving With Determinantal Point Processes14 Oct 2024
- 2024LeanAgent: Lifelong Learning for Formal Theorem Proving8 Oct 2024
- 2024Consistent Autoformalization for Constructing Mathematical Libraries5 Oct 2024
- 2024Can Transformers Do Enumerative Geometry?27 Aug 2024
- 2024Learning Formal Mathematics From Intrinsic Motivation30 Jun 2024
- 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data23 May 2024
- 2024ATG: Benchmarking Automated Theorem Generation for Generative Language Models5 May 2024
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Lean18 Apr 2024
- 2024A Survey on Deep Learning for Theorem Proving15 Apr 2024
- 2024Learn from Failure: Fine-Tuning LLMs with Trial-and-Error Data for Intuitionistic Propositional Logic Proving10 Apr 2024
- 2024GANsemble for Small and Imbalanced Data Sets: A Baseline for Synthetic Microplastics Data10 Apr 2024
- 2024REFACTOR: Learning to Extract Theorems from Proofs26 Feb 2024
- 2024MUSTARD: Mastering Uniform Synthesis of Theorem and Proof Data14 Feb 2024
- 2024EvoGPT-f: An Evolutionary GPT Framework for Benchmarking Formal Math Languages12 Feb 2024
- 2024CodeIt: Self-Improving Language Models with Prioritized Hindsight Replay7 Feb 2024
- 2023Enhancing Neural Theorem Proving through Data Augmentation and Dynamic Sampling Method20 Dec 2023
- 2023Learning to Compute Gr"obner Bases21 Nov 2023
- 2023LEGO-Prover: Neural Theorem Proving with Growing Libraries1 Oct 2023
- 2023Forward-Backward Reasoning in Large Language Models for Mathematical Verification15 Aug 2023
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Models27 Jun 2023
- 2023Teaching Probabilistic Logical Reasoning to Transformers22 May 2023
- 2023Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matrices21 Mar 2023
- 2023Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning models14 Mar 2023
- 2022Learning to Prove Trigonometric Identities14 Jul 2022
- 2022A Survey in Mathematical Language Processing30 May 2022
- 2022Learning to Find Proofs and Theorems by Learning to Refine Search Strategies: The Case of Loop Invariant Synthesis27 May 2022
- 2022HyperTree Proof Search for Neural Theorem Proving23 May 2022
- 2021Explaining Answers with Entailment Trees17 Apr 2021
- 2021NaturalProofs: Mathematical Theorem Proving in Natural Language24 Mar 2021
- 2021Training a First-Order Theorem Prover from Synthetic Data5 Mar 2021
- 2021Proof Artifact Co-training for Theorem Proving with Language Models11 Feb 2021
- 2025STP: Self-play LLM Theorem Provers with Iterative Conjecturing and Provingcited by 77
- 2024MUSTARD: Mastering Uniform Synthesis of Theorem and Proof Datacited by 43
- 2023Forward-Backward Reasoning in Large Language Models for Mathematical Verificationcited by 39
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2024LeanAgent: Lifelong Learning for Formal Theorem Provingcited by 34
- 2024CodeIt: Self-Improving Language Models with Prioritized Hindsight Replaycited by 23
- 2023Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning modelscited by 18
- 2023Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matricescited by 9
- 2023Teaching Probabilistic Logical Reasoning to Transformerscited by 7
- 2026Learning to Disprove: Formal Counterexample Generation with Large Language Modelscited by 4
- 2025Building A Proof-Oriented Programmer That Is 64% Better Than GPT-4o Under Data Scarcitycited by 2
- 2025Saturation-Driven Dataset Generation for LLM Mathematical Reasoning in the TPTP Ecosystemcited by 2
- 2026Learning to Disprove: Formal Counterexample Generation with Large Language Models19 Mar 2026
- 2025Saturation-Driven Dataset Generation for LLM Mathematical Reasoning in the TPTP Ecosystem8 Sep 2025
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflection21 Jul 2025
- 2025Building A Proof-Oriented Programmer That Is 64% Better Than GPT-4o Under Data Scarcity17 Feb 2025
- 2025STP: Self-play LLM Theorem Provers with Iterative Conjecturing and Proving31 Jan 2025
- 2024LeanAgent: Lifelong Learning for Formal Theorem Proving8 Oct 2024
- 2024MUSTARD: Mastering Uniform Synthesis of Theorem and Proof Data14 Feb 2024
- 2024CodeIt: Self-Improving Language Models with Prioritized Hindsight Replay7 Feb 2024
- 2023Forward-Backward Reasoning in Large Language Models for Mathematical Verification15 Aug 2023
- 2023Teaching Probabilistic Logical Reasoning to Transformers22 May 2023
- 2023Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matrices21 Mar 2023
- 2023Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning models14 Mar 2023
- 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
- 2021Explaining Answers with Entailment Treescited by 148
- 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 108
- 2021NaturalProofs: Mathematical Theorem Proving in Natural Languagecited by 80
- 2024A Survey on Deep Learning for Theorem Provingcited by 55
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 52
- 2024Learning Formal Mathematics From Intrinsic Motivationcited by 45
- 2024Consistent Autoformalization for Constructing Mathematical Librariescited by 20
- 2024Pantograph: A Machine-to-Machine Interaction Interface for Advanced Theorem Proving, High Level Reasoning, and Data Extraction in Lean 4cited by 15
- 2024Learn from Failure: Fine-Tuning LLMs with Trial-and-Error Data for Intuitionistic Propositional Logic Provingcited by 11
- 2022A Survey in Mathematical Language Processingcited by 9
- 2024REFACTOR: Learning to Extract Theorems from Proofscited by 9
12 most cited of 28 All 28 (JSON)
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier8 Jul 2026
- 2025Lean Finder: Semantic Search for Mathlib That Understands User Intents8 Oct 2025
- 2025Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Proving12 Mar 2025
- 2025Steering LLMs for Formal Theorem Proving21 Feb 2025
- 2024Application of AI to formal methods - an analysis of current trends22 Nov 2024
- 2024Pantograph: A Machine-to-Machine Interaction Interface for Advanced Theorem Proving, High Level Reasoning, and Data Extraction in Lean 421 Oct 2024
- 2024Alchemy: Amplifying Theorem-Proving Capability through Symbolic Mutation21 Oct 2024
- 20243D-Prover: Diversity Driven Theorem Proving With Determinantal Point Processes14 Oct 2024
- 2024Consistent Autoformalization for Constructing Mathematical Libraries5 Oct 2024
- 2024Can Transformers Do Enumerative Geometry?27 Aug 2024
- 2024Learning Formal Mathematics From Intrinsic Motivation30 Jun 2024
- 2024ATG: Benchmarking Automated Theorem Generation for Generative Language Models5 May 2024
12 newest of 28 All 28 (JSON)