DeepMath - Deep Sequence Models for Premise Selection
Not on the map. Why?
Abstract (arXiv)
We study the effectiveness of neural sequence models for premise selection in automated theorem proving, one of the main bottlenecks in the formalization of mathematics. We propose a two stage approach for this task that yields good results for the premise selection task on the Mizar corpus while avoiding the hand-engineered features of existing state-of-the-art models. To our knowledge, this is the first time deep learning has been applied to theorem proving on a large scale.
Key facts. Cited by 80 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 10; 2023: 12; 2024: 17; 2025: 19; 2026: 11.
80 papers.
Sort:
By area:
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2022Autoformalization with Large Language Modelscited by 252
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
- 2022Formal Mathematics Statement Curriculum Learningcited by 141
- 2021Proof Artifact Co-training for Theorem Proving with Language Modelscited by 130
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 126
- 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
- 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 108
- 2022Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Proverscited by 97
- 2021NaturalProofs: Mathematical Theorem Proving in Natural Languagecited by 80
- 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 80
38 more
- 2024Premise Order Matters in Reasoning with Large Language Modelscited by 71
- 2024A Survey on Deep Learning for Theorem Provingcited by 55
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 52
- 2023Magnushammer: A Transformer-Based Approach to Premise Selectioncited by 50
- 2024Learning Formal Mathematics From Intrinsic Motivationcited by 45
- 2024miniCTX: Neural Theorem Proving with (Long-)Contextscited by 35
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2024LeanAgent: Lifelong Learning for Formal Theorem Provingcited by 34
- 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofscited by 28
- 2025Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physicscited by 27
- 2023Mathematical Language Models: A Surveycited by 24
- 2024Proof Automation with Large Language Modelscited by 20
- 2021Contrastive Reinforcement Learning of Symbolic Reasoning Domainscited by 17
- 2021Neural Termination Analysiscited by 16
- 2021Learning to Guide a Saturation-Based Theorem Provercited by 15
- 2022Peano: Learning Formal Mathematical Reasoningcited by 15
- 2025A Survey on Mathematical Reasoning and Optimization with Large Language Modelscited by 12
- 2024Learn from Failure: Fine-Tuning LLMs with Trial-and-Error Data for Intuitionistic Propositional Logic Provingcited by 11
- 2021Vampire With a Brain Is a Good ITP Hammercited by 10
- 2023Machine-Learned Premise Selection for Leancited by 10
- 2025MPS-Prover: Advancing Stepwise Theorem Proving by Multi-Perspective Search and Data Curationcited by 10
- 2021Learning Symbolic Rules for Reasoning in Quasi-Natural Languagecited by 9
- 2022A Survey in Mathematical Language Processingcited by 9
- 2023Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matricescited by 9
- 2021The Role of Entropy in Guiding a Connection Provercited by 8
- 2022The Isabelle ENIGMAcited by 8
- 2024Learning Guided Automated Reasoning: A Brief Surveycited by 7
- 2025Lean Finder: Semantic Search for Mathlib That Understands User Intentscited by 7
- 2024ATG: Benchmarking Automated Theorem Generation for Generative Language Modelscited by 6
- 2021Generating Symbolic Reasoning Problems with Transformer GANscited by 5
- 2023CoProver: A Recommender System for Proof Constructioncited by 5
- 2025Agentic Verification of Software Systemscited by 5
- 2021A Study of Continuous Vector Representationsfor Theorem Provingcited by 4
- 2025Neural Theorem Proving: Generating and Structuring Proofs for Formal Verificationcited by 4
- 2023Lemmas: Generation, Selection, Applicationcited by 3
- 2023Reinforcement Learning and Data-Generation for Syntax-Guided Synthesiscited by 3
- 2025RocqStar: Leveraging Similarity-driven Retrieval and Agentic Systems for Rocq generationcited by 3
- 2025A Case Study on the Effectiveness of LLMs in Verification with Proof Assistantscited by 3
50 most cited of 80 All 80 (JSON)
- 2026When Does Structured Knowledge Help Neural Theorem Proving?28 Sep 2026
- 2026Governed Deduction: Policy-Grounded Premise Authorization Beyond Relevance25 Sep 2026
- 2026Proving olympiad geometry theorems on a superconducting quantum processor13 Sep 2026
- 2026TREAT: Evaluating Access to Formal Knowledge across Equivalent Mathematical Representations29 Jul 2026
- 2026Learned Interventions in Lean 4 grind25 Jul 2026
- 2026PriorProof: A Point-in-Time Measure of Technique Novelty for Formal Proofs18 Jul 2026
- 2026MathCoPilot: An Interactive System for Human-AI Symbiotic Paradigm of Mathematical Research16 Jul 2026
- 2026SABER-Math: Automated Benchmark for Information Retrieval Evaluation in Mathematics29 Jun 2026
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structure28 May 2026
- 2026Re2Math: Benchmarking Theorem Retrieval in Research-Level Mathematics9 May 2026
- 2026Non-Parametric Structural Priors for Geometry Theorem Prediction5 Mar 2026
- 2025Exploring Depth Generalization in Large Language Models for Solving Recursive Logic Tasks2 Dec 2025
38 more
- 2025Agentic Verification of Software Systems21 Nov 2025
- 2025Foundation of Intelligence: Review of Math Word Problems from Human Cognition Perspective24 Oct 2025
- 2025Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics14 Oct 2025
- 2025Lean Finder: Semantic Search for Mathlib That Understands User Intents8 Oct 2025
- 2025Handling Open-Vocabulary Constructs in Formalizing Specifications: Retrieval-Augmented Parsing with Expert Knowledge10 Sep 2025
- 2025Saturation-Driven Dataset Generation for LLM Mathematical Reasoning in the TPTP Ecosystem8 Sep 2025
- 2025A Case Study on the Effectiveness of LLMs in Verification with Proof Assistants26 Aug 2025
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflection21 Jul 2025
- 2025Partial Label Learning for Automated Theorem Proving4 Jul 2025
- 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofs24 Jun 2025
- 2025RocqStar: Leveraging Similarity-driven Retrieval and Agentic Systems for Rocq generation28 May 2025
- 2025MPS-Prover: Advancing Stepwise Theorem Proving by Multi-Perspective Search and Data Curation16 May 2025
- 2025Hierarchical Attention Generates Better Proofs27 Apr 2025
- 2025Neural Theorem Proving: Generating and Structuring Proofs for Formal Verification23 Apr 2025
- 2025A Survey on Mathematical Reasoning and Optimization with Large Language Models22 Mar 2025
- 2025Local Look-Ahead Guidance via Verifier-in-the-Loop for Automated Theorem Proving12 Mar 2025
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Proving11 Feb 2025
- 2025Scaling Natural-Language Graph-Based Test Time Compute for Automated Theorem Proving4 Feb 2025
- 2024Learning Randomized Reductions24 Dec 2024
- 2024Formal Mathematical Reasoning: A New Frontier in AI20 Dec 2024
- 2024Learning Rules Explaining Interactive Theorem Proving Tactic Prediction2 Nov 2024
- 2024LeanAgent: Lifelong Learning for Formal Theorem Proving8 Oct 2024
- 2024AlphaIntegrator: Transformer Action Search for Symbolic Integration Proofs3 Oct 2024
- 2024Proof Automation with Large Language Models22 Sep 2024
- 2024miniCTX: Neural Theorem Proving with (Long-)Contexts5 Aug 2024
- 2024Learning Formal Mathematics From Intrinsic Motivation30 Jun 2024
- 2024ATG: Benchmarking Automated Theorem Generation for Generative Language Models5 May 2024
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Lean18 Apr 2024
- 2024A Survey on Deep Learning for Theorem Proving15 Apr 2024
- 2024Learn from Failure: Fine-Tuning LLMs with Trial-and-Error Data for Intuitionistic Propositional Logic Proving10 Apr 2024
- 2024Incorporating Graph Attention Mechanism into Geometric Problem Solving Based on Deep Reinforcement Learning14 Mar 2024
- 2024Learning Guided Automated Reasoning: A Brief Survey6 Mar 2024
- 2024Premise Order Matters in Reasoning with Large Language Models14 Feb 2024
- 2024Learning Better Representations From Less Data For Propositional Satisfiability13 Feb 2024
- 2024EvoGPT-f: An Evolutionary GPT Framework for Benchmarking Formal Math Languages12 Feb 2024
- 2023Enhancing Neural Theorem Proving through Data Augmentation and Dynamic Sampling Method20 Dec 2023
- 2023Mathematical Language Models: A Survey12 Dec 2023
- 2023LEGO-Prover: Neural Theorem Proving with Growing Libraries1 Oct 2023
50 newest of 80 All 80 (JSON)
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
- 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
- 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 80
- 2024Premise Order Matters in Reasoning with Large Language Modelscited by 71
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2024LeanAgent: Lifelong Learning for Formal Theorem Provingcited by 34
- 2025Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physicscited by 27
- 2022Peano: Learning Formal Mathematical Reasoningcited by 15
- 2025A Survey on Mathematical Reasoning and Optimization with Large Language Modelscited by 12
- 2023Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matricescited by 9
- 2024Learning Guided Automated Reasoning: A Brief Surveycited by 7
- 2025Scaling Natural-Language Graph-Based Test Time Compute for Automated Theorem Provingcited by 2
12 most cited of 14 All 14 (JSON)
- 2026Re2Math: Benchmarking Theorem Retrieval in Research-Level Mathematics9 May 2026
- 2025Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics14 Oct 2025
- 2025Saturation-Driven Dataset Generation for LLM Mathematical Reasoning in the TPTP Ecosystem8 Sep 2025
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflection21 Jul 2025
- 2025A Survey on Mathematical Reasoning and Optimization with Large Language Models22 Mar 2025
- 2025Scaling Natural-Language Graph-Based Test Time Compute for Automated Theorem Proving4 Feb 2025
- 2024Formal Mathematical Reasoning: A New Frontier in AI20 Dec 2024
- 2024LeanAgent: Lifelong Learning for Formal Theorem Proving8 Oct 2024
- 2024Learning Guided Automated Reasoning: A Brief Survey6 Mar 2024
- 2024Premise Order Matters in Reasoning with Large Language Models14 Feb 2024
- 2023Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matrices21 Mar 2023
- 2022A Survey of Deep Learning for Mathematical Reasoning20 Dec 2022
12 newest of 14 All 14 (JSON)
- 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofscited by 28
- 2025Agentic Verification of Software Systemscited by 5
- 2025RocqStar: Leveraging Similarity-driven Retrieval and Agentic Systems for Rocq generationcited by 3
- 2024Learning Randomized Reductionscited by 0
- 2026SABER-Math: Automated Benchmark for Information Retrieval Evaluation in Mathematicscited by 0
- 2026SABER-Math: Automated Benchmark for Information Retrieval Evaluation in Mathematics29 Jun 2026
- 2025Agentic Verification of Software Systems21 Nov 2025
- 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofs24 Jun 2025
- 2025RocqStar: Leveraging Similarity-driven Retrieval and Agentic Systems for Rocq generation28 May 2025
- 2024Learning Randomized Reductions24 Dec 2024
- 2022Autoformalization with Large Language Modelscited by 252
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
- 2022Formal Mathematics Statement Curriculum Learningcited by 141
- 2025Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Provingcited by 126
- 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 108
- 2022Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Proverscited by 97
- 2021NaturalProofs: Mathematical Theorem Proving in Natural Languagecited by 80
- 2024A Survey on Deep Learning for Theorem Provingcited by 55
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 52
- 2023Magnushammer: A Transformer-Based Approach to Premise Selectioncited by 50
- 2024Learning Formal Mathematics From Intrinsic Motivationcited by 45
- 2024miniCTX: Neural Theorem Proving with (Long-)Contextscited by 35
12 most cited of 58 All 58 (JSON)
- 2026When Does Structured Knowledge Help Neural Theorem Proving?28 Sep 2026
- 2026Governed Deduction: Policy-Grounded Premise Authorization Beyond Relevance25 Sep 2026
- 2026Proving olympiad geometry theorems on a superconducting quantum processor13 Sep 2026
- 2026TREAT: Evaluating Access to Formal Knowledge across Equivalent Mathematical Representations29 Jul 2026
- 2026Learned Interventions in Lean 4 grind25 Jul 2026
- 2026PriorProof: A Point-in-Time Measure of Technique Novelty for Formal Proofs18 Jul 2026
- 2026MathCoPilot: An Interactive System for Human-AI Symbiotic Paradigm of Mathematical Research16 Jul 2026
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structure28 May 2026
- 2026Non-Parametric Structural Priors for Geometry Theorem Prediction5 Mar 2026
- 2025Exploring Depth Generalization in Large Language Models for Solving Recursive Logic Tasks2 Dec 2025
- 2025Foundation of Intelligence: Review of Math Word Problems from Human Cognition Perspective24 Oct 2025
- 2025Lean Finder: Semantic Search for Mathlib That Understands User Intents8 Oct 2025
12 newest of 58 All 58 (JSON)