Premise Selection for Theorem Proving by Deep Graph Embedding
Not on the map. Why?
Abstract (arXiv)
We propose a deep learning-based approach to the problem of premise selection: selecting mathematical statements relevant for proving a given conjecture. We represent a higher-order logic formula as a graph that is invariant to variable renaming but still fully preserves syntactic and semantic information. We then embed the graph into a vector via a novel embedding method that preserves the information of edge ordering. Our approach achieves state-of-the-art results on the HolStep dataset, improving the classification accuracy from 83% to 90.3%.
Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 6; 2023: 5; 2024: 12; 2025: 8; 2026: 4.
44 papers.
Sort:
By area:
- 2022Formal Mathematics Statement Curriculum Learningcited by 142
- 2022Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Proverscited by 98
- 2024Premise Order Matters in Reasoning with Large Language Modelscited by 72
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 58
- 2024A Survey on Deep Learning for Theorem Provingcited by 57
- 2023Magnushammer: A Transformer-Based Approach to Premise Selectioncited by 50
- 2021LIME: Learning Inductive Bias for Primitives of Mathematical Reasoningcited by 46
- 2021TacticZero: Learning to Prove Theorems from Scratch with Deep Reinforcement Learningcited by 37
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2021Learning to Guide a Saturation-Based Theorem Provercited by 15
- 2021Embedding Symbolic Temporal Knowledge into Deep Sequential Modelscited by 11
- 2024Learn from Failure: Fine-Tuning LLMs with Trial-and-Error Data for Intuitionistic Propositional Logic Provingcited by 11
32 more
- 2025ProofAug: Efficient Neural Theorem Proving via Fine-grained Proof Structure Analysiscited by 11
- 2021Vampire With a Brain Is a Good ITP Hammercited by 10
- 2025MPS-Prover: Advancing Stepwise Theorem Proving by Multi-Perspective Search and Data Curationcited by 10
- 2022A Survey in Mathematical Language Processingcited by 9
- 2021SyGNS: A Systematic Generalization Testbed Based on Natural Language Semanticscited by 7
- 2024Learning Guided Automated Reasoning: A Brief Surveycited by 7
- 2024ATG: Benchmarking Automated Theorem Generation for Generative Language Modelscited by 6
- 2023CoProver: A Recommender System for Proof Constructioncited by 5
- 2025Neural Theorem Proving: Generating and Structuring Proofs for Formal Verificationcited by 5
- 2021A Study of Continuous Vector Representationsfor Theorem Provingcited by 4
- 2023An Ensemble Approach for Automated Theorem Proving Based on Efficient Name Invariant Graph Neural Representationscited by 4
- 2021Graph Contrastive Pre-training for Effective Theorem Reasoningcited by 3
- 2023Lemmas: Generation, Selection, Applicationcited by 3
- 2024Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventionscited by 3
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structurecited by 3
- 2024Learning Structure-Aware Representations of Dependent Typescited by 2
- 2024BAIT: Benchmarking (Embedding) Architectures for Interactive Theorem-Provingcited by 2
- 2022Exploring Representation of Horn Clauses using GNNs (Extended Technical Report)cited by 1
- 2022Learning to Prove Trigonometric Identitiescited by 1
- 2022Neural Controller Synthesis for Signal Temporal Logic Specifications Using Encoder-Decoder Structured Networkscited by 1
- 2024Learning Better Representations From Less Data For Propositional Satisfiabilitycited by 1
- 2024Guiding Word Equation Solving using Graph Neural Networks (Extended Technical Report)cited by 1
- 2025Hierarchical Attention Generates Better Proofscited by 1
- 2025Foundation of Intelligence: Review of Math Word Problems from Human Cognition Perspectivecited by 1
- 2026MathCoPilot: An Interactive System for Human-AI Symbiotic Paradigm of Mathematical Researchcited by 1
- 2021Learning Heuristics for Template-based CEGIS of Loop Invariants with Reinforcement Learningcited by 0
- 2023Safety without alignmentcited by 0
- 2024EvoGPT-f: An Evolutionary GPT Framework for Benchmarking Formal Math Languagescited by 0
- 2025When GNNs Met a Word Equations Solver: Learning to Rank Equations (Extended Technical Report)cited by 0
- 2025Partial Label Learning for Automated Theorem Provingcited by 0
- 2026Automated Proving of Shannon-Type Entropy Inequalities via Fine-Tuned Language Models and Guided Tree Searchcited by 0
- 2026When Does Structured Knowledge Help Neural Theorem Proving?cited by 0
- 2026When Does Structured Knowledge Help Neural Theorem Proving?28 Sep 2026
- 2026MathCoPilot: An Interactive System for Human-AI Symbiotic Paradigm of Mathematical Research16 Jul 2026
- 2026Automated Proving of Shannon-Type Entropy Inequalities via Fine-Tuned Language Models and Guided Tree Search4 Jun 2026
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structure28 May 2026
- 2025Foundation of Intelligence: Review of Math Word Problems from Human Cognition Perspective24 Oct 2025
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflection21 Jul 2025
- 2025Partial Label Learning for Automated Theorem Proving4 Jul 2025
- 2025When GNNs Met a Word Equations Solver: Learning to Rank Equations (Extended Technical Report)30 Jun 2025
- 2025MPS-Prover: Advancing Stepwise Theorem Proving by Multi-Perspective Search and Data Curation16 May 2025
- 2025Hierarchical Attention Generates Better Proofs27 Apr 2025
- 2025Neural Theorem Proving: Generating and Structuring Proofs for Formal Verification23 Apr 2025
- 2025ProofAug: Efficient Neural Theorem Proving via Fine-grained Proof Structure Analysis30 Jan 2025
32 more
- 2024Guiding Word Equation Solving using Graph Neural Networks (Extended Technical Report)19 Nov 2024
- 2024ATG: Benchmarking Automated Theorem Generation for Generative Language Models5 May 2024
- 2024Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventions29 Apr 2024
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Lean18 Apr 2024
- 2024A Survey on Deep Learning for Theorem Proving15 Apr 2024
- 2024Learn from Failure: Fine-Tuning LLMs with Trial-and-Error Data for Intuitionistic Propositional Logic Proving10 Apr 2024
- 2024Learning Guided Automated Reasoning: A Brief Survey6 Mar 2024
- 2024BAIT: Benchmarking (Embedding) Architectures for Interactive Theorem-Proving6 Mar 2024
- 2024Premise Order Matters in Reasoning with Large Language Models14 Feb 2024
- 2024Learning Better Representations From Less Data For Propositional Satisfiability13 Feb 2024
- 2024EvoGPT-f: An Evolutionary GPT Framework for Benchmarking Formal Math Languages12 Feb 2024
- 2024Learning Structure-Aware Representations of Dependent Types3 Feb 2024
- 2023An Ensemble Approach for Automated Theorem Proving Based on Efficient Name Invariant Graph Neural Representations15 May 2023
- 2023Lemmas: Generation, Selection, Application10 Mar 2023
- 2023Magnushammer: A Transformer-Based Approach to Premise Selection8 Mar 2023
- 2023CoProver: A Recommender System for Proof Construction1 Mar 2023
- 2023Safety without alignment27 Feb 2023
- 2022Neural Controller Synthesis for Signal Temporal Logic Specifications Using Encoder-Decoder Structured Networks10 Dec 2022
- 2022Learning to Prove Trigonometric Identities14 Jul 2022
- 2022Exploring Representation of Horn Clauses using GNNs (Extended Technical Report)14 Jun 2022
- 2022A Survey in Mathematical Language Processing30 May 2022
- 2022Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Provers22 May 2022
- 2022Formal Mathematics Statement Curriculum Learning3 Feb 2022
- 2021Graph Contrastive Pre-training for Effective Theorem Reasoning24 Aug 2021
- 2021Learning Heuristics for Template-based CEGIS of Loop Invariants with Reinforcement Learning16 Jul 2021
- 2021Learning to Guide a Saturation-Based Theorem Prover7 Jun 2021
- 2021SyGNS: A Systematic Generalization Testbed Based on Natural Language Semantics2 Jun 2021
- 2021TacticZero: Learning to Prove Theorems from Scratch with Deep Reinforcement Learning19 Feb 2021
- 2021Vampire With a Brain Is a Good ITP Hammer6 Feb 2021
- 2021Embedding Symbolic Temporal Knowledge into Deep Sequential Models28 Jan 2021
- 2021A Study of Continuous Vector Representationsfor Theorem Proving22 Jan 2021
- 2021LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning15 Jan 2021
- 2024Premise Order Matters in Reasoning with Large Language Modelscited by 72
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflectioncited by 35
- 2024Learning Guided Automated Reasoning: A Brief Surveycited by 7
- 2024Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventionscited by 3
- 2025Solving Formal Math Problems by Decomposition and Iterative Reflection21 Jul 2025
- 2024Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventions29 Apr 2024
- 2024Learning Guided Automated Reasoning: A Brief Survey6 Mar 2024
- 2024Premise Order Matters in Reasoning with Large Language Models14 Feb 2024
- 2022Formal Mathematics Statement Curriculum Learningcited by 142
- 2022Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Proverscited by 98
- 2024Lean Copilot: Large Language Models as Copilots for Theorem Proving in Leancited by 58
- 2024A Survey on Deep Learning for Theorem Provingcited by 57
- 2023Magnushammer: A Transformer-Based Approach to Premise Selectioncited by 50
- 2021LIME: Learning Inductive Bias for Primitives of Mathematical Reasoningcited by 46
- 2021TacticZero: Learning to Prove Theorems from Scratch with Deep Reinforcement Learningcited by 37
- 2021Learning to Guide a Saturation-Based Theorem Provercited by 15
- 2024Learn from Failure: Fine-Tuning LLMs with Trial-and-Error Data for Intuitionistic Propositional Logic Provingcited by 11
- 2025ProofAug: Efficient Neural Theorem Proving via Fine-grained Proof Structure Analysiscited by 11
- 2021Vampire With a Brain Is a Good ITP Hammercited by 10
- 2025MPS-Prover: Advancing Stepwise Theorem Proving by Multi-Perspective Search and Data Curationcited by 10
12 most cited of 39 All 39 (JSON)
- 2026When Does Structured Knowledge Help Neural Theorem Proving?28 Sep 2026
- 2026MathCoPilot: An Interactive System for Human-AI Symbiotic Paradigm of Mathematical Research16 Jul 2026
- 2026Automated Proving of Shannon-Type Entropy Inequalities via Fine-Tuned Language Models and Guided Tree Search4 Jun 2026
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structure28 May 2026
- 2025Foundation of Intelligence: Review of Math Word Problems from Human Cognition Perspective24 Oct 2025
- 2025Partial Label Learning for Automated Theorem Proving4 Jul 2025
- 2025When GNNs Met a Word Equations Solver: Learning to Rank Equations (Extended Technical Report)30 Jun 2025
- 2025MPS-Prover: Advancing Stepwise Theorem Proving by Multi-Perspective Search and Data Curation16 May 2025
- 2025Hierarchical Attention Generates Better Proofs27 Apr 2025
- 2025Neural Theorem Proving: Generating and Structuring Proofs for Formal Verification23 Apr 2025
- 2025ProofAug: Efficient Neural Theorem Proving via Fine-grained Proof Structure Analysis30 Jan 2025
- 2024Guiding Word Equation Solving using Graph Neural Networks (Extended Technical Report)19 Nov 2024
12 newest of 39 All 39 (JSON)