Learning Guided Automated Reasoning: A Brief Survey
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
Automated theorem provers and formal proof assistants are general reasoning systems that are in theory capable of proving arbitrarily hard theorems, thus solving arbitrary problems reducible to mathematics and logical reasoning. In practice, such systems however face large combinatorial explosion, and therefore include many heuristics and choice points that considerably influence their performance. This is an opportunity for trained machine learning predictors, which can guide the work of such reasoning systems. Conversely, deductive search supported by the notion of logically valid proof allows one to train machine learning systems on large reasoning corpora. Such bodies of proof are usually correct by construction and when combined with more and more precise trained guidance they can be boostrapped into very large corpora, with increasingly long reasoning chains and possibly novel proof ideas. In this paper we provide an overview of several automated reasoning and theorem proving domains and the learning and AI methods that have been so far developed for them. These include premise selection, proof guidance in several settings, AI systems and feedback loops iterating between reasoning and learning, and symbolic classification problems.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 56 of its 163 references that are in the map. First posted on arXiv 6 Mar 2024.
Builds on
56 of 163 references.
References · 56
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 515
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2019Neural Probabilistic Logic Programming in DeepProbLogcited by 389
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
- 2017Learning Explanatory Rules from Noisy Datacited by 210
- 2018Learning a SAT Solver from Single-Bit Supervisioncited by 198
- 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
- 2019Learning to Prove Theorems via Interacting with Proof Assistantscited by 107
- 2020Inductive logic programming at 30: a new introductioncited by 83
- 2016DeepMath - Deep Sequence Models for Premise Selectioncited by 80
38 more
- 2018Reinforcement Learning of Theorem Provingcited by 69
- 2018First Experiments with Neural Translation of Informal to Formal Mathematicscited by 52
- 2018GamePad: A Learning Environment for Theorem Provingcited by 48
- 2017Deep Network Guided Proof Searchcited by 47
- 2017Premise Selection for Theorem Proving by Deep Graph Embeddingcited by 44
- 2018TacticToe: Learning to Prove with Tacticscited by 43
- 2019Generating Correctness Proofs with Neural Networkscited by 36
- 2017ENIGMA: Efficient Learning-based Inference Guiding Machinecited by 26
- 2020ENIGMA Anonymous: Symbol-Independent Inference Guiding Machine (system description)cited by 26
- 2020First Neural Conjecturing Datasets and Experimentscited by 26
- 2016Learning Continuous Semantic Representations of Symbolic Expressionscited by 25
- 2018Can Neural Networks Understand Logical Entailment?cited by 24
- 2019ENIGMA-NG: Efficient Neural and Gradient-Boosted Inference Guidance for Ecited by 24
- 2021Techniques for Symbol Grounding with SATNetcited by 24
- 2013MizAR 40 for Mizar 40cited by 23
- 2020The Tactician (extended version): A Seamless, Interactive Tactic Learner and Prover for Coqcited by 23
- 2021Neuro-Symbolic Hierarchical Rule Inductioncited by 23
- 2019Property Invariant Embedding for Automated Reasoningcited by 22
- 2019Hammering Mizar by Learning Clause Guidancecited by 20
- 2018Learning to Reason with HOL4 tacticscited by 14
- 2021Proving Theorems using Incremental Learning and Hindsight Experience Replaycited by 13
- 2018ATPboost: Learning Premise Selection in Binary Setting with ATP Feedbackcited by 12
- 2020Stateful Premise Selection by Recurrent Neural Networkscited by 11
- 2021Vampire With a Brain Is a Good ITP Hammercited by 10
- 2023Machine-Learned Premise Selection for Leancited by 10
- 2023Assessing SATNet's Ability to Solve the Symbol Grounding Problemcited by 10
- 2023Alien Codingcited by 9
- 2021The Role of Entropy in Guiding a Connection Provercited by 8
- 2021Fast and Slow Enigmas and Parental Guidancecited by 8
- 2014Developing Corpus-based Translation Methods between Informal and Formal Mathematics: Project Descriptioncited by 7
- 2018PaMpeR: Proof Method Recommendation System for Isabelle/HOLcited by 7
- 2021Learning Theorem Proving Componentscited by 7
- 2019Guiding Inferences in Connection Tableau by Recurrent Neural Networkscited by 6
- 2023MizAR 60 for Mizar 50cited by 6
- 2014Learning-assisted Theorem Proving with Millions of Lemmascited by 5
- 2019ENIGMAWatch: ProofWatch Meets ENIGMAcited by 5
- 2023Graph Sequence Learning for Premise Selectioncited by 5
- 2015SEPIA: Search for Proofs Using Inferred Automatacited by 4
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 6.
7 papers.
- 2025Autoformalization in the Era of Large Language Models: A Surveycited by 19
- 2025Learning Conjecturing from Scratchcited by 3
- 2025Towards AI-assisted Neutrino Flavor Theory Designcited by 3
- 2025Neuro-Symbolic AI for Cybersecurity: State of the Art, Challenges, and Opportunitiescited by 2
- 2025Tree-Based Deep Learning for Ranking Symbolic Integration Algorithmscited by 1
- 2024Machine Learning for Quantifier Selection in cvc5cited by 0
- 2025Efficient Neural Clause-Selection Reinforcementcited by 0
- 2025Neuro-Symbolic AI for Cybersecurity: State of the Art, Challenges, and Opportunities8 Sep 2025
- 2025Tree-Based Deep Learning for Ranking Symbolic Integration Algorithms8 Aug 2025
- 2025Towards AI-assisted Neutrino Flavor Theory Design9 Jun 2025
- 2025Autoformalization in the Era of Large Language Models: A Survey29 May 2025
- 2025Efficient Neural Clause-Selection Reinforcement10 Mar 2025
- 2025Learning Conjecturing from Scratch3 Mar 2025
- 2024Machine Learning for Quantifier Selection in cvc526 Aug 2024
Similar, not cited
Close in wording, no citation either way
- 2026Self-Supervised Theorem Discovery in a Formal Axiomatic System
- 2025MSC-180: A Benchmark for Automated Formal Theorem Proving from Mathematical Subject Classification
- 2025Spark-Prover-X1: Formal Theorem Proving Through Diverse Data Training
- 2026Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery
- 2025APOLLO: Automated LLM and Lean Collaboration for Advanced Formal Reasoning
- 2024Formal Theorem Proving by Rewarding LLMs to Decompose Proofs Hierarchically
- 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofs
- 2025Towards Solving More Challenging IMO Problems via Decoupled Reasoning and Proving