mlsanityData to 7 Oct 2026

Learning Guided Automated Reasoning: A Brief Survey

arXiv 2403.04017 ↗First posted 6 Mar 2024cs.AI cs.LG cs.LOcited by 7

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

Automated theorem provers and formal proof assistants are general reasoning systems that are in theory capable of proving arbitrarily hard theorems, thus solving arbitrary problems reducible to mathematics and logical reasoning. In practice, such systems however face large combinatorial explosion, and therefore include many heuristics and choice points that considerably influence their performance. This is an opportunity for trained machine learning predictors, which can guide the work of such reasoning systems. Conversely, deductive search supported by the notion of logically valid proof allows one to train machine learning systems on large reasoning corpora. Such bodies of proof are usually correct by construction and when combined with more and more precise trained guidance they can be boostrapped into very large corpora, with increasingly long reasoning chains and possibly novel proof ideas. In this paper we provide an overview of several automated reasoning and theorem proving domains and the learning and AI methods that have been so far developed for them. These include premise selection, proof guidance in several settings, AI systems and feedback loops iterating between reasoning and learning, and symbolic classification problems.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 56 of its 163 references that are in the map. First posted on arXiv 6 Mar 2024.

Builds on

56 of 163 references.

References · 56

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  3. 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 515
  4. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
  5. 2019Neural Probabilistic Logic Programming in DeepProbLogcited by 389
  6. 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
  7. 2017Learning Explanatory Rules from Noisy Datacited by 210
  8. 2018Learning a SAT Solver from Single-Bit Supervisioncited by 198
  9. 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
  10. 2019Learning to Prove Theorems via Interacting with Proof Assistantscited by 107
  11. 2020Inductive logic programming at 30: a new introductioncited by 83
  12. 2016DeepMath - Deep Sequence Models for Premise Selectioncited by 80
38 more
  1. 2018Reinforcement Learning of Theorem Provingcited by 69
  2. 2018First Experiments with Neural Translation of Informal to Formal Mathematicscited by 52
  3. 2018GamePad: A Learning Environment for Theorem Provingcited by 48
  4. 2017Deep Network Guided Proof Searchcited by 47
  5. 2017Premise Selection for Theorem Proving by Deep Graph Embeddingcited by 44
  6. 2018TacticToe: Learning to Prove with Tacticscited by 43
  7. 2019Generating Correctness Proofs with Neural Networkscited by 36
  8. 2017ENIGMA: Efficient Learning-based Inference Guiding Machinecited by 26
  9. 2020ENIGMA Anonymous: Symbol-Independent Inference Guiding Machine (system description)cited by 26
  10. 2020First Neural Conjecturing Datasets and Experimentscited by 26
  11. 2016Learning Continuous Semantic Representations of Symbolic Expressionscited by 25
  12. 2018Can Neural Networks Understand Logical Entailment?cited by 24
  13. 2019ENIGMA-NG: Efficient Neural and Gradient-Boosted Inference Guidance for Ecited by 24
  14. 2021Techniques for Symbol Grounding with SATNetcited by 24
  15. 2013MizAR 40 for Mizar 40cited by 23
  16. 2020The Tactician (extended version): A Seamless, Interactive Tactic Learner and Prover for Coqcited by 23
  17. 2021Neuro-Symbolic Hierarchical Rule Inductioncited by 23
  18. 2019Property Invariant Embedding for Automated Reasoningcited by 22
  19. 2019Hammering Mizar by Learning Clause Guidancecited by 20
  20. 2018Learning to Reason with HOL4 tacticscited by 14
  21. 2021Proving Theorems using Incremental Learning and Hindsight Experience Replaycited by 13
  22. 2018ATPboost: Learning Premise Selection in Binary Setting with ATP Feedbackcited by 12
  23. 2020Stateful Premise Selection by Recurrent Neural Networkscited by 11
  24. 2021Vampire With a Brain Is a Good ITP Hammercited by 10
  25. 2023Machine-Learned Premise Selection for Leancited by 10
  26. 2023Assessing SATNet's Ability to Solve the Symbol Grounding Problemcited by 10
  27. 2023Alien Codingcited by 9
  28. 2021The Role of Entropy in Guiding a Connection Provercited by 8
  29. 2021Fast and Slow Enigmas and Parental Guidancecited by 8
  30. 2014Developing Corpus-based Translation Methods between Informal and Formal Mathematics: Project Descriptioncited by 7
  31. 2018PaMpeR: Proof Method Recommendation System for Isabelle/HOLcited by 7
  32. 2021Learning Theorem Proving Componentscited by 7
  33. 2019Guiding Inferences in Connection Tableau by Recurrent Neural Networkscited by 6
  34. 2023MizAR 60 for Mizar 50cited by 6
  35. 2014Learning-assisted Theorem Proving with Millions of Lemmascited by 5
  36. 2019ENIGMAWatch: ProofWatch Meets ENIGMAcited by 5
  37. 2023Graph Sequence Learning for Premise Selectioncited by 5
  38. 2015SEPIA: Search for Proofs Using Inferred Automatacited by 4

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 6.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Self-Supervised Theorem Discovery in a Formal Axiomatic System
  2. 2025MSC-180: A Benchmark for Automated Formal Theorem Proving from Mathematical Subject Classification
  3. 2025Spark-Prover-X1: Formal Theorem Proving Through Diverse Data Training
  4. 2026Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery
  5. 2025APOLLO: Automated LLM and Lean Collaboration for Advanced Formal Reasoning
  6. 2024Formal Theorem Proving by Rewarding LLMs to Decompose Proofs Hierarchically
  7. 2025Prover Agent: An Agent-Based Framework for Formal Mathematical Proofs
  8. 2025Towards Solving More Challenging IMO Problems via Decoupled Reasoning and Proving