Learning Reasoning Strategies in End-to-End Differentiable Proving
Not on the map. Why?
Abstract (arXiv)
Attempts to render deep learning models interpretable, data-efficient, and robust have seen some success through hybridisation with rule-based systems, for example, in Neural Theorem Provers (NTPs). These neuro-symbolic models can induce interpretable rules and learn representations from data via back-propagation, while providing logical explanations for their predictions. However, they are restricted by their computational complexity, as they need to consider all possible proof paths for explaining a goal, thus rendering them unfit for large-scale applications. We present Conditional Theorem Provers (CTPs), an extension to NTPs that learns an optimal rule selection strategy via gradient-based optimisation. We show that CTPs are scalable and yield state-of-the-art results on the CLUTRR dataset, which tests systematic generalisation of neural models by learning to reason over smaller graphs and evaluating on larger ones. Finally, CTPs show better link prediction results on standard benchmarks in comparison with other neural-symbolic models, while being explainable. All source code and datasets are available online, at https://github.com/uclnlp/ctp.
Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 14; 2023: 17; 2024: 9; 2025: 5; 2026: 2.
60 papers.
Sort:
By area:
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2021From Statistical Relational to Neurosymbolic Artificial Intelligence: a Surveycited by 72
- 2023Large Language Models can Learn Rulescited by 66
- 2023Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyondcited by 65
- 2023Scallop: A Language for Neurosymbolic Programmingcited by 63
- 2023Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Textcited by 59
- 2021Neuro-Symbolic Artificial Intelligence: Current Trendscited by 54
- 2021Systematic Generalization with Edge Transformerscited by 38
- 2021Neuro-Symbolic Inductive Logic Programming with Logical Neural Networkscited by 36
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 34
- 2022VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programmingcited by 31
- 2021Neural Multi-Hop Reasoning With Logical Rules on Biomedical Knowledge Graphscited by 25
38 more
- 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraintscited by 21
- 2022A Survey of Trustworthy Graph Learning: Reliability, Explainability, and Privacy Protectioncited by 20
- 2023Neural Compositional Rule Learning for Knowledge Graph Reasoningcited by 20
- 2022Knowledge Graph Reasoning with Logics and Embeddings: Survey and Perspectivecited by 18
- 2023Improved Logical Reasoning of Language Models via Differentiable Symbolic Programmingcited by 18
- 2022Logical Reasoning with Span-Level Predictions for Interpretable and Robust NLI Modelscited by 17
- 2024Quantifying the Capabilities of LLMs across Scale and Precisioncited by 17
- 2021FF-NSL: Feed-Forward Neural-Symbolic Learnercited by 15
- 2024A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practicescited by 15
- 2023Sequential Query Encoding For Complex Query Answering on Knowledge Graphscited by 13
- 2023Learning Differentiable Logic Programs for Abstract Visual Reasoningcited by 12
- 2021Is Multi-Hop Reasoning Really Explainable? Towards Benchmarking Reasoning Interpretabilitycited by 10
- 2024Learning with Logical Constraints but without Shortcut Satisfactioncited by 10
- 2024DeiSAM: Segment Anything with Deictic Promptingcited by 9
- 2023Certified Deductive Reasoning with Language Modelscited by 8
- 2021Combining Rules and Embeddings via Neuro-Symbolic AI for Knowledge Base Completioncited by 7
- 2021A Critical Review of Inductive Logic Programming Techniques for Explainable AIcited by 7
- 2022R5: Rule Discovery with Reinforced and Recurrent Relational Reasoningcited by 7
- 2024Relational Programming with Foundation Modelscited by 7
- 2025PEIRCE: Unifying Material and Formal Reasoning via LLM-Driven Neuro-Symbolic Refinementcited by 7
- 2021Neural-Symbolic Commonsense Reasoner with Relation Predictorscited by 6
- 2024EXPLAIN, AGREE, LEARN: Scaling Learning for Neural Probabilistic Logiccited by 6
- 2022An Interpretable Neuro-Symbolic Reasoning Framework for Task-Oriented Dialogue Generationcited by 5
- 2024Dolphin: A Programmable Framework for Scalable Neurosymbolic Learningcited by 5
- 2021Relational Reasoning Networkscited by 4
- 2021On the Capabilities of Pointer Networks for Deep Deductive Reasoningcited by 4
- 2022Instance-based Learning for Knowledge Base Completioncited by 4
- 2024Systematic Relational Reasoning With Epistemic Graph Neural Networkscited by 4
- 2025Lobster: A GPU-Accelerated Framework for Neurosymbolic Programmingcited by 4
- 2023Knowledge-enhanced Neural Machine Reasoning: A Reviewcited by 3
- 2023Reinforcement Learning-based Knowledge Graph Reasoning for Explainable Fact-checkingcited by 3
- 2023Towards Unbiased Exploration in Partial Label Learningcited by 2
- 2023Federated Neuro-Symbolic Learningcited by 2
- 2023KGEx: Explaining Knowledge Graph Embeddings via Subgraph Sampling and Knowledge Distillationcited by 2
- 2025Large Language Model-Enhanced Symbolic Reasoning for Knowledge Base Completioncited by 2
- 2025Generalizable Reasoning through Compositional Energy Minimizationcited by 2
- 2025When No Paths Lead to Rome: Benchmarking Systematic Neural Relational Reasoningcited by 2
- 2022Neural Theorem Provers Delineating Search Area Using RNNcited by 1
50 most cited of 60 All 60 (JSON)
- 2026Project Auto-World: Towards Automated Benchmarking of Neural Relational Reasoners23 Jun 2026
- 2026Generating Graph-Like Logical Rules for Knowledge Graph Reasoning via Diffusion Models29 May 2026
- 2025When No Paths Lead to Rome: Benchmarking Systematic Neural Relational Reasoning27 Oct 2025
- 2025Generalizable Reasoning through Compositional Energy Minimization23 Oct 2025
- 2025PEIRCE: Unifying Material and Formal Reasoning via LLM-Driven Neuro-Symbolic Refinement5 Apr 2025
- 2025Lobster: A GPU-Accelerated Framework for Neurosymbolic Programming27 Mar 2025
- 2025Large Language Model-Enhanced Symbolic Reasoning for Knowledge Base Completion2 Jan 2025
- 2024Relational Programming with Foundation Models19 Dec 2024
- 2024Dolphin: A Programmable Framework for Scalable Neurosymbolic Learning4 Oct 2024
- 2024EXPLAIN, AGREE, LEARN: Scaling Learning for Neural Probabilistic Logic15 Aug 2024
- 2024Systematic Relational Reasoning With Epistemic Graph Neural Networks24 Jul 2024
- 2024A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practices13 Jun 2024
38 more
- 2024Quantifying the Capabilities of LLMs across Scale and Precision6 May 2024
- 2024AS-ES Learning: Towards Efficient CoT Learning in Small Models4 Mar 2024
- 2024Learning with Logical Constraints but without Shortcut Satisfaction1 Mar 2024
- 2024DeiSAM: Segment Anything with Deictic Prompting21 Feb 2024
- 2023Reinforcement Learning-based Knowledge Graph Reasoning for Explainable Fact-checking11 Oct 2023
- 2023Large Language Models can Learn Rules10 Oct 2023
- 2023KGEx: Explaining Knowledge Graph Embeddings via Subgraph Sampling and Knowledge Distillation2 Oct 2023
- 2023On the Aggregation of Rules for Knowledge Graph Completion1 Sep 2023
- 2023Federated Neuro-Symbolic Learning29 Aug 2023
- 2023Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text15 Jul 2023
- 2023Learning Differentiable Logic Programs for Abstract Visual Reasoning3 Jul 2023
- 2023Towards Unbiased Exploration in Partial Label Learning2 Jul 2023
- 2023Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyond16 Jun 2023
- 2023Certified Deductive Reasoning with Language Models6 Jun 2023
- 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraints30 May 2023
- 2023Improved Logical Reasoning of Language Models via Differentiable Symbolic Programming5 May 2023
- 2023Scallop: A Language for Neurosymbolic Programming10 Apr 2023
- 2023Neural Compositional Rule Learning for Knowledge Graph Reasoning7 Mar 2023
- 2023Sequential Query Encoding For Complex Query Answering on Knowledge Graphs25 Feb 2023
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity8 Feb 2023
- 2023Knowledge-enhanced Neural Machine Reasoning: A Review4 Feb 2023
- 2022A Noise-tolerant Differentiable Learning Approach for Single Occurrence Regular Expression with Interleaving1 Dec 2022
- 2022Instance-based Learning for Knowledge Base Completion13 Nov 2022
- 2022Deep Explainable Learning with Graph Based Data Assessing and Rule Reasoning9 Nov 2022
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computing28 Oct 2022
- 2022Embeddings as Epistemic States: Limitations on the Use of Pooling Operators for Accumulating Knowledge11 Oct 2022
- 2022Logical Reasoning with Span-Level Predictions for Interpretable and Robust NLI Models23 May 2022
- 2022A Survey of Trustworthy Graph Learning: Reliability, Explainability, and Privacy Protection20 May 2022
- 2022R5: Rule Discovery with Reinforced and Recurrent Relational Reasoning13 May 2022
- 2022RNNCTPs: A Neural Symbolic Reasoning Method Using Dynamic Knowledge Partitioning Technology19 Apr 2022
- 2022Differentiable Reasoning over Long Stories -- Assessing Systematic Generalisation in Neural Models20 Mar 2022
- 2022Neural Theorem Provers Delineating Search Area Using RNN14 Mar 2022
- 2022An Interpretable Neuro-Symbolic Reasoning Framework for Task-Oriented Dialogue Generation11 Mar 2022
- 2022Knowledge Graph Reasoning with Logics and Embeddings: Survey and Perspective15 Feb 2022
- 2022VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programming7 Feb 2022
- 2021A Critical Review of Inductive Logic Programming Techniques for Explainable AI31 Dec 2021
- 2021Neuro-Symbolic Inductive Logic Programming with Logical Neural Networks6 Dec 2021
- 2021Systematic Generalization with Edge Transformers1 Dec 2021
50 newest of 60 All 60 (JSON)
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2023Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyondcited by 65
- 2023Scallop: A Language for Neurosymbolic Programmingcited by 63
- 2023Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Textcited by 59
- 2022VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programmingcited by 31
- 2023Improved Logical Reasoning of Language Models via Differentiable Symbolic Programmingcited by 18
- 2022Logical Reasoning with Span-Level Predictions for Interpretable and Robust NLI Modelscited by 17
- 2023Learning Differentiable Logic Programs for Abstract Visual Reasoningcited by 12
- 2023Certified Deductive Reasoning with Language Modelscited by 8
- 2025PEIRCE: Unifying Material and Formal Reasoning via LLM-Driven Neuro-Symbolic Refinementcited by 7
- 2022An Interpretable Neuro-Symbolic Reasoning Framework for Task-Oriented Dialogue Generationcited by 5
- 2024Dolphin: A Programmable Framework for Scalable Neurosymbolic Learningcited by 5
12 most cited of 17 All 17 (JSON)
- 2026Project Auto-World: Towards Automated Benchmarking of Neural Relational Reasoners23 Jun 2026
- 2025PEIRCE: Unifying Material and Formal Reasoning via LLM-Driven Neuro-Symbolic Refinement5 Apr 2025
- 2025Lobster: A GPU-Accelerated Framework for Neurosymbolic Programming27 Mar 2025
- 2025Large Language Model-Enhanced Symbolic Reasoning for Knowledge Base Completion2 Jan 2025
- 2024Dolphin: A Programmable Framework for Scalable Neurosymbolic Learning4 Oct 2024
- 2024AS-ES Learning: Towards Efficient CoT Learning in Small Models4 Mar 2024
- 2023Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text15 Jul 2023
- 2023Learning Differentiable Logic Programs for Abstract Visual Reasoning3 Jul 2023
- 2023Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyond16 Jun 2023
- 2023Certified Deductive Reasoning with Language Models6 Jun 2023
- 2023Improved Logical Reasoning of Language Models via Differentiable Symbolic Programming5 May 2023
- 2023Scallop: A Language for Neurosymbolic Programming10 Apr 2023
12 newest of 17 All 17 (JSON)
- 2021From Statistical Relational to Neurosymbolic Artificial Intelligence: a Surveycited by 72
- 2023Large Language Models can Learn Rulescited by 66
- 2021Neuro-Symbolic Artificial Intelligence: Current Trendscited by 54
- 2021Systematic Generalization with Edge Transformerscited by 38
- 2021Neuro-Symbolic Inductive Logic Programming with Logical Neural Networkscited by 36
- 2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 34
- 2021Neural Multi-Hop Reasoning With Logical Rules on Biomedical Knowledge Graphscited by 25
- 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraintscited by 21
- 2022A Survey of Trustworthy Graph Learning: Reliability, Explainability, and Privacy Protectioncited by 20
- 2023Neural Compositional Rule Learning for Knowledge Graph Reasoningcited by 20
- 2022Knowledge Graph Reasoning with Logics and Embeddings: Survey and Perspectivecited by 18
- 2024Quantifying the Capabilities of LLMs across Scale and Precisioncited by 17
12 most cited of 43 All 43 (JSON)
- 2026Generating Graph-Like Logical Rules for Knowledge Graph Reasoning via Diffusion Models29 May 2026
- 2025When No Paths Lead to Rome: Benchmarking Systematic Neural Relational Reasoning27 Oct 2025
- 2025Generalizable Reasoning through Compositional Energy Minimization23 Oct 2025
- 2024Relational Programming with Foundation Models19 Dec 2024
- 2024EXPLAIN, AGREE, LEARN: Scaling Learning for Neural Probabilistic Logic15 Aug 2024
- 2024Systematic Relational Reasoning With Epistemic Graph Neural Networks24 Jul 2024
- 2024A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practices13 Jun 2024
- 2024Quantifying the Capabilities of LLMs across Scale and Precision6 May 2024
- 2024Learning with Logical Constraints but without Shortcut Satisfaction1 Mar 2024
- 2024DeiSAM: Segment Anything with Deictic Prompting21 Feb 2024
- 2023Reinforcement Learning-based Knowledge Graph Reasoning for Explainable Fact-checking11 Oct 2023
- 2023Large Language Models can Learn Rules10 Oct 2023
12 newest of 43 All 43 (JSON)