Neural Methods for Logical Reasoning Over Knowledge Graphs
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Reasoning is a fundamental problem for computers and deeply studied in Artificial Intelligence. In this paper, we specifically focus on answering multi-hop logical queries on Knowledge Graphs (KGs). This is a complicated task because, in real-world scenarios, the graphs tend to be large and incomplete. Most previous works have been unable to create models that accept full First-Order Logical (FOL) queries, which include negative queries, and have only been able to process a limited set of query structures. Additionally, most methods present logic operators that can only perform the logical operation they are made for. We introduce a set of models that use Neural Networks to create one-point vector embeddings to answer the queries. The versatility of neural networks allows the framework to handle FOL queries with Conjunction (wedge), Disjunction (vee) and Negation (neg) operators. We demonstrate experimentally the performance of our model through extensive experimentation on well-known benchmarking datasets. Besides having more versatile operators, the models achieve a 10% relative increase over the best performing state of the art and more than 30% over the original method based on single-point vector embeddings.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 15 of its 27 references that are in the map. First posted on arXiv 28 Sep 2022.
Builds on
15 of 27 references.
References · 15
- 2017Attention Is All You Needcited by 59,932
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
- 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
- 2020Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddingscited by 169
- 2020Beta Embeddings for Multi-Hop Logical Reasoning in Knowledge Graphscited by 128
- 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
- 2018Embedding Logical Queries on Knowledge Graphscited by 120
- 2019Probabilistic Logic Neural Networks for Reasoningcited by 69
- 2020Heterogeneous Hypergraph Embedding for Graph Classificationcited by 52
- 2015Traversing Knowledge Graphs in Vector Spacecited by 51
- 2020Neural Logic Reasoningcited by 38
3 more
- 2016Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networkscited by 37
- 2018Variational Knowledge Graph Reasoningcited by 27
- 2019Neural Logic Networkscited by 7
Built on by
Citing papers per year: 2022: 2; 2023: 8; 2024: 5; 2025: 2.
17 papers.
Sort:
By area:
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
- 2023Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databasescited by 35
- 2023Logical Message Passing Networks with One-hop Inference on Atomic Formulascited by 28
- 2022Inductive Logical Query Answering in Knowledge Graphscited by 25
- 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraintscited by 21
- 2023Wasserstein-Fisher-Rao Embedding: Logical Query Embeddings with Local Comparison and Global Transportcited by 16
- 2023Sequential Query Encoding For Complex Query Answering on Knowledge Graphscited by 13
- 2024A Foundation Model for Zero-shot Logical Query Reasoningcited by 13
- 2023Knowledge Graph Reasoning over Entities and Numerical Valuescited by 11
- 2022KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understandingcited by 9
- 2024Applications of Generative AI (GAI) for Mobile and Wireless Networking: A Surveycited by 9
- 2025A Smooth Transition Between Induction and Deduction: Fast Abductive Learning Based on Probabilistic Symbol Perceptioncited by 3
5 more
- 2023Neuro-Symbolic Recommendation Model based on Logic Querycited by 2
- 2024Extending Complex Logical Queries on Uncertain Knowledge Graphscited by 2
- 2024Meta Operator for Complex Query Answering on Knowledge Graphscited by 2
- 2024Pathformer: Recursive Path Query Encoding for Complex Logical Query Answeringcited by 1
- 2025Efficient and Scalable Neural Symbolic Search for Knowledge Graph Complex Query Answeringcited by 1
- 2025Efficient and Scalable Neural Symbolic Search for Knowledge Graph Complex Query Answering13 May 2025
- 2025A Smooth Transition Between Induction and Deduction: Fast Abductive Learning Based on Probabilistic Symbol Perception18 Feb 2025
- 2024Pathformer: Recursive Path Query Encoding for Complex Logical Query Answering21 Jun 2024
- 2024Applications of Generative AI (GAI) for Mobile and Wireless Networking: A Survey30 May 2024
- 2024A Foundation Model for Zero-shot Logical Query Reasoning10 Apr 2024
- 2024Meta Operator for Complex Query Answering on Knowledge Graphs15 Mar 2024
- 2024Extending Complex Logical Queries on Uncertain Knowledge Graphs3 Mar 2024
- 2023Neuro-Symbolic Recommendation Model based on Logic Query14 Sep 2023
- 2023Knowledge Graph Reasoning over Entities and Numerical Values2 Jun 2023
- 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraints30 May 2023
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge14 May 2023
- 2023Wasserstein-Fisher-Rao Embedding: Logical Query Embeddings with Local Comparison and Global Transport6 May 2023
5 more
- 2023Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databases26 Mar 2023
- 2023Sequential Query Encoding For Complex Query Answering on Knowledge Graphs25 Feb 2023
- 2023Logical Message Passing Networks with One-hop Inference on Atomic Formulas21 Jan 2023
- 2022Inductive Logical Query Answering in Knowledge Graphs13 Oct 2022
- 2022KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understanding8 Oct 2022
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
- 2023Logical Message Passing Networks with One-hop Inference on Atomic Formulascited by 28
- 2022Inductive Logical Query Answering in Knowledge Graphscited by 25
- 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraintscited by 21
- 2023Wasserstein-Fisher-Rao Embedding: Logical Query Embeddings with Local Comparison and Global Transportcited by 16
- 2023Sequential Query Encoding For Complex Query Answering on Knowledge Graphscited by 13
- 2024A Foundation Model for Zero-shot Logical Query Reasoningcited by 13
- 2023Knowledge Graph Reasoning over Entities and Numerical Valuescited by 11
- 2022KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understandingcited by 9
- 2024Applications of Generative AI (GAI) for Mobile and Wireless Networking: A Surveycited by 9
- 2023Neuro-Symbolic Recommendation Model based on Logic Querycited by 2
- 2024Extending Complex Logical Queries on Uncertain Knowledge Graphscited by 2
12 most cited of 15 All 15 (JSON)
- 2025Efficient and Scalable Neural Symbolic Search for Knowledge Graph Complex Query Answering13 May 2025
- 2024Pathformer: Recursive Path Query Encoding for Complex Logical Query Answering21 Jun 2024
- 2024Applications of Generative AI (GAI) for Mobile and Wireless Networking: A Survey30 May 2024
- 2024A Foundation Model for Zero-shot Logical Query Reasoning10 Apr 2024
- 2024Meta Operator for Complex Query Answering on Knowledge Graphs15 Mar 2024
- 2024Extending Complex Logical Queries on Uncertain Knowledge Graphs3 Mar 2024
- 2023Neuro-Symbolic Recommendation Model based on Logic Query14 Sep 2023
- 2023Knowledge Graph Reasoning over Entities and Numerical Values2 Jun 2023
- 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraints30 May 2023
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge14 May 2023
- 2023Wasserstein-Fisher-Rao Embedding: Logical Query Embeddings with Local Comparison and Global Transport6 May 2023
- 2023Sequential Query Encoding For Complex Query Answering on Knowledge Graphs25 Feb 2023
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning
- 2022Neural-Symbolic Models for Logical Queries on Knowledge Graphs
- 2023Rethinking Complex Queries on Knowledge Graphs with Neural Link Predictors
- 2025A Large Language Model Based Method for Complex Logical Reasoning over Knowledge Graphs
- 2025Fully Geometric Multi-Hop Reasoning on Knowledge Graphs with Transitive Relations
- 2022GammaE: Gamma Embeddings for Logical Queries on Knowledge Graphs
- 2023Query Structure Modeling for Inductive Logical Reasoning Over Knowledge Graphs
- 2024Efficient Parallel Multi-Hop Reasoning: A Scalable Approach for Knowledge Graph Analysis