mlsanityData to 7 Oct 2026

Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databases

arXiv 2303.14617 ↗First posted 26 Mar 2023cs.DB cs.AI cs.LGcited by 35

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Complex logical query answering (CLQA) is a recently emerged task of graph machine learning that goes beyond simple one-hop link prediction and solves a far more complex task of multi-hop logical reasoning over massive, potentially incomplete graphs in a latent space. The task received a significant traction in the community; numerous works expanded the field along theoretical and practical axes to tackle different types of complex queries and graph modalities with efficient systems. In this paper, we provide a holistic survey of CLQA with a detailed taxonomy studying the field from multiple angles, including graph types (modality, reasoning domain, background semantics), modeling aspects (encoder, processor, decoder), supported queries (operators, patterns, projected variables), datasets, evaluation metrics, and applications. Refining the CLQA task, we introduce the concept of Neural Graph Databases (NGDBs). Extending the idea of graph databases (graph DBs), NGDB consists of a Neural Graph Storage and a Neural Graph Engine. Inside Neural Graph Storage, we design a graph store, a feature store, and further embed information in a latent embedding store using an encoder. Given a query, Neural Query Engine learns how to perform query planning and execution in order to efficiently retrieve the correct results by interacting with the Neural Graph Storage. Compared with traditional graph DBs, NGDBs allow for a flexible and unified modeling of features in diverse modalities using the embedding store. Moreover, when the graph is incomplete, they can provide robust retrieval of answers which a normal graph DB cannot recover. Finally, we point out promising directions, unsolved problems and applications of NGDB for future research.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 102 of its 171 references that are in the map. First posted on arXiv 26 Mar 2023.

Builds on

102 of 171 references.

Closest ancestors · 7

Same direction, newest first

  1. 2022Weisfeiler and Leman Go Relational30 Nov
  2. 2022NQE: N-ary Query Embedding for Complex Query Answering over Hyper-Relational Knowledge Graphs24 Nov
  3. 2022GammaE: Gamma Embeddings for Logical Queries on Knowledge Graphs27 Oct
  4. 2022Neural Methods for Logical Reasoning Over Knowledge Graphs28 Sep
  5. 2022TFLEX: Temporal Feature-Logic Embedding Framework for Complex Reasoning over Temporal Knowledge Graph28 May
  6. 2022Neural-Symbolic Models for Logical Queries on Knowledge Graphs16 May
  7. 2022Type-aware Embeddings for Multi-Hop Reasoning over Knowledge Graphs2 May

Other references · 95

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2017Graph Attention Networkscited by 8,854
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  7. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  8. 2018How Powerful are Graph Neural Networks?cited by 4,355
  9. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  10. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  11. 2017Billion-scale similarity search with GPUscited by 2,477
  12. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
38 more
  1. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  2. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  3. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
  4. 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
  5. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  6. 2017Deep Setscited by 1,394
  7. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  8. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
  9. 2017Neural Collaborative Filteringcited by 1,108
  10. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  11. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  12. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  13. 2016Complex Embeddings for Simple Link Predictioncited by 897
  14. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
  15. 2020Knowledge Graphscited by 619
  16. 2023Augmented Language Models: a Surveycited by 398
  17. 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 395
  18. 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
  19. 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
  20. 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
  21. 2022Reasoning with Language Model Prompting: A Surveycited by 251
  22. 2019Inductive Relation Prediction by Subgraph Reasoningcited by 237
  23. 2020Logic Tensor Networkscited by 197
  24. 2020Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddingscited by 169
  25. 2020Machine Learning on Graphs: A Model and Comprehensive Taxonomycited by 156
  26. 2018Canonical Tensor Decomposition for Knowledge Base Completioncited by 150
  27. 2020Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation Learningcited by 148
  28. 2019Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answeringcited by 147
  29. 2020Beta Embeddings for Multi-Hop Logical Reasoning in Knowledge Graphscited by 128
  30. 2018Embedding Logical Queries on Knowledge Graphscited by 120
  31. 2020From Local Structures to Size Generalization in Graph Neural Networkscited by 119
  32. 2020RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphscited by 117
  33. 2022Prompting Is Programming: A Query Language for Large Language Modelscited by 110
  34. 2018Multi-Hop Knowledge Graph Reasoning with Reward Shapingcited by 102
  35. 2020Analyzing Differentiable Fuzzy Logic Operatorscited by 100
  36. 2020Complex Query Answering with Neural Link Predictorscited by 98
  37. 2022Compositional Semantic Parsing with Large Language Modelscited by 95
  38. 2020Message Passing for Hyper-Relational Knowledge Graphscited by 78

50 most cited of 95 All 95 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 8; 2024: 14; 2025: 7; 2026: 6.

35 papers.

Sort:

By area:

  1. 2023Complex Query Answering on Eventuality Knowledge Graph with Implicit Logical Constraintscited by 21
  2. 2023Wasserstein-Fisher-Rao Embedding: Logical Query Embeddings with Local Comparison and Global Transportcited by 16
  3. 2024Can LLMs Evaluate Complex Attribution in QA? Automatic Benchmarking using Knowledge Graphscited by 16
  4. 2024A Foundation Model for Zero-shot Logical Query Reasoningcited by 13
  5. 2025Top Ten Challenges Towards Agentic Neural Graph Databasescited by 13
  6. 2023Rethinking Complex Queries on Knowledge Graphs with Neural Link Predictorscited by 12
  7. 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operationcited by 12
  8. 2023HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformerscited by 10
  9. 2024Is Complex Query Answering Really Complex?cited by 7
  10. 2024Intention Knowledge Graph Construction for User Intention Relation Modelingcited by 6
  11. 2025Enhancing Transformers for Generalizable First-Order Logical Entailmentcited by 6
  12. 2023A Neuro-Symbolic Framework for Answering Graph Pattern Queries in Knowledge Graphscited by 4
23 more
  1. 2024Learning Federated Neural Graph Databases for Answering Complex Queries from Distributed Knowledge Graphscited by 4
  2. 2024Demystifying Higher-Order Graph Neural Networkscited by 4
  3. 2024Adaptive Stochastic Weight Averagingcited by 4
  4. 2025The Discovery Engine: A Framework for AI-Driven Synthesis and Navigation of Scientific Knowledge Landscapescited by 4
  5. 2023IntelliGraphs: Datasets for Benchmarking Knowledge Graph Generationcited by 3
  6. 2024Extending Complex Logical Queries on Uncertain Knowledge Graphscited by 2
  7. 2024RConE: Rough Cone Embedding for Multi-Hop Logical Query Answering on Multi-Modal Knowledge Graphscited by 2
  8. 2025Transformers for Complex Query Answering over Knowledge Hypergraphscited by 2
  9. 2026NGDB-Zoo: Towards Efficient and Scalable Neural Graph Databases Trainingcited by 2
  10. 2026KGPFN: Unlocking the Potential of Knowledge Graph Foundation Model via In-Context Learningcited by 2
  11. 2024Pathformer: Recursive Path Query Encoding for Complex Logical Query Answeringcited by 1
  12. 2024Complex Logical Query Answering by Calibrating Knowledge Graph Completion Modelscited by 1
  13. 2024Learning Representations for Reasoning: Generalizing Across Diverse Structurescited by 1
  14. 2025Efficient and Scalable Neural Symbolic Search for Knowledge Graph Complex Query Answeringcited by 1
  15. 2023Approximate Answering of Graph Queriescited by 0
  16. 2024Efficient Parallel Multi-Hop Reasoning: A Scalable Approach for Knowledge Graph Analysiscited by 0
  17. 2024Graph Neural Networks on Graph Databasescited by 0
  18. 2025MPRM: A Markov Path-based Rule Miner for Efficient and Interpretable Knowledge Graph Reasoningcited by 0
  19. 2025CQD-SHAP: Explainable Complex Query Answering via Shapley Valuescited by 0
  20. 2026HEHRGNN: A Unified Embedding Model for Knowledge Graphs with Hyperedges and Hyper-Relational Edgescited by 0
  21. 2026NGDBench: Towards Neural Graph Data Managementcited by 0
  22. 2026Neural Scalable Symbolic Search Framework for Complex Logical Queries with Multiple Free Variablescited by 0
  23. 2026InductWave: Inductive Multi-Hop Logical Query Answering on Knowledge Graphscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025KGCompiler: Deep Learning Compilation Optimization for Knowledge Graph Complex Logical Query Answering
  2. 2024Conditional Logical Message Passing Transformer for Complex Query Answering
  3. 2024Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning
  4. 2023Complex Logical Reasoning over Knowledge Graphs using Large Language Models
  5. 2024GraphOTTER: Evolving LLM-based Graph Reasoning for Complex Table Question Answering
  6. 2023Query Structure Modeling for Inductive Logical Reasoning Over Knowledge Graphs
  7. 2025A Large Language Model Based Method for Complex Logical Reasoning over Knowledge Graphs
  8. 2025Fully Geometric Multi-Hop Reasoning on Knowledge Graphs with Transitive Relations