Type-aware Embeddings for Multi-Hop Reasoning over Knowledge Graphs
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Multi-hop reasoning over real-life knowledge graphs (KGs) is a highly challenging problem as traditional subgraph matching methods are not capable to deal with noise and missing information. To address this problem, it has been recently introduced a promising approach based on jointly embedding logical queries and KGs into a low-dimensional space to identify answer entities. However, existing proposals ignore critical semantic knowledge inherently available in KGs, such as type information. To leverage type information, we propose a novel TypE-aware Message Passing (TEMP) model, which enhances the entity and relation representations in queries, and simultaneously improves generalization, deductive and inductive reasoning. Remarkably, TEMP is a plug-and-play model that can be easily incorporated into existing embedding-based models to improve their performance. Extensive experiments on three real-world datasets demonstrate TEMP's effectiveness.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 34 references that are in the map. First posted on arXiv 2 May 2022.
Builds on
22 of 34 references.
References · 22
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
- 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
- 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
- 2015Highway Networkscited by 257
- 2019Inductive Relation Prediction by Subgraph Reasoningcited by 237
- 2020Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddingscited by 169
- 2020Beta Embeddings for Multi-Hop Logical Reasoning in Knowledge Graphscited by 128
- 2018Embedding Logical Queries on Knowledge Graphscited by 120
- 2020Complex Query Answering with Neural Link Predictorscited by 98
- 2021ConE: Cone Embeddings for Multi-Hop Reasoning over Knowledge Graphscited by 78
- 2020Relational Message Passing for Knowledge Graph Completioncited by 61
10 more
- 2020Inductive Entity Representations from Text via Link Predictioncited by 61
- 2021Topology-Aware Correlations Between Relations for Inductive Link Prediction in Knowledge Graphscited by 47
- 2020Self-Supervised Hyperboloid Representations from Logical Queries over Knowledge Graphscited by 35
- 2021Probabilistic Entity Representation Model for Reasoning over Knowledge Graphscited by 28
- 2019Dual Co-Matching Network for Multi-choice Reading Comprehensioncited by 26
- 2016Learning Natural Language Inference using Bidirectional LSTM model and Inner-Attentioncited by 23
- 2020Connecting Embeddings for Knowledge Graph Entity Typingcited by 17
- 2021Logic Embeddings for Complex Query Answeringcited by 17
- 2021Context-aware Entity Typing in Knowledge Graphscited by 12
- 2020AutoETER: Automated Entity Type Representation for Knowledge Graph Embeddingcited by 6
Built on by
Citing papers per year: 2022: 2; 2023: 6; 2024: 5.
13 papers.
Sort:
By area:
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
- 2023Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databasescited by 35
- 2022Transformer-based Entity Typing in Knowledge Graphscited by 13
- 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operationcited by 12
- 2023Entity-Agnostic Representation Learning for Parameter-Efficient Knowledge Graph Embeddingcited by 8
- 2023HyperFormer: Enhancing Entity and Relation Interaction for Hyper-Relational Knowledge Graph Completioncited by 5
- 2023Inductive Knowledge Graph Completion with GNNs and Rules: An Analysiscited by 4
- 2023Query Structure Modeling for Inductive Logical Reasoning Over Knowledge Graphscited by 3
- 2024HyperMono: A Monotonicity-aware Approach to Hyper-Relational Knowledge Representationcited by 2
- 2024Leveraging Intra-modal and Inter-modal Interaction for Multi-Modal Entity Alignmentcited by 2
- 2024Type-based Neural Link Prediction Adapter for Complex Query Answeringcited by 0
- 2024Prompt-fused framework for Inductive Logical Query Answeringcited by 0
1 more
- 2024COTET: Cross-view Optimal Transport for Knowledge Graph Entity Typing22 May 2024
- 2024Leveraging Intra-modal and Inter-modal Interaction for Multi-Modal Entity Alignment19 Apr 2024
- 2024HyperMono: A Monotonicity-aware Approach to Hyper-Relational Knowledge Representation15 Apr 2024
- 2024Prompt-fused framework for Inductive Logical Query Answering19 Mar 2024
- 2024Type-based Neural Link Prediction Adapter for Complex Query Answering29 Jan 2024
- 2023Inductive Knowledge Graph Completion with GNNs and Rules: An Analysis14 Aug 2023
- 2023HyperFormer: Enhancing Entity and Relation Interaction for Hyper-Relational Knowledge Graph Completion12 Aug 2023
- 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operation15 Jul 2023
- 2023Query Structure Modeling for Inductive Logical Reasoning Over Knowledge Graphs23 May 2023
- 2023Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databases26 Mar 2023
- 2023Entity-Agnostic Representation Learning for Parameter-Efficient Knowledge Graph Embedding3 Feb 2023
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodal12 Dec 2022
1 more
- 2022Transformer-based Entity Typing in Knowledge Graphs20 Oct 2022
- 2023Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databasescited by 35
- 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operationcited by 12
- 2023Query Structure Modeling for Inductive Logical Reasoning Over Knowledge Graphscited by 3
- 2024Type-based Neural Link Prediction Adapter for Complex Query Answeringcited by 0
- 2024Type-based Neural Link Prediction Adapter for Complex Query Answering29 Jan 2024
- 2023EFOk-CQA: Towards Knowledge Graph Complex Query Answering beyond Set Operation15 Jul 2023
- 2023Query Structure Modeling for Inductive Logical Reasoning Over Knowledge Graphs23 May 2023
- 2023Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databases26 Mar 2023
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
- 2022Transformer-based Entity Typing in Knowledge Graphscited by 13
- 2023Entity-Agnostic Representation Learning for Parameter-Efficient Knowledge Graph Embeddingcited by 8
- 2023HyperFormer: Enhancing Entity and Relation Interaction for Hyper-Relational Knowledge Graph Completioncited by 5
- 2023Inductive Knowledge Graph Completion with GNNs and Rules: An Analysiscited by 4
- 2024HyperMono: A Monotonicity-aware Approach to Hyper-Relational Knowledge Representationcited by 2
- 2024Leveraging Intra-modal and Inter-modal Interaction for Multi-Modal Entity Alignmentcited by 2
- 2024Prompt-fused framework for Inductive Logical Query Answeringcited by 0
- 2024COTET: Cross-view Optimal Transport for Knowledge Graph Entity Typingcited by 0
- 2024COTET: Cross-view Optimal Transport for Knowledge Graph Entity Typing22 May 2024
- 2024Leveraging Intra-modal and Inter-modal Interaction for Multi-Modal Entity Alignment19 Apr 2024
- 2024HyperMono: A Monotonicity-aware Approach to Hyper-Relational Knowledge Representation15 Apr 2024
- 2024Prompt-fused framework for Inductive Logical Query Answering19 Mar 2024
- 2023Inductive Knowledge Graph Completion with GNNs and Rules: An Analysis14 Aug 2023
- 2023HyperFormer: Enhancing Entity and Relation Interaction for Hyper-Relational Knowledge Graph Completion12 Aug 2023
- 2023Entity-Agnostic Representation Learning for Parameter-Efficient Knowledge Graph Embedding3 Feb 2023
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodal12 Dec 2022
- 2022Transformer-based Entity Typing in Knowledge Graphs20 Oct 2022
Similar, not cited
Close in wording, no citation either way
- 2026Multi-hop Reasoning and Retrieval in Embedding Space: Leveraging Large Language Models with Knowledge
- 2024Efficient Parallel Multi-Hop Reasoning: A Scalable Approach for Knowledge Graph Analysis
- 2024Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning
- 2022GammaE: Gamma Embeddings for Logical Queries on Knowledge Graphs
- 2025KG-o1: Enhancing Multi-hop Question Answering in Large Language Models via Knowledge Graph Integration
- 2025A Large Language Model Based Method for Complex Logical Reasoning over Knowledge Graphs
- 2025Efficient Multi-Hop Question Answering over Knowledge Graphs via LLM Planning and Embedding-Guided Search
- 2025Think Parallax: Solving Multi-Hop Problems via Multi-View Knowledge-Graph-Based Retrieval-Augmented Generation