mlsanityData to 7 Oct 2026

Type-aware Embeddings for Multi-Hop Reasoning over Knowledge Graphs

arXiv 2205.00782 ↗First posted 2 May 2022cs.AI cs.LGcited by 13

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Multi-hop reasoning over real-life knowledge graphs (KGs) is a highly challenging problem as traditional subgraph matching methods are not capable to deal with noise and missing information. To address this problem, it has been recently introduced a promising approach based on jointly embedding logical queries and KGs into a low-dimensional space to identify answer entities. However, existing proposals ignore critical semantic knowledge inherently available in KGs, such as type information. To leverage type information, we propose a novel TypE-aware Message Passing (TEMP) model, which enhances the entity and relation representations in queries, and simultaneously improves generalization, deductive and inductive reasoning. Remarkably, TEMP is a plug-and-play model that can be easily incorporated into existing embedding-based models to improve their performance. Extensive experiments on three real-world datasets demonstrate TEMP's effectiveness.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 34 references that are in the map. First posted on arXiv 2 May 2022.

Builds on

22 of 34 references.

References · 22

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
  3. 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
  4. 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
  5. 2015Highway Networkscited by 257
  6. 2019Inductive Relation Prediction by Subgraph Reasoningcited by 237
  7. 2020Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddingscited by 169
  8. 2020Beta Embeddings for Multi-Hop Logical Reasoning in Knowledge Graphscited by 128
  9. 2018Embedding Logical Queries on Knowledge Graphscited by 120
  10. 2020Complex Query Answering with Neural Link Predictorscited by 98
  11. 2021ConE: Cone Embeddings for Multi-Hop Reasoning over Knowledge Graphscited by 78
  12. 2020Relational Message Passing for Knowledge Graph Completioncited by 61
10 more
  1. 2020Inductive Entity Representations from Text via Link Predictioncited by 61
  2. 2021Topology-Aware Correlations Between Relations for Inductive Link Prediction in Knowledge Graphscited by 47
  3. 2020Self-Supervised Hyperboloid Representations from Logical Queries over Knowledge Graphscited by 35
  4. 2021Probabilistic Entity Representation Model for Reasoning over Knowledge Graphscited by 28
  5. 2019Dual Co-Matching Network for Multi-choice Reading Comprehensioncited by 26
  6. 2016Learning Natural Language Inference using Bidirectional LSTM model and Inner-Attentioncited by 23
  7. 2020Connecting Embeddings for Knowledge Graph Entity Typingcited by 17
  8. 2021Logic Embeddings for Complex Query Answeringcited by 17
  9. 2021Context-aware Entity Typing in Knowledge Graphscited by 12
  10. 2020AutoETER: Automated Entity Type Representation for Knowledge Graph Embeddingcited by 6

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 6; 2024: 5.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Multi-hop Reasoning and Retrieval in Embedding Space: Leveraging Large Language Models with Knowledge
  2. 2024Efficient Parallel Multi-Hop Reasoning: A Scalable Approach for Knowledge Graph Analysis
  3. 2024Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning
  4. 2022GammaE: Gamma Embeddings for Logical Queries on Knowledge Graphs
  5. 2025KG-o1: Enhancing Multi-hop Question Answering in Large Language Models via Knowledge Graph Integration
  6. 2025A Large Language Model Based Method for Complex Logical Reasoning over Knowledge Graphs
  7. 2025Efficient Multi-Hop Question Answering over Knowledge Graphs via LLM Planning and Embedding-Guided Search
  8. 2025Think Parallax: Solving Multi-Hop Problems via Multi-View Knowledge-Graph-Based Retrieval-Augmented Generation