Context-Driven Knowledge Graph Completion with Semantic-Aware Relational Message Passing
Not on the map. Why?
Abstract (arXiv)
Semantic context surrounding a triplet (h, r, t) is crucial for Knowledge Graph Completion (KGC), providing vital cues for prediction. However, traditional node-based message passing mechanisms, when applied to knowledge graphs, often introduce noise and suffer from information dilution or over-smoothing by indiscriminately aggregating information from all neighboring edges. To address this challenge, we propose a semantic-aware relational message passing. A core innovation of this framework is the introduction of a semantic-aware Top-K neighbor selection strategy. Specifically, this strategy first evaluates the semantic relevance between a central node and its incident edges within a shared latent space, selecting only the Top-K most pertinent ones. Subsequently, information from these selected edges is effectively fused with the central node's own representation using a multi-head attention aggregator to generate a semantically focused node message. In this manner, our model not only leverages the structure and features of edges within the knowledge graph but also more accurately captures and propagates the contextual information most relevant to the specific link prediction task, thereby effectively mitigating interference from irrelevant information. Extensive experiments demonstrate that our method achieves superior performance compared to existing approaches on several established benchmarks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 48 references that are in the map. First posted on arXiv 29 Jun 2025.
Builds on
34 of 48 references.
References · 34
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
22 more
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2016Complex Embeddings for Simple Link Predictioncited by 902
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2020Heterogeneous Graph Transformercited by 582
- 2019Graph Transformer Networkscited by 523
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
- 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 396
- 2019Learning Deep Transformer Models for Machine Translationcited by 309
- 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 275
- 2019DRUM: End-To-End Differentiable Rule Mining On Knowledge Graphscited by 175
- 2019Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Predictioncited by 133
- 2020RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphscited by 118
- 2021Knowledge Graph Reasoning with Relational Digraphcited by 92
- 2020Relational Message Passing for Knowledge Graph Completioncited by 61
- 2022Geometry Interaction Knowledge Graph Embeddingscited by 18
- 2023Link Prediction with Attention Applied on Multiple Knowledge Graph Embedding Modelscited by 15
- 2024Logical Reasoning with Relation Network for Inductive Knowledge Graph Completioncited by 6
Built on by
Not cited yet.