Hierarchy-Aware Semantic Losses for Knowledge Graph Link Prediction
Not on the map. Why?
Abstract (arXiv)
Knowledge graphs are often accompanied by ontological class hierarchies that encode valuable semantic information, yet many link prediction methods either ignore such hierarchies or incorporate them indirectly through additional graph edges. Recent work introduced hierarchy-aware graph neural networks (GNNs), which use semantic losses derived from box embeddings to encourage satisfaction of subclass relationships during GNN-based representation learning. While this approach has shown promise for biological regression tasks, its effectiveness for knowledge graph link prediction has not been investigated. In this paper we evaluate hierarchy-aware semantic losses on link prediction across three benchmark datasets: AIFB, CoDEx, and BioKG. We combine graph neural network encoders with box-embedding-based semantic losses that encourage learned representations to better satisfy ontology-derived class hierarchies, and compare this approach to both standard link prediction models and models incorporating subclass relations as graph edges. Across all datasets, hierarchy-aware semantic losses significantly improve mean reciprocal rank (MRR) and consistently outperform models that incorporate hierarchy information through additional subclass edges. Relative to the baseline GNN models, MRR improved by 7.6%, 2.4%, and 15.5% on AIFB, CoDEx, and BioKG, respectively. Furthermore, semantic losses consistently outperform the alternative of augmenting the graph with subclass edges. These results are consistent with ontology-derived class hierarchies providing complementary information to graph structure, and suggest that encouraging hierarchical consistency through semantic losses is an effective and comparatively parameter-efficient mechanism for improving knowledge graph link prediction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 24 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
17 of 24 references.
References · 17
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2016Complex Embeddings for Simple Link Predictioncited by 902
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 684
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
- 2017A Semantic Loss Function for Deep Learning with Symbolic Knowledgecited by 270
- 2019Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Predictioncited by 133
- 2020CoDEx: A Comprehensive Knowledge Graph Completion Benchmarkcited by 102
- 2018Probabilistic Embedding of Knowledge Graphs with Box Lattice Measurescited by 64
5 more
- 2019EL Embeddings: Geometric construction of models for the Description Logic EL ++cited by 48
- 2022Faithiful Embeddings for EL++ Knowledge Basescited by 25
- 2023Dual Box Embeddings for the Description Logic EL++cited by 21
- 2021Box Embeddings: An open-source library for representation learning using geometric structurescited by 9
- 2026Graph Neural Network based Hierarchy-Aware Embeddings of Knowledge Graphs: Applications to Yeast Phenotype Predictioncited by 1
Built on by
Not cited yet.