Multi-level Shared Knowledge Guided Learning for Knowledge Graph Completion
Not on the map. Why?
Abstract (arXiv)
In the task of Knowledge Graph Completion (KGC), the existing datasets and their inherent subtasks carry a wealth of shared knowledge that can be utilized to enhance the representation of knowledge triplets and overall performance. However, no current studies specifically address the shared knowledge within KGC. To bridge this gap, we introduce a multi-level Shared Knowledge Guided learning method (SKG) that operates at both the dataset and task levels. On the dataset level, SKG-KGC broadens the original dataset by identifying shared features within entity sets via text summarization. On the task level, for the three typical KGC subtasks - head entity prediction, relation prediction, and tail entity prediction - we present an innovative multi-task learning architecture with dynamically adjusted loss weights. This approach allows the model to focus on more challenging and underperforming tasks, effectively mitigating the imbalance of knowledge sharing among subtasks. Experimental results demonstrate that SKG-KGC outperforms existing text-based methods significantly on three well-known datasets, with the most notable improvement on WN18RR.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 8 May 2024.
Builds on
21 of 42 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2016Complex Embeddings for Simple Link Predictioncited by 902
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2017Focal Loss for Dense Object Detectioncited by 752
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
- 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
- 2022SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Modelscited by 91
- 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
9 more
- 2020Inductive Entity Representations from Text via Link Predictioncited by 62
- 2019Improving Multilingual Sentence Embedding using Bi-directional Dual Encoder with Additive Margin Softmaxcited by 58
- 2022From Discrimination to Generation: Knowledge Graph Completion with Generative Transformercited by 45
- 2023Exploring Large Language Models for Knowledge Graph Completioncited by 43
- 2023Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Promptingcited by 33
- 2022Multi-task Pre-training Language Model for Semantic Network Completioncited by 15
- 2023Link Prediction with Attention Applied on Multiple Knowledge Graph Embedding Modelscited by 15
- 2020Knowledge Base Completion: Baseline strikes back (Again)cited by 12
- 2023Unifying Structure and Language Semantic for Efficient Contrastive Knowledge Graph Completion with Structured Entity Anchorscited by 1
Built on by
Citing papers per year: 2025: 2.
2 papers.