mlsanityData to 14 Oct 2026

Relation Prediction as an Auxiliary Training Objective for Improving Multi-Relational Graph Representations

arXiv 2110.02834 ↗First posted 6 Oct 2021cs.CL cs.AIcited by 37

Not on the map. Why?

Abstract (arXiv)

Learning good representations on multi-relational graphs is essential to knowledge base completion (KBC). In this paper, we propose a new self-supervised training objective for multi-relational graph representation learning, via simply incorporating relation prediction into the commonly used 1vsAll objective. The new training objective contains not only terms for predicting the subject and object of a given triple, but also a term for predicting the relation type. We analyse how this new objective impacts multi-relational learning in KBC: experiments on a variety of datasets and models show that relation prediction can significantly improve entity ranking, the most widely used evaluation task for KBC, yielding a 6.1% increase in MRR and 9.9% increase in Hits@1 on FB15k-237 as well as a 3.1% increase in MRR and 3.4% in Hits@1 on Aristo-v4. Moreover, we observe that the proposed objective is especially effective on highly multi-relational datasets, i.e. datasets with a large number of predicates, and generates better representations when larger embedding sizes are used.

Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). Builds on 13 of its 26 references that are in the map. First posted on arXiv 6 Oct 2021.

Builds on

13 of 26 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  3. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
  4. 2016Complex Embeddings for Simple Link Predictioncited by 902
  5. 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
  6. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  7. 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
  8. 2015A Review of Relational Machine Learning for Knowledge Graphscited by 265
  9. 2018Canonical Tensor Decomposition for Knowledge Base Completioncited by 150
  10. 2019A Re-evaluation of Knowledge Graph Completion Methodscited by 73
  11. 2017Knowledge Base Completion: Baselines Strike Backcited by 39
  12. 2019Dynamically Pruned Message Passing Networks for Large-Scale Knowledge Graph Reasoningcited by 23
1 more
  1. 2020Knowledge Base Completion: Baseline strikes back (Again)cited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 11; 2023: 7; 2024: 10; 2025: 8; 2026: 1.

37 papers.

Sort:

By area:

  1. 2023Towards Foundation Models for Knowledge Graph Reasoningcited by 86
  2. 2022When Do Flat Minima Optimizers Work?cited by 78
  3. 2022A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphscited by 49
  4. 2022Answering Complex Logical Queries on Knowledge Graphs via Query Computation Tree Optimizationcited by 29
  5. 2024A Prompt-Based Knowledge Graph Foundation Model for Universal In-Context Reasoningcited by 25
  6. 2023A Multi-Task Perspective for Link Prediction with New Relation Types and Nodescited by 24
  7. 2025TRIX: A More Expressive Model for Zero-shot Domain Transfer in Knowledge Graphscited by 24
  8. 2023How to Turn Your Knowledge Graph Embeddings into Generative Modelscited by 20
  9. 2022Multi-task Pre-training Language Model for Semantic Network Completioncited by 15
  10. 2022Joint Language Semantic and Structure Embedding for Knowledge Graph Completioncited by 15
  11. 2022ReFactor GNNs: Revisiting Factorisation-based Models from a Message-Passing Perspectivecited by 12
  12. 2022TripleRE: Knowledge Graph Embeddings via Tripled Relation Vectorscited by 10
25 more
  1. 2025Flock: A Knowledge Graph Foundation Model via Learning on Random Walkscited by 9
  2. 2024AsEP: Benchmarking Deep Learning Methods for Antibody-specific Epitope Predictioncited by 8
  3. 2025SEMMA: A Semantic Aware Knowledge Graph Foundation Modelcited by 8
  4. 2022TranS: Transition-based Knowledge Graph Embedding with Synthetic Relation Representationcited by 7
  5. 2024Large Language Model Enhanced Knowledge Representation Learning: A Surveycited by 7
  6. 2022InterHT: Knowledge Graph Embeddings by Interaction between Head and Tail Entitiescited by 6
  7. 2024How Data Inter-connectivity Shapes LLMs Unlearning: A Structural Unlearning Perspectivecited by 5
  8. 2022Commonsense Knowledge Salience Evaluation with a Benchmark Dataset in E-commercecited by 4
  9. 2023Query2Triple: Unified Query Encoding for Answering Diverse Complex Queries over Knowledge Graphscited by 4
  10. 2024SnapE -- Training Snapshot Ensembles of Link Prediction Modelscited by 4
  11. 2023Knowledge Graph Embedding with 3D Compound Geometric Transformationscited by 3
  12. 2025Knowledge Graph Completion with Mixed Geometry Tensor Factorizationcited by 3
  13. 2023Relation-aware Ensemble Learning for Knowledge Graph Embeddingcited by 2
  14. 2023Self-Distillation with Meta Learning for Knowledge Graph Completioncited by 1
  15. 2024Towards Better Benchmark Datasets for Inductive Knowledge Graph Completioncited by 1
  16. 2024Complex Logical Query Answering by Calibrating Knowledge Graph Completion Modelscited by 1
  17. 2025Efficient and Scalable Neural Symbolic Search for Knowledge Graph Complex Query Answeringcited by 1
  18. 2025Geometric Structural Knowledge Graph Foundation Modelcited by 1
  19. 2026Half a Link can Be Enough to Predict a Whole Link: Understanding Generalization in Knowledge Graph Foundation Modelscited by 1
  20. 2022AutoWeird: Weird Translational Scoring Function Identified by Random Searchcited by 0
  21. 2024Type-based Neural Link Prediction Adapter for Complex Query Answeringcited by 0
  22. 2024Are We Wasting Time? A Fast, Accurate Performance Evaluation Framework for Knowledge Graph Link Predictorscited by 0
  23. 2024One Model, Any Conjunctive Query: Graph Neural Networks for Answering Queries over Incomplete Knowledge Graphscited by 0
  24. 2025RSCF: Relation-Semantics Consistent Filter for Entity Embedding of Knowledge Graphcited by 0
  25. 2025Interactive Query Answering on Knowledge Graphs with Soft Entity Constraintscited by 0