mlsanityData to 7 Oct 2026

A Multi-Task Perspective for Link Prediction with New Relation Types and Nodes

arXiv 2307.06046 ↗First posted 12 Jul 2023cs.LG cs.AIcited by 23

Not on the map. Why?

Abstract (arXiv)

The task of inductive link prediction in (discrete) attributed multigraphs infers missing attributed links (relations) between nodes in new test multigraphs. Traditional relational learning methods face the challenge of limited generalization to test multigraphs containing both novel nodes and novel relation types not seen in training. Recently, under the only assumption that all relation types share the same structural predictive patterns (single task), Gao et al. (2023) proposed a link prediction method using the theoretical concept of double equivariance (equivariance for nodes & relation types), in contrast to the (single) equivariance (only for nodes) used to design Graph Neural Networks (GNNs). In this work we further extend the double equivariance concept to multi-task double equivariance, where we define link prediction in attributed multigraphs that can have distinct and potentially conflicting predictive patterns for different sets of relation types (multiple tasks). Our empirical results on real-world datasets demonstrate that our approach can effectively generalize to test graphs with multi-task structures without access to additional information.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 48 of its 61 references that are in the map. First posted on arXiv 12 Jul 2023.

Builds on

48 of 61 references.

References · 48

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2018How Powerful are Graph Neural Networks?cited by 4,355
  3. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  4. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  5. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  6. 2016Complex Embeddings for Simple Link Predictioncited by 897
  7. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
  8. 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
  9. 2018Link Prediction Based on Graph Neural Networkscited by 829
  10. 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
  11. 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 395
  12. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
36 more
  1. 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 273
  2. 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
  3. 2019Inductive Relation Prediction by Subgraph Reasoningcited by 237
  4. 2019Position-aware Graph Neural Networkscited by 203
  5. 2015Holographic Embeddings of Knowledge Graphscited by 181
  6. 2019DRUM: End-To-End Differentiable Rule Mining On Knowledge Graphscited by 173
  7. 2021Equivariant Subgraph Aggregation Networkscited by 154
  8. 2018Canonical Tensor Decomposition for Knowledge Base Completioncited by 150
  9. 2020Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation Learningcited by 148
  10. 2017A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Networkcited by 143
  11. 2020On Learning Sets of Symmetric Elementscited by 97
  12. 2021Knowledge Graph Reasoning with Relational Digraphcited by 91
  13. 2018One-Shot Relational Learning for Knowledge Graphscited by 78
  14. 2020Message Passing for Hyper-Relational Knowledge Graphscited by 78
  15. 2019Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphscited by 73
  16. 2021NodePiece: Compositional and Parameter-Efficient Representations of Large Knowledge Graphscited by 71
  17. 2019Few-Shot Knowledge Graph Completioncited by 63
  18. 2023InGram: Inductive Knowledge Graph Embedding via Relation Graphscited by 50
  19. 2020A Survey on Complex Question Answering over Knowledge Base: Recent Advances and Challengescited by 47
  20. 2021OntoZSL: Ontology-enhanced Zero-shot Learningcited by 45
  21. 2018Ontology Reasoning with Deep Neural Networkscited by 40
  22. 2021Relation Prediction as an Auxiliary Training Objective for Improving Multi-Relational Graph Representationscited by 37
  23. 2020Generative Adversarial Zero-Shot Relational Learning for Knowledge Graphscited by 30
  24. 2022Weisfeiler and Leman Go Relationalcited by 28
  25. 2021Improving Inductive Link Prediction Using Hyper-Relational Factscited by 21
  26. 2023Double Equivariance for Inductive Link Prediction for Both New Nodes and New Relation Typescited by 21
  27. 2022Rethinking Graph Convolutional Networks in Knowledge Graph Completioncited by 20
  28. 2022Few-shot Relational Reasoning via Connection Subgraph Pretrainingcited by 18
  29. 2020Knowledge Base Completion: Baseline strikes back (Again)cited by 12
  30. 2022ReFactor GNNs: Revisiting Factorisation-based Models from a Message-Passing Perspectivecited by 12
  31. 2022Endowing Language Models with Multimodal Knowledge Graph Representationscited by 11
  32. 2022A Hierarchical N-Gram Framework for Zero-Shot Link Predictioncited by 9
  33. 2020Knowledge Embedding Based Graph Convolutional Networkcited by 8
  34. 2021Exploring the Limits of Few-Shot Link Prediction in Knowledge Graphscited by 8
  35. 2023Understanding Expressivity of GNN in Rule Learningcited by 7
  36. 2023Causal Lifting and Link Predictioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 5; 2025: 7; 2026: 9.

23 papers.

Sort:

By area:

  1. 2023Towards Foundation Models for Knowledge Graph Reasoningcited by 83
  2. 2023Does Invariant Graph Learning via Environment Augmentation Learn Invariance?cited by 42
  3. 2024A Prompt-Based Knowledge Graph Foundation Model for Universal In-Context Reasoningcited by 25
  4. 2025TRIX: A More Expressive Model for Zero-shot Domain Transfer in Knowledge Graphscited by 23
  5. 2025How Expressive are Knowledge Graph Foundation Models?cited by 22
  6. 2024LLM as Prompter: Low-resource Inductive Reasoning on Arbitrary Knowledge Graphscited by 13
  7. 2024A Foundation Model for Zero-shot Logical Query Reasoningcited by 13
  8. 2025Flock: A Knowledge Graph Foundation Model via Learning on Random Walkscited by 8
  9. 2025SEMMA: A Semantic Aware Knowledge Graph Foundation Modelcited by 7
  10. 2025HYPER: A Foundation Model for Inductive Link Prediction with Knowledge Hypergraphscited by 7
  11. 2024Towards Graph Foundation Models: Training on Knowledge Graphs Enables Transferability to General Graphscited by 6
  12. 2025Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answeringcited by 5
11 more
  1. 2026Bridging Input Feature Spaces Towards Graph Foundation Modelscited by 2
  2. 2026KGPFN: Unlocking the Potential of Knowledge Graph Foundation Model via In-Context Learningcited by 2
  3. 2024Learning Representations for Reasoning: Generalizing Across Diverse Structurescited by 1
  4. 2025Geometric Structural Knowledge Graph Foundation Modelcited by 1
  5. 2026THOR: Inductive Link Prediction over Hyper-Relational Knowledge Graphscited by 0
  6. 2026Boosting Knowledge Graph Foundation Models via Enhanced Negative Samplingcited by 0
  7. 2026Half a Link can Be Enough to Predict a Whole Link: Understanding Generalization in Knowledge Graph Foundation Modelscited by 0
  8. 2026GRATE: Temporal Extensions for Inductive KG Foundation Models via Gated Rotary Attentioncited by 0
  9. 2026Neural Message Passing on Structural Interaction Graphs for Fully-Inductive Graph Neural Networkscited by 0
  10. 2026Structure-Internalized Rule Language Model for Faithful Knowledge Graph Reasoningcited by 0
  11. 2026Reification as a Transferable Vocabulary: Zero-Shot Link Prediction with Vanilla GNNscited by 0