mlsanityData to 7 Oct 2026

Link Prediction on N-ary Relational Facts: A Graph-based Approach

arXiv 2105.08476 ↗First posted 18 May 2021cs.AIcited by 29

Not on the map. Why?

Abstract (arXiv)

Link prediction on knowledge graphs (KGs) is a key research topic. Previous work mainly focused on binary relations, paying less attention to higher-arity relations although they are ubiquitous in real-world KGs. This paper considers link prediction upon n-ary relational facts and proposes a graph-based approach to this task. The key to our approach is to represent the n-ary structure of a fact as a small heterogeneous graph, and model this graph with edge-biased fully-connected attention. The fully-connected attention captures universal inter-vertex interactions, while with edge-aware attentive biases to particularly encode the graph structure and its heterogeneity. In this fashion, our approach fully models global and local dependencies in each n-ary fact, and hence can more effectively capture associations therein. Extensive evaluation verifies the effectiveness and superiority of our approach. It performs substantially and consistently better than current state-of-the-art across a variety of n-ary relational benchmarks. Our code is publicly available.

Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 18 May 2021.

Builds on

27 of 41 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  5. 2016Layer Normalizationcited by 5,579
  6. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  7. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  8. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  9. 2018Self-Attention with Relative Position Representationscited by 1,112
  10. 2016Complex Embeddings for Simple Link Predictioncited by 897
  11. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
  12. 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
15 more
  1. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  2. 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
  3. 2015A Review of Relational Machine Learning for Knowledge Graphscited by 264
  4. 2020Message Passing for Hyper-Relational Knowledge Graphscited by 78
  5. 2018Linguistically-Informed Self-Attention for Semantic Role Labelingcited by 71
  6. 2019Tree Transformer: Integrating Tree Structures into Self-Attentioncited by 68
  7. 2021Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extractioncited by 68
  8. 2020FLAT: Chinese NER Using Flat-Lattice Transformercited by 67
  9. 2016On the representation and embedding of knowledge bases beyond binary relationscited by 55
  10. 2020HittER: Hierarchical Transformers for Knowledge Graph Embeddingscited by 54
  11. 2020Generalizing Tensor Decomposition for N-ary Relational Knowledge Basescited by 38
  12. 2019CoKE: Contextualized Knowledge Graph Embeddingcited by 30
  13. 2021Role-Aware Modeling for N-ary Relational Knowledge Basescited by 29
  14. 2019Extracting Multiple-Relations in One-Pass with Pre-Trained Transformerscited by 19
  15. 2021Improving Hyper-Relational Knowledge Graph Completioncited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 3; 2023: 8; 2024: 5; 2025: 8; 2026: 3.

29 papers.

Sort:

By area:

  1. 2025HyperGraphRAG: Retrieval-Augmented Generation via Hypergraph-Structured Knowledge Representationcited by 68
  2. 2021What is Event Knowledge Graph: A Surveycited by 19
  3. 2023Representation Learning on Hyper-Relational and Numeric Knowledge Graphs with Transformerscited by 16
  4. 2023Shrinking Embeddings for Hyper-Relational Knowledge Graphscited by 12
  5. 2023Text2NKG: Fine-Grained N-ary Relation Extraction for N-ary relational Knowledge Graph Constructioncited by 11
  6. 2023HAHE: Hierarchical Attention for Hyper-Relational Knowledge Graphs in Global and Local Levelcited by 10
  7. 2023Temporal Fact Reasoning over Hyper-Relational Knowledge Graphscited by 10
  8. 2022NQE: N-ary Query Embedding for Complex Query Answering over Hyper-Relational Knowledge Graphscited by 9
  9. 2022Learning Representations for Hyper-Relational Knowledge Graphscited by 8
  10. 2022DHGE: Dual-View Hyper-Relational Knowledge Graph Embedding for Link Prediction and Entity Typingcited by 7
  11. 2023HyperFormer: Enhancing Entity and Relation Interaction for Hyper-Relational Knowledge Graph Completioncited by 5
  12. 2025A Survey of Link Prediction in N-ary Knowledge Graphscited by 4
17 more
  1. 2023IntelliGraphs: Datasets for Benchmarking Knowledge Graph Generationcited by 3
  2. 2024Cardinality Estimation on Hyper-relational Knowledge Graphscited by 3
  3. 2024Replacing Paths with Connection-Biased Attention for Knowledge Graph Completioncited by 3
  4. 2024UniHR: Hierarchical Representation Learning for Unified Knowledge Graph Link Predictioncited by 3
  5. 2025Inductive Link Prediction on N-ary Relational Facts via Semantic Hypergraph Reasoningcited by 3
  6. 2021Fact-Tree Reasoning for N-ary Question Answering over Knowledge Graphscited by 2
  7. 2023Few-shot Link Prediction on N-ary Factscited by 2
  8. 2024HyperMono: A Monotonicity-aware Approach to Hyper-Relational Knowledge Representationcited by 2
  9. 2024Generalizing Hyperedge Expansion for Hyper-relational Knowledge Graph Modelingcited by 2
  10. 2025Transformers for Complex Query Answering over Knowledge Hypergraphscited by 2
  11. 2025Two-dimensional Taxonomy for N-ary Knowledge Representation Learning Methodscited by 1
  12. 2025Understanding the Embedding Models on Hyper-relational Knowledge Graphcited by 1
  13. 2025VITA: Versatile Time Representation Learning for Temporal Hyper-Relational Knowledge Graphscited by 0
  14. 2025Mixture Policy based Multi-Hop Reasoning over N-tuple Temporal Knowledge Graphscited by 0
  15. 2026THOR: Inductive Link Prediction over Hyper-Relational Knowledge Graphscited by 0
  16. 2026Life-Bench: A Benchmark and Knowledge Graph Framework for Multimodal Personalization Beyond Concept Recognitioncited by 0
  17. 2026Generative Representation Learning on Hyper-relational Knowledge Graphs via Masked Discrete Diffusioncited by 0