mlsanityData to 14 Oct 2026

Graph Collaborative Attention Network for Link Prediction in Knowledge Graphs

arXiv 2507.03947 ↗First posted 5 Jul 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Knowledge graphs offer a structured representation of real-world entities and their relationships, enabling a wide range of applications from information retrieval to automated reasoning. In this paper, we conduct a systematic comparison between traditional rule-based approaches and modern deep learning methods for link prediction. We focus on KBGAT, a graph neural network model that leverages multi-head attention to jointly encode both entity and relation features within local neighborhood structures. To advance this line of research, we introduce GCAT (Graph Collaborative Attention Network), a refined model that enhances context aggregation and interaction between heterogeneous nodes. Experimental results on four widely-used benchmark datasets demonstrate that GCAT not only consistently outperforms rule-based methods but also achieves competitive or superior performance compared to existing neural embedding models. Our findings highlight the advantages of attention-based architectures in capturing complex relational patterns for knowledge graph completion tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 5 Jul 2025.

Builds on

25 of 42 references.

References · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Graph Attention Networkscited by 8,923
  4. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  5. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  6. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  7. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  8. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
  9. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
  10. 2016Complex Embeddings for Simple Link Predictioncited by 902
  11. 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
  12. 2017Dynamic Routing Between Capsulescited by 689
13 more
  1. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  2. 2015LINE: Large-scale Information Network Embeddingcited by 582
  3. 2019Stand-Alone Self-Attention in Vision Modelscited by 542
  4. 2019On the Relationship between Self-Attention and Convolutional Layerscited by 300
  5. 2017A Comprehensive Survey of Graph Embedding: Problems, Techniques and Applicationscited by 260
  6. 2017Graph Embedding Techniques, Applications, and Performance: A Surveycited by 188
  7. 2020Hierarchical Multi-Scale Attention for Semantic Segmentationcited by 183
  8. 2017A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Networkcited by 143
  9. 2018NetGAN: Generating Graphs via Random Walkscited by 131
  10. 2019Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphscited by 125
  11. 2019Learning to Exploit Long-term Relational Dependencies in Knowledge Graphscited by 83
  12. 2020Multi-Head Attention: Collaborate Instead of Concatenatecited by 60
  13. 2018A Capsule Network-based Embedding Model for Knowledge Graph Completion and Search Personalizationcited by 30

Built on by

Not cited yet.