mlsanityData to 14 Oct 2026

Heterogeneous Graph Representation Learning with Relation Awareness

arXiv 2105.11122 ↗First posted 24 May 2021cs.LG cs.SIcited by 31

Not on the map. Why?

Abstract (arXiv)

Representation learning on heterogeneous graphs aims to obtain meaningful node representations to facilitate various downstream tasks, such as node classification and link prediction. Existing heterogeneous graph learning methods are primarily developed by following the propagation mechanism of node representations. There are few efforts on studying the role of relations for improving the learning of more fine-grained node representations. Indeed, it is important to collaboratively learn the semantic representations of relations and discern node representations with respect to different relation types. To this end, in this paper, we propose a novel Relation-aware Heterogeneous Graph Neural Network, namely R-HGNN, to learn node representations on heterogeneous graphs at a fine-grained level by considering relation-aware characteristics. Specifically, a dedicated graph convolution component is first designed to learn unique node representations from each relation-specific graph separately. Then, a cross-relation message passing module is developed to improve the interactions of node representations across different relations. Also, the relation representations are learned in a layer-wise manner to capture relation semantics, which are used to guide the node representation learning process. Moreover, a semantic fusing module is presented to aggregate relation-aware node representations into a compact representation with the learned relation representations. Finally, we conduct extensive experiments on a variety of graph learning tasks, and experimental results demonstrate that our approach consistently outperforms existing methods among all the tasks.

Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 24 May 2021.

Builds on

29 of 46 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  6. 2017Graph Attention Networkscited by 8,923
  7. 2017Inductive Representation Learning on Large Graphscited by 6,320
  8. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  9. 2018How Powerful are Graph Neural Networks?cited by 4,393
  10. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  11. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  12. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
17 more
  1. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  2. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  3. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
  4. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
  5. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
  6. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
  7. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
  8. 2019Heterogeneous Graph Attention Networkcited by 734
  9. 2019Neural Graph Collaborative Filteringcited by 661
  10. 2020Heterogeneous Graph Transformercited by 582
  11. 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
  12. 2019Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networkscited by 242
  13. 2017Heterogeneous Information Network Embedding for Recommendationcited by 133
  14. 2015A Survey of Heterogeneous Information Network Analysiscited by 110
  15. 2019Representation Learning for Attributed Multiplex Heterogeneous Networkcited by 91
  16. 2019An Attention-based Graph Neural Network for Heterogeneous Structural Learningcited by 71
  17. 2019Relation Structure-Aware Heterogeneous Information Network Embeddingcited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 3; 2022: 8; 2023: 8; 2024: 5; 2025: 4; 2026: 3.

31 papers.

Sort:

By area:

  1. 2022Graph Attention Multi-Layer Perceptroncited by 83
  2. 2022Algorithm and System Co-design for Efficient Subgraph-based Graph Representation Learningcited by 28
  3. 2023Pretraining Language Models with Text-Attributed Heterogeneous Graphscited by 15
  4. 2022Label-Enhanced Graph Neural Network for Semi-supervised Node Classificationcited by 11
  5. 2023Meta-Path Learning for Multi-relational Graph Neural Networkscited by 10
  6. 2023Learning from Heterogeneity: A Dynamic Learning Framework for Hypergraphscited by 8
  7. 2023Collaborative Graph Neural Networks for Attributed Network Embeddingcited by 8
  8. 2022Enabling Homogeneous GNNs to Handle Heterogeneous Graphs via Relation Embeddingcited by 7
  9. 2024A Self-Explainable Heterogeneous GNN for Relational Deep Learningcited by 7
  10. 2021Learning Bi-typed Multi-relational Heterogeneous Graph via Dual Hierarchical Attention Networkscited by 4
  11. 2022MECCH: Metapath Context Convolution-based Heterogeneous Graph Neural Networkscited by 4
  12. 2023HAGNN: Hybrid Aggregation for Heterogeneous Graph Neural Networkscited by 4
19 more
  1. 2023A Neuro-Symbolic Framework for Answering Graph Pattern Queries in Knowledge Graphscited by 4
  2. 2021Graph Attention MLP with Reliable Label Utilizationcited by 3
  3. 2023Seq-HGNN: Learning Sequential Node Representation on Heterogeneous Graphcited by 3
  4. 2024Large Language Models Meet Graph Neural Networks: A Perspective of Graph Miningcited by 3
  5. 2021HMSG: Heterogeneous Graph Neural Network based on Metapath Subgraph Learningcited by 2
  6. 2025Towards Efficient LLM-aware Heterogeneous Graph Learningcited by 2
  7. 2022Representation Learning on Heterostructures via Heterogeneous Anonymous Walkscited by 1
  8. 2022Towards Relation-centered Pooling and Convolution for Heterogeneous Graph Learning Networkscited by 1
  9. 2023Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graphcited by 1
  10. 2024MEGA: Message Passing Neural Networks for Multigraphs with EdGe Attributescited by 1
  11. 2025MAPN: Enhancing Heterogeneous Sparse Graph Representation by Mamba-based Asynchronous Aggregationcited by 1
  12. 2026RABot: Reinforcement-Guided Graph Augmentation for Imbalanced and Noisy Social Bot Detectioncited by 1
  13. 2022RHCO: A Relation-aware Heterogeneous Graph Neural Network with Contrastive Learning for Large-scale Graphscited by 0
  14. 2024Generative-Contrastive Heterogeneous Graph Neural Networkcited by 0
  15. 2024SCNode: Spatial and Contextual Coordinates for Graph Representation Learningcited by 0
  16. 2025FHGE: A Fast Heterogeneous Graph Embedding with Ad-hoc Meta-pathscited by 0
  17. 2025A Benchmark Dataset for Graph Regression with Homogeneous and Multi-Relational Variantscited by 0
  18. 2026Scalable Heterogeneous Graph Learning via Heterogeneous-aware Orthogonal Prototype Expertscited by 0
  19. 2026THGFM: Dual-Branch Temporal Heterogeneous Graph Fusion Modelcited by 0