Heterogeneous Graph Representation Learning with Relation Awareness
Not on the map. Why?
Abstract (arXiv)
Representation learning on heterogeneous graphs aims to obtain meaningful node representations to facilitate various downstream tasks, such as node classification and link prediction. Existing heterogeneous graph learning methods are primarily developed by following the propagation mechanism of node representations. There are few efforts on studying the role of relations for improving the learning of more fine-grained node representations. Indeed, it is important to collaboratively learn the semantic representations of relations and discern node representations with respect to different relation types. To this end, in this paper, we propose a novel Relation-aware Heterogeneous Graph Neural Network, namely R-HGNN, to learn node representations on heterogeneous graphs at a fine-grained level by considering relation-aware characteristics. Specifically, a dedicated graph convolution component is first designed to learn unique node representations from each relation-specific graph separately. Then, a cross-relation message passing module is developed to improve the interactions of node representations across different relations. Also, the relation representations are learned in a layer-wise manner to capture relation semantics, which are used to guide the node representation learning process. Moreover, a semantic fusing module is presented to aggregate relation-aware node representations into a compact representation with the learned relation representations. Finally, we conduct extensive experiments on a variety of graph learning tasks, and experimental results demonstrate that our approach consistently outperforms existing methods among all the tasks.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 24 May 2021.
Builds on
29 of 46 references.
References · 29
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
17 more
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
- 2019Heterogeneous Graph Attention Networkcited by 734
- 2019Neural Graph Collaborative Filteringcited by 661
- 2020Heterogeneous Graph Transformercited by 582
- 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
- 2019Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networkscited by 242
- 2017Heterogeneous Information Network Embedding for Recommendationcited by 133
- 2015A Survey of Heterogeneous Information Network Analysiscited by 110
- 2019Representation Learning for Attributed Multiplex Heterogeneous Networkcited by 91
- 2019An Attention-based Graph Neural Network for Heterogeneous Structural Learningcited by 71
- 2019Relation Structure-Aware Heterogeneous Information Network Embeddingcited by 19
Built on by
Citing papers per year: 2021: 3; 2022: 8; 2023: 8; 2024: 5; 2025: 4; 2026: 3.
31 papers.
Sort:
By area:
- 2022Graph Attention Multi-Layer Perceptroncited by 83
- 2022Algorithm and System Co-design for Efficient Subgraph-based Graph Representation Learningcited by 28
- 2023Pretraining Language Models with Text-Attributed Heterogeneous Graphscited by 15
- 2022Label-Enhanced Graph Neural Network for Semi-supervised Node Classificationcited by 11
- 2023Meta-Path Learning for Multi-relational Graph Neural Networkscited by 10
- 2023Learning from Heterogeneity: A Dynamic Learning Framework for Hypergraphscited by 8
- 2023Collaborative Graph Neural Networks for Attributed Network Embeddingcited by 8
- 2022Enabling Homogeneous GNNs to Handle Heterogeneous Graphs via Relation Embeddingcited by 7
- 2024A Self-Explainable Heterogeneous GNN for Relational Deep Learningcited by 7
- 2021Learning Bi-typed Multi-relational Heterogeneous Graph via Dual Hierarchical Attention Networkscited by 4
- 2022MECCH: Metapath Context Convolution-based Heterogeneous Graph Neural Networkscited by 4
- 2023HAGNN: Hybrid Aggregation for Heterogeneous Graph Neural Networkscited by 4
19 more
- 2023A Neuro-Symbolic Framework for Answering Graph Pattern Queries in Knowledge Graphscited by 4
- 2021Graph Attention MLP with Reliable Label Utilizationcited by 3
- 2023Seq-HGNN: Learning Sequential Node Representation on Heterogeneous Graphcited by 3
- 2024Large Language Models Meet Graph Neural Networks: A Perspective of Graph Miningcited by 3
- 2021HMSG: Heterogeneous Graph Neural Network based on Metapath Subgraph Learningcited by 2
- 2025Towards Efficient LLM-aware Heterogeneous Graph Learningcited by 2
- 2022Representation Learning on Heterostructures via Heterogeneous Anonymous Walkscited by 1
- 2022Towards Relation-centered Pooling and Convolution for Heterogeneous Graph Learning Networkscited by 1
- 2023Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graphcited by 1
- 2024MEGA: Message Passing Neural Networks for Multigraphs with EdGe Attributescited by 1
- 2025MAPN: Enhancing Heterogeneous Sparse Graph Representation by Mamba-based Asynchronous Aggregationcited by 1
- 2026RABot: Reinforcement-Guided Graph Augmentation for Imbalanced and Noisy Social Bot Detectioncited by 1
- 2022RHCO: A Relation-aware Heterogeneous Graph Neural Network with Contrastive Learning for Large-scale Graphscited by 0
- 2024Generative-Contrastive Heterogeneous Graph Neural Networkcited by 0
- 2024SCNode: Spatial and Contextual Coordinates for Graph Representation Learningcited by 0
- 2025FHGE: A Fast Heterogeneous Graph Embedding with Ad-hoc Meta-pathscited by 0
- 2025A Benchmark Dataset for Graph Regression with Homogeneous and Multi-Relational Variantscited by 0
- 2026Scalable Heterogeneous Graph Learning via Heterogeneous-aware Orthogonal Prototype Expertscited by 0
- 2026THGFM: Dual-Branch Temporal Heterogeneous Graph Fusion Modelcited by 0
- 2026THGFM: Dual-Branch Temporal Heterogeneous Graph Fusion Model29 Jul 2026
- 2026RABot: Reinforcement-Guided Graph Augmentation for Imbalanced and Noisy Social Bot Detection25 Feb 2026
- 2026Scalable Heterogeneous Graph Learning via Heterogeneous-aware Orthogonal Prototype Experts9 Jan 2026
- 2025Towards Efficient LLM-aware Heterogeneous Graph Learning22 Nov 2025
- 2025A Benchmark Dataset for Graph Regression with Homogeneous and Multi-Relational Variants29 May 2025
- 2025MAPN: Enhancing Heterogeneous Sparse Graph Representation by Mamba-based Asynchronous Aggregation23 Feb 2025
- 2025FHGE: A Fast Heterogeneous Graph Embedding with Ad-hoc Meta-paths22 Feb 2025
- 2024Large Language Models Meet Graph Neural Networks: A Perspective of Graph Mining26 Dec 2024
- 2024A Self-Explainable Heterogeneous GNN for Relational Deep Learning30 Nov 2024
- 2024MEGA: Message Passing Neural Networks for Multigraphs with EdGe Attributes29 Nov 2024
- 2024SCNode: Spatial and Contextual Coordinates for Graph Representation Learning3 Oct 2024
- 2024Generative-Contrastive Heterogeneous Graph Neural Network3 Apr 2024
19 more
- 2023Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph10 Dec 2023
- 2023Pretraining Language Models with Text-Attributed Heterogeneous Graphs19 Oct 2023
- 2023A Neuro-Symbolic Framework for Answering Graph Pattern Queries in Knowledge Graphs6 Oct 2023
- 2023Meta-Path Learning for Multi-relational Graph Neural Networks29 Sep 2023
- 2023Collaborative Graph Neural Networks for Attributed Network Embedding22 Jul 2023
- 2023Learning from Heterogeneity: A Dynamic Learning Framework for Hypergraphs7 Jul 2023
- 2023HAGNN: Hybrid Aggregation for Heterogeneous Graph Neural Networks4 Jul 2023
- 2023Seq-HGNN: Learning Sequential Node Representation on Heterogeneous Graph18 May 2023
- 2022MECCH: Metapath Context Convolution-based Heterogeneous Graph Neural Networks23 Nov 2022
- 2022RHCO: A Relation-aware Heterogeneous Graph Neural Network with Contrastive Learning for Large-scale Graphs20 Nov 2022
- 2022Towards Relation-centered Pooling and Convolution for Heterogeneous Graph Learning Networks31 Oct 2022
- 2022Enabling Homogeneous GNNs to Handle Heterogeneous Graphs via Relation Embedding23 Sep 2022
- 2022Graph Attention Multi-Layer Perceptron9 Jun 2022
- 2022Label-Enhanced Graph Neural Network for Semi-supervised Node Classification31 May 2022
- 2022Algorithm and System Co-design for Efficient Subgraph-based Graph Representation Learning28 Feb 2022
- 2022Representation Learning on Heterostructures via Heterogeneous Anonymous Walks18 Jan 2022
- 2021Learning Bi-typed Multi-relational Heterogeneous Graph via Dual Hierarchical Attention Networks24 Dec 2021
- 2021HMSG: Heterogeneous Graph Neural Network based on Metapath Subgraph Learning7 Sep 2021
- 2021Graph Attention MLP with Reliable Label Utilization23 Aug 2021
- 2022Graph Attention Multi-Layer Perceptroncited by 83
- 2022Algorithm and System Co-design for Efficient Subgraph-based Graph Representation Learningcited by 28
- 2023Pretraining Language Models with Text-Attributed Heterogeneous Graphscited by 15
- 2022Label-Enhanced Graph Neural Network for Semi-supervised Node Classificationcited by 11
- 2023Meta-Path Learning for Multi-relational Graph Neural Networkscited by 10
- 2023Learning from Heterogeneity: A Dynamic Learning Framework for Hypergraphscited by 8
- 2023Collaborative Graph Neural Networks for Attributed Network Embeddingcited by 8
- 2022Enabling Homogeneous GNNs to Handle Heterogeneous Graphs via Relation Embeddingcited by 7
- 2024A Self-Explainable Heterogeneous GNN for Relational Deep Learningcited by 7
- 2021Learning Bi-typed Multi-relational Heterogeneous Graph via Dual Hierarchical Attention Networkscited by 4
- 2022MECCH: Metapath Context Convolution-based Heterogeneous Graph Neural Networkscited by 4
- 2023HAGNN: Hybrid Aggregation for Heterogeneous Graph Neural Networkscited by 4
12 most cited of 29 All 29 (JSON)
- 2026THGFM: Dual-Branch Temporal Heterogeneous Graph Fusion Model29 Jul 2026
- 2026RABot: Reinforcement-Guided Graph Augmentation for Imbalanced and Noisy Social Bot Detection25 Feb 2026
- 2025Towards Efficient LLM-aware Heterogeneous Graph Learning22 Nov 2025
- 2025A Benchmark Dataset for Graph Regression with Homogeneous and Multi-Relational Variants29 May 2025
- 2025FHGE: A Fast Heterogeneous Graph Embedding with Ad-hoc Meta-paths22 Feb 2025
- 2024Large Language Models Meet Graph Neural Networks: A Perspective of Graph Mining26 Dec 2024
- 2024A Self-Explainable Heterogeneous GNN for Relational Deep Learning30 Nov 2024
- 2024MEGA: Message Passing Neural Networks for Multigraphs with EdGe Attributes29 Nov 2024
- 2024SCNode: Spatial and Contextual Coordinates for Graph Representation Learning3 Oct 2024
- 2024Generative-Contrastive Heterogeneous Graph Neural Network3 Apr 2024
- 2023Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph10 Dec 2023
- 2023Pretraining Language Models with Text-Attributed Heterogeneous Graphs19 Oct 2023
12 newest of 29 All 29 (JSON)