Heterogeneous Graph Neural Networks using Self-supervised Reciprocally Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be annotated, which is costly and time-consuming. Self-supervised contrastive learning has been proposed to address the problem of requiring annotated data by mining intrinsic information hidden within the given data. However, the existing contrastive learning methods are inadequate for heterogeneous graphs because they construct contrastive views only based on data perturbation or pre-defined structural properties (e.g., meta-path) in graph data while ignore the noises that may exist in both node attributes and graph topologies. We develop for the first time a novel and robust heterogeneous graph contrastive learning approach, namely HGCL, which introduces two views on respective guidance of node attributes and graph topologies and integrates and enhances them by reciprocally contrastive mechanism to better model heterogeneous graphs. In this new approach, we adopt distinct but most suitable attribute and topology fusion mechanisms in the two views, which are conducive to mining relevant information in attributes and topologies separately. We further use both attribute similarity and topological correlation to construct high-quality contrastive samples. Extensive experiments on three large real-world heterogeneous graphs demonstrate the superiority and robustness of HGCL over state-of-the-art methods.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 29 of its 53 references that are in the map. First posted on arXiv 30 Apr 2022.
Builds on
29 of 53 references.
References · 29
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2016Variational Graph Auto-Encoderscited by 1,373
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2019Heterogeneous Graph Attention Networkcited by 732
- 2020Heterogeneous Graph Transformercited by 581
17 more
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2019Graph Transformer Networkscited by 520
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
- 2019Diffusion Improves Graph Learningcited by 414
- 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
- 2020Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node Embeddingscited by 212
- 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
- 2021Are we really making much progress? Revisiting, benchmarking, and refining heterogeneous graph neural networkscited by 176
- 2021Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learningcited by 130
- 2015A Survey of Heterogeneous Information Network Analysiscited by 109
- 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
- 2020Graph Neural Networks: Taxonomy, Advances and Trendscited by 48
- 2019Relation Structure-Aware Heterogeneous Information Network Embeddingcited by 19
- 2021Structure-Aware Hard Negative Mining for Heterogeneous Graph Contrastive Learningcited by 3
Built on by
Citing papers per year: 2023: 5; 2024: 0; 2025: 0; 2026: 1.
6 papers.
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Reviewcited by 20
- 2023HAGNN: Hybrid Aggregation for Heterogeneous Graph Neural Networkscited by 4
- 2026MUG: Meta-path-aware Universal Heterogeneous Graph Pre-Trainingcited by 4
- 2023Efficient Partitioning Method of Large-Scale Public Safety Spatio-Temporal Data based on Information Loss Constraintscited by 0
- 2023Entity Alignment Method of Science and Technology Patent based on Graph Convolution Network and Information Fusioncited by 0
- 2023Topic model based on co-occurrence word networks for unbalanced short text datasetscited by 0
- 2026MUG: Meta-path-aware Universal Heterogeneous Graph Pre-Training26 Feb 2026
- 2023Topic model based on co-occurrence word networks for unbalanced short text datasets5 Nov 2023
- 2023Entity Alignment Method of Science and Technology Patent based on Graph Convolution Network and Information Fusion1 Nov 2023
- 2023HAGNN: Hybrid Aggregation for Heterogeneous Graph Neural Networks4 Jul 2023
- 2023Efficient Partitioning Method of Large-Scale Public Safety Spatio-Temporal Data based on Information Loss Constraints22 Jun 2023
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Review11 Mar 2023