mlsanityData to 7 Oct 2026

Heterogeneous Graph Neural Networks using Self-supervised Reciprocally Contrastive Learning

arXiv 2205.00256 ↗First posted 30 Apr 2022cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be annotated, which is costly and time-consuming. Self-supervised contrastive learning has been proposed to address the problem of requiring annotated data by mining intrinsic information hidden within the given data. However, the existing contrastive learning methods are inadequate for heterogeneous graphs because they construct contrastive views only based on data perturbation or pre-defined structural properties (e.g., meta-path) in graph data while ignore the noises that may exist in both node attributes and graph topologies. We develop for the first time a novel and robust heterogeneous graph contrastive learning approach, namely HGCL, which introduces two views on respective guidance of node attributes and graph topologies and integrates and enhances them by reciprocally contrastive mechanism to better model heterogeneous graphs. In this new approach, we adopt distinct but most suitable attribute and topology fusion mechanisms in the two views, which are conducive to mining relevant information in attributes and topologies separately. We further use both attribute similarity and topological correlation to construct high-quality contrastive samples. Extensive experiments on three large real-world heterogeneous graphs demonstrate the superiority and robustness of HGCL over state-of-the-art methods.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 29 of its 53 references that are in the map. First posted on arXiv 30 Apr 2022.

Builds on

29 of 53 references.

References · 29

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Graph Attention Networkscited by 8,854
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2017Inductive Representation Learning on Large Graphscited by 6,284
  7. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  8. 2016Variational Graph Auto-Encoderscited by 1,373
  9. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  10. 2018Deep Graph Infomaxcited by 1,101
  11. 2019Heterogeneous Graph Attention Networkcited by 732
  12. 2020Heterogeneous Graph Transformercited by 581
17 more
  1. 2020Deep Graph Contrastive Representation Learningcited by 535
  2. 2019Graph Transformer Networkscited by 520
  3. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  4. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
  5. 2019Diffusion Improves Graph Learningcited by 414
  6. 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
  7. 2021Graph Self-Supervised Learning: A Surveycited by 289
  8. 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
  9. 2020Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node Embeddingscited by 212
  10. 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
  11. 2021Are we really making much progress? Revisiting, benchmarking, and refining heterogeneous graph neural networkscited by 176
  12. 2021Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learningcited by 130
  13. 2015A Survey of Heterogeneous Information Network Analysiscited by 109
  14. 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
  15. 2020Graph Neural Networks: Taxonomy, Advances and Trendscited by 48
  16. 2019Relation Structure-Aware Heterogeneous Information Network Embeddingcited by 19
  17. 2021Structure-Aware Hard Negative Mining for Heterogeneous Graph Contrastive Learningcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 0; 2025: 0; 2026: 1.

6 papers.