mlsanityData to 7 Oct 2026

Generative-Contrastive Heterogeneous Graph Neural Network

arXiv 2404.02810 ↗First posted 3 Apr 2024cs.LG cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Heterogeneous Graphs (HGs) effectively model complex relationships in the real world through multi-type nodes and edges. In recent years, inspired by self-supervised learning (SSL), contrastive learning (CL)-based Heterogeneous Graphs Neural Networks (HGNNs) have shown great potential in utilizing data augmentation and contrastive discriminators for downstream tasks. However, data augmentation remains limited due to the graph data's integrity. Furthermore, the contrastive discriminators suffer from sampling bias and lack local heterogeneous information. To tackle the above limitations, we propose a novel Generative-Contrastive Heterogeneous Graph Neural Network (GC-HGNN). Specifically, we propose a heterogeneous graph generative learning method that enhances CL-based paradigm. This paradigm includes: 1) A contrastive view augmentation strategy using a masked autoencoder. 2) Position-aware and semantics-aware positive sample sampling strategy for generating hard negative samples. 3) A hierarchical contrastive learning strategy aimed at capturing local and global information. Furthermore, the hierarchical contrastive learning and sampling strategies aim to constitute an enhanced contrastive discriminator under the generative-contrastive perspective. Finally, we compare our model with seventeen baselines on eight real-world datasets. Our model outperforms the latest baselines on node classification and link prediction tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 57 references that are in the map. First posted on arXiv 3 Apr 2024.

Builds on

40 of 57 references.

References · 40

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Graph Attention Networkscited by 8,854
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2022Generative Adversarial Networkscited by 5,603
  7. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  8. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  9. 2018How Powerful are Graph Neural Networks?cited by 4,355
  10. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  11. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  12. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
28 more
  1. 2016Variational Graph Auto-Encoderscited by 1,373
  2. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  3. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  4. 2019Heterogeneous Graph Attention Networkcited by 732
  5. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  6. 2020Heterogeneous Graph Transformercited by 581
  7. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  8. 2020Hard Negative Mixing for Contrastive Learningcited by 399
  9. 2020Self-supervised Graph Learning for Recommendationcited by 305
  10. 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
  11. 2020GPT-GNN: Generative Pre-Training of Graph Neural Networkscited by 302
  12. 2023LLMRec: Large Language Models with Graph Augmentation for Recommendationcited by 171
  13. 2017Heterogeneous Information Network Embedding for Recommendationcited by 133
  14. 2021Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learningcited by 130
  15. 2019Unsupervised Attributed Multiplex Network Embeddingcited by 95
  16. 2022Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learningcited by 86
  17. 2022Hard Sample Aware Network for Contrastive Deep Graph Clusteringcited by 61
  18. 2022Heterogeneous Graph Masked Autoencoderscited by 47
  19. 2019Heterogeneous Deep Graph Infomaxcited by 42
  20. 2021Heterogeneous Graph Representation Learning with Relation Awarenesscited by 31
  21. 2023Heterogeneous Graph Contrastive Learning for Recommendationcited by 28
  22. 2022Multiplex Heterogeneous Graph Convolutional Networkcited by 27
  23. 2023Generative Contrastive Graph Learning for Recommendationcited by 20
  24. 2023Permutation Equivariant Graph Framelets for Heterophilous Graph Learningcited by 19
  25. 2021Social Recommendation with Self-Supervised Metagraph Informax Networkcited by 18
  26. 2022Heterogeneous Graph Contrastive Multi-view Learningcited by 14
  27. 2021Curriculum Pre-Training Heterogeneous Subgraph Transformer for Top-N Recommendationcited by 8
  28. 2023Graph Contrastive Learning with Generative Adversarial Networkcited by 8

Built on by

Not cited yet.