mlsanityData to 7 Oct 2026

Multi-Scale Subgraph Contrastive Learning

arXiv 2403.02719 ↗First posted 5 Mar 2024cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Graph-level contrastive learning, aiming to learn the representations for each graph by contrasting two augmented graphs, has attracted considerable attention. Previous studies usually simply assume that a graph and its augmented graph as a positive pair, otherwise as a negative pair. However, it is well known that graph structure is always complex and multi-scale, which gives rise to a fundamental question: after graph augmentation, will the previous assumption still hold in reality? By an experimental analysis, we discover the semantic information of an augmented graph structure may be not consistent as original graph structure, and whether two augmented graphs are positive or negative pairs is highly related with the multi-scale structures. Based on this finding, we propose a multi-scale subgraph contrastive learning architecture which is able to characterize the fine-grained semantic information. Specifically, we generate global and local views at different scales based on subgraph sampling, and construct multiple contrastive relationships according to their semantic associations to provide richer self-supervised signals. Extensive experiments and parametric analyzes on eight graph classification real-world datasets well demonstrate the effectiveness of the proposed method.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 23 of its 49 references that are in the map. First posted on arXiv 5 Mar 2024.

Builds on

23 of 49 references.

References · 23

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Graph Attention Networkscited by 8,854
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2018How Powerful are Graph Neural Networks?cited by 4,355
  7. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  8. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  9. 2016Variational Graph Auto-Encoderscited by 1,373
  10. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  11. 2018Deep Graph Infomaxcited by 1,101
  12. 2019Strategies for Pre-training Graph Neural Networkscited by 964
11 more
  1. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
  2. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
  3. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  4. 2021Graph Contrastive Learning Automatedcited by 287
  5. 2017graph2vec: Learning Distributed Representations of Graphscited by 228
  6. 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
  7. 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
  8. 2020Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learningcited by 90
  9. 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
  10. 2019Are Powerful Graph Neural Nets Necessary? A Dissection on Graph Classificationcited by 39
  11. 2016AptRank: An Adaptive PageRank Model for Protein Function Prediction on Bi-relational Graphscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 1.

5 papers.