mlsanityData to 7 Oct 2026

GPS: Graph Contrastive Learning via Multi-scale Augmented Views from Adversarial Pooling

arXiv 2401.16011 ↗First posted 29 Jan 2024cs.LG cs.AI cs.SIcited by 1

Not on the map. Why?

Abstract (arXiv)

Self-supervised graph representation learning has recently shown considerable promise in a range of fields, including bioinformatics and social networks. A large number of graph contrastive learning approaches have shown promising performance for representation learning on graphs, which train models by maximizing agreement between original graphs and their augmented views (i.e., positive views). Unfortunately, these methods usually involve pre-defined augmentation strategies based on the knowledge of human experts. Moreover, these strategies may fail to generate challenging positive views to provide sufficient supervision signals. In this paper, we present a novel approach named Graph Pooling ContraSt (GPS) to address these issues. Motivated by the fact that graph pooling can adaptively coarsen the graph with the removal of redundancy, we rethink graph pooling and leverage it to automatically generate multi-scale positive views with varying emphasis on providing challenging positives and preserving semantics, i.e., strongly-augmented view and weakly-augmented view. Then, we incorporate both views into a joint contrastive learning framework with similarity learning and consistency learning, where our pooling module is adversarially trained with respect to the encoder for adversarial robustness. Experiments on twelve datasets on both graph classification and transfer learning tasks verify the superiority of the proposed method over its counterparts.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 50 of its 80 references that are in the map. First posted on arXiv 29 Jan 2024.

Builds on

50 of 80 references.

References · 50

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Graph Attention Networkscited by 8,854
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2017Inductive Representation Learning on Large Graphscited by 6,284
  7. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  8. 2018How Powerful are Graph Neural Networks?cited by 4,355
  9. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  10. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  11. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  12. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
38 more
  1. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  2. 2018Deep Graph Infomaxcited by 1,101
  3. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  4. 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
  5. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
  6. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
  7. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  8. 2019Graph U-Netscited by 489
  9. 2017Towards Principled Methods for Training Generative Adversarial Networkscited by 460
  10. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  11. 2019Self-Attention Graph Poolingcited by 421
  12. 2021Graph Contrastive Learning Automatedcited by 287
  13. 2019SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimizationcited by 253
  14. 2017graph2vec: Learning Distributed Representations of Graphscited by 228
  15. 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 209
  16. 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
  17. 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
  18. 2019ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representationscited by 156
  19. 2021Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learningcited by 130
  20. 2020When Does Self-Supervision Help Graph Convolutional Networks?cited by 121
  21. 2021Contrastive Learning with Stronger Augmentationscited by 100
  22. 2021Contrastive Learning for Cold-Start Recommendationcited by 77
  23. 2021SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanismcited by 75
  24. 2023A Comprehensive Survey on Deep Graph Representation Learningcited by 72
  25. 2020ASGN: An Active Semi-supervised Graph Neural Network for Molecular Property Predictioncited by 58
  26. 2022Let Invariant Rationale Discovery Inspire Graph Contrastive Learningcited by 57
  27. 2020Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systemscited by 38
  28. 2023A Diffusion model for POI recommendationcited by 24
  29. 2022GLCC: A General Framework for Graph-Level Clusteringcited by 21
  30. 2023TGNN: A Joint Semi-supervised Framework for Graph-level Classificationcited by 19
  31. 2022KGNN: Harnessing Kernel-based Networks for Semi-supervised Graph Classificationcited by 18
  32. 2023Dynamic Hypergraph Structure Learning for Traffic Flow Forecastingcited by 14
  33. 2022ChemicalX: A Deep Learning Library for Drug Pair Scoringcited by 11
  34. 2023Learning Graph ODE for Continuous-Time Sequential Recommendationcited by 11
  35. 2023Redundancy-Free Self-Supervised Relational Learning for Graph Clusteringcited by 8
  36. 2023RAHNet: Retrieval Augmented Hybrid Network for Long-tailed Graph Classificationcited by 7
  37. 2016AptRank: An Adaptive PageRank Model for Protein Function Prediction on Bi-relational Graphscited by 6
  38. 2017Beyond Low-Rank Representations: Orthogonal Clustering Basis Reconstruction with Optimized Graph Structure for Multi-view Spectral Clusteringcited by 6

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.