GPS: Graph Contrastive Learning via Multi-scale Augmented Views from Adversarial Pooling
Not on the map. Why?
Abstract (arXiv)
Self-supervised graph representation learning has recently shown considerable promise in a range of fields, including bioinformatics and social networks. A large number of graph contrastive learning approaches have shown promising performance for representation learning on graphs, which train models by maximizing agreement between original graphs and their augmented views (i.e., positive views). Unfortunately, these methods usually involve pre-defined augmentation strategies based on the knowledge of human experts. Moreover, these strategies may fail to generate challenging positive views to provide sufficient supervision signals. In this paper, we present a novel approach named Graph Pooling ContraSt (GPS) to address these issues. Motivated by the fact that graph pooling can adaptively coarsen the graph with the removal of redundancy, we rethink graph pooling and leverage it to automatically generate multi-scale positive views with varying emphasis on providing challenging positives and preserving semantics, i.e., strongly-augmented view and weakly-augmented view. Then, we incorporate both views into a joint contrastive learning framework with similarity learning and consistency learning, where our pooling module is adversarially trained with respect to the encoder for adversarial robustness. Experiments on twelve datasets on both graph classification and transfer learning tasks verify the superiority of the proposed method over its counterparts.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 50 of its 80 references that are in the map. First posted on arXiv 29 Jan 2024.
Builds on
50 of 80 references.
References · 50
- 2017Attention Is All You Needcited by 59,932
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
38 more
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2019Graph U-Netscited by 489
- 2017Towards Principled Methods for Training Generative Adversarial Networkscited by 460
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2019Self-Attention Graph Poolingcited by 421
- 2021Graph Contrastive Learning Automatedcited by 287
- 2019SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimizationcited by 253
- 2017graph2vec: Learning Distributed Representations of Graphscited by 228
- 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 209
- 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
- 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
- 2019ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representationscited by 156
- 2021Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learningcited by 130
- 2020When Does Self-Supervision Help Graph Convolutional Networks?cited by 121
- 2021Contrastive Learning with Stronger Augmentationscited by 100
- 2021Contrastive Learning for Cold-Start Recommendationcited by 77
- 2021SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanismcited by 75
- 2023A Comprehensive Survey on Deep Graph Representation Learningcited by 72
- 2020ASGN: An Active Semi-supervised Graph Neural Network for Molecular Property Predictioncited by 58
- 2022Let Invariant Rationale Discovery Inspire Graph Contrastive Learningcited by 57
- 2020Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systemscited by 38
- 2023A Diffusion model for POI recommendationcited by 24
- 2022GLCC: A General Framework for Graph-Level Clusteringcited by 21
- 2023TGNN: A Joint Semi-supervised Framework for Graph-level Classificationcited by 19
- 2022KGNN: Harnessing Kernel-based Networks for Semi-supervised Graph Classificationcited by 18
- 2023Dynamic Hypergraph Structure Learning for Traffic Flow Forecastingcited by 14
- 2022ChemicalX: A Deep Learning Library for Drug Pair Scoringcited by 11
- 2023Learning Graph ODE for Continuous-Time Sequential Recommendationcited by 11
- 2023Redundancy-Free Self-Supervised Relational Learning for Graph Clusteringcited by 8
- 2023RAHNet: Retrieval Augmented Hybrid Network for Long-tailed Graph Classificationcited by 7
- 2016AptRank: An Adaptive PageRank Model for Protein Function Prediction on Bi-relational Graphscited by 6
- 2017Beyond Low-Rank Representations: Orthogonal Clustering Basis Reconstruction with Optimized Graph Structure for Multi-view Spectral Clusteringcited by 6
Built on by
Citing papers per year: 2024: 1.
1 paper.