GIMM: InfoMin-Max for Automated Graph Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Graph contrastive learning (GCL) shows great potential in unsupervised graph representation learning. Data augmentation plays a vital role in GCL, and its optimal choice heavily depends on the downstream task. Many GCL methods with automated data augmentation face the risk of insufficient information as they fail to preserve the essential information necessary for the downstream task. To solve this problem, we propose InfoMin-Max for automated Graph contrastive learning (GIMM), which prevents GCL from encoding redundant information and losing essential information. GIMM consists of two major modules: (1) automated graph view generator, which acquires the approximation of InfoMin's optimal views through adversarial training without requiring task-relevant information; (2) view comparison, which learns an excellent encoder by applying InfoMax to view representations. To the best of our knowledge, GIMM is the first method that combines the InfoMin and InfoMax principles in GCL. Besides, GIMM introduces randomness to augmentation, thus stabilizing the model against perturbations. Extensive experiments on unsupervised and semi-supervised learning for node and graph classification demonstrate the superiority of our GIMM over state-of-the-art GCL methods with automated and manual data augmentation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 57 references that are in the map. First posted on arXiv 27 May 2023.
Builds on
38 of 57 references.
References · 38
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
- 2018Deep Graph Infomaxcited by 1,101
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2016Deep Variational Information Bottleneckcited by 915
26 more
- 2020What Makes for Good Views for Contrastive Learning?cited by 843
- 2018Link Prediction Based on Graph Neural Networkscited by 829
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2019On Mutual Information Maximization for Representation Learningcited by 315
- 2021Graph Contrastive Learning Automatedcited by 287
- 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 253
- 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
- 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
- 2022G-Mixup: Graph Data Augmentation for Graph Classificationcited by 145
- 2022Data Augmentation for Deep Graph Learning: A Surveycited by 132
- 2020When Does Self-Supervision Help Graph Convolutional Networks?cited by 121
- 2019Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learningcited by 94
- 2019Graph Adversarial Training: Dynamically Regularizing Based on Graph Structurecited by 93
- 2021Multi-view Contrastive Graph Clusteringcited by 76
- 2021AutoGCL: Automated Graph Contrastive Learning via Learnable View Generatorscited by 73
- 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
- 2020The Information Bottleneck Problem and Its Applications in Machine Learningcited by 66
- 2020Graph InfoClust: Leveraging cluster-level node information for unsupervised graph representation learningcited by 35
- 2021Graph Transplant: Node Saliency-Guided Graph Mixup with Local Structure Preservationcited by 30
- 2019GAP: Generalizable Approximate Graph Partitioning Frameworkcited by 18
- 2020Node Masking: Making Graph Neural Networks Generalize and Scale Bettercited by 7
- 2020Interferometric Graph Transform: a Deep Unsupervised Graph Representationcited by 3
Built on by
Not cited yet.