mlsanityData to 7 Oct 2026

GIMM: InfoMin-Max for Automated Graph Contrastive Learning

arXiv 2305.17437 ↗First posted 27 May 2023cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph contrastive learning (GCL) shows great potential in unsupervised graph representation learning. Data augmentation plays a vital role in GCL, and its optimal choice heavily depends on the downstream task. Many GCL methods with automated data augmentation face the risk of insufficient information as they fail to preserve the essential information necessary for the downstream task. To solve this problem, we propose InfoMin-Max for automated Graph contrastive learning (GIMM), which prevents GCL from encoding redundant information and losing essential information. GIMM consists of two major modules: (1) automated graph view generator, which acquires the approximation of InfoMin's optimal views through adversarial training without requiring task-relevant information; (2) view comparison, which learns an excellent encoder by applying InfoMax to view representations. To the best of our knowledge, GIMM is the first method that combines the InfoMin and InfoMax principles in GCL. Besides, GIMM introduces randomness to augmentation, thus stabilizing the model against perturbations. Extensive experiments on unsupervised and semi-supervised learning for node and graph classification demonstrate the superiority of our GIMM over state-of-the-art GCL methods with automated and manual data augmentation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 57 references that are in the map. First posted on arXiv 27 May 2023.

Builds on

38 of 57 references.

References · 38

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2018How Powerful are Graph Neural Networks?cited by 4,355
  5. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  6. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
  7. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  8. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  9. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
  10. 2018Deep Graph Infomaxcited by 1,101
  11. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  12. 2016Deep Variational Information Bottleneckcited by 915
26 more
  1. 2020What Makes for Good Views for Contrastive Learning?cited by 843
  2. 2018Link Prediction Based on Graph Neural Networkscited by 829
  3. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
  4. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
  5. 2020Deep Graph Contrastive Representation Learningcited by 535
  6. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  7. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  8. 2019On Mutual Information Maximization for Representation Learningcited by 315
  9. 2021Graph Contrastive Learning Automatedcited by 287
  10. 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 253
  11. 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
  12. 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
  13. 2022G-Mixup: Graph Data Augmentation for Graph Classificationcited by 145
  14. 2022Data Augmentation for Deep Graph Learning: A Surveycited by 132
  15. 2020When Does Self-Supervision Help Graph Convolutional Networks?cited by 121
  16. 2019Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learningcited by 94
  17. 2019Graph Adversarial Training: Dynamically Regularizing Based on Graph Structurecited by 93
  18. 2021Multi-view Contrastive Graph Clusteringcited by 76
  19. 2021AutoGCL: Automated Graph Contrastive Learning via Learnable View Generatorscited by 73
  20. 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
  21. 2020The Information Bottleneck Problem and Its Applications in Machine Learningcited by 66
  22. 2020Graph InfoClust: Leveraging cluster-level node information for unsupervised graph representation learningcited by 35
  23. 2021Graph Transplant: Node Saliency-Guided Graph Mixup with Local Structure Preservationcited by 30
  24. 2019GAP: Generalizable Approximate Graph Partitioning Frameworkcited by 18
  25. 2020Node Masking: Making Graph Neural Networks Generalize and Scale Bettercited by 7
  26. 2020Interferometric Graph Transform: a Deep Unsupervised Graph Representationcited by 3

Built on by

Not cited yet.