CGCL: Collaborative Graph Contrastive Learning without Handcrafted Graph Data Augmentations
Not on the map. Why?
Abstract (arXiv)
Unsupervised graph representation learning is a non-trivial topic. The success of contrastive methods in the unsupervised representation learning on structured data inspires similar attempts on the graph. Existing graph contrastive learning (GCL) aims to learn the invariance across multiple augmentation views, which renders it heavily reliant on the handcrafted graph augmentations. However, inappropriate graph data augmentations can potentially jeopardize such invariance. In this paper, we show the potential hazards of inappropriate augmentations and then propose a novel Collaborative Graph Contrastive Learning framework (CGCL). This framework harnesses multiple graph encoders to observe the graph. Features observed from different encoders serve as the contrastive views in contrastive learning, which avoids inducing unstable perturbation and guarantees the invariance. To ensure the collaboration among diverse graph encoders, we propose the concepts of asymmetric architecture and complementary encoders as the design principle. To further prove the rationality, we utilize two quantitative metrics to measure the assembly of CGCL respectively. Extensive experiments demonstrate the advantages of CGCL in unsupervised graph-level representation learning and the potential of collaborative framework. The source code for reproducibility is available at https://github.com/zhangtia16/CGCL
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 39 references that are in the map. First posted on arXiv 5 Nov 2021.
Builds on
26 of 39 references.
References · 26
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
14 more
- 2018Deep Graph Infomaxcited by 1,101
- 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2015Order Matters: Sequence to sequence for setscited by 236
- 2017graph2vec: Learning Distributed Representations of Graphscited by 228
- 2020What Should Not Be Contrastive in Contrastive Learningcited by 224
- 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
- 2019Graph Representation Learning: A Surveycited by 75
- 2020Graph Neural Networks: Taxonomy, Advances and Trendscited by 48
- 2020Affinity and Diversity: Quantifying Mechanisms of Data Augmentationcited by 45
- 2019Heterogeneous Deep Graph Infomaxcited by 42
- 2021Adversarial Active Learning based Heterogeneous Graph Neural Network for Fake News Detectioncited by 21
- 2021Label Contrastive Coding based Graph Neural Network for Graph Classificationcited by 10
Built on by
Citing papers per year: 2025: 1.
1 paper.