LAC: Graph Contrastive Learning with Learnable Augmentation in Continuous Space
Not on the map. Why?
Abstract (arXiv)
Graph Contrastive Learning frameworks have demonstrated success in generating high-quality node representations. The existing research on efficient data augmentation methods and ideal pretext tasks for graph contrastive learning remains limited, resulting in suboptimal node representation in the unsupervised setting. In this paper, we introduce LAC, a graph contrastive learning framework with learnable data augmentation in an orthogonal continuous space. To capture the representative information in the graph data during augmentation, we introduce a continuous view augmenter, that applies both a masked topology augmentation module and a cross-channel feature augmentation module to adaptively augment the topological information and the feature information within an orthogonal continuous space, respectively. The orthogonal nature of continuous space ensures that the augmentation process avoids dimension collapse. To enhance the effectiveness of pretext tasks, we propose an information-theoretic principle named InfoBal and introduce corresponding pretext tasks. These tasks enable the continuous view augmenter to maintain consistency in the representative information across views while maximizing diversity between views, and allow the encoder to fully utilize the representative information in the unsupervised setting. Our experimental results show that LAC significantly outperforms the state-of-the-art frameworks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 49 references that are in the map. First posted on arXiv 20 Oct 2024.
Builds on
37 of 49 references.
References · 37
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2017Deep Setscited by 1,394
- 2016Variational Graph Auto-Encoderscited by 1,373
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2020What Makes for Good Views for Contrastive Learning?cited by 843
25 more
- 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
- 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 374
- 2021Graph Contrastive Learning Automatedcited by 287
- 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
- 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 184
- 2020Graph Information Bottleneckcited by 168
- 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 138
- 2023Specformer: Spectral Graph Neural Networks Meet Transformerscited by 102
- 2021Mining Latent Structures for Multimedia Recommendationcited by 79
- 2021AutoGCL: Automated Graph Contrastive Learning via Learnable View Generatorscited by 73
- 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
- 2021Generative and Contrastive Self-Supervised Learning for Graph Anomaly Detectioncited by 67
- 2021GRCN: Graph-Refined Convolutional Network for Multimedia Recommendation with Implicit Feedbackcited by 58
- 2022Graph Anomaly Detection via Multi-Scale Contrastive Learning Networks with Augmented Viewcited by 54
- 2022A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendationcited by 53
- 2022Spectral Feature Augmentation for Graph Contrastive Learning and Beyondcited by 49
- 2022Revisiting Graph Contrastive Learning from the Perspective of Graph Spectrumcited by 43
- 2022Spectral Augmentation for Self-Supervised Learning on Graphscited by 38
- 2022Bringing Your Own View: Graph Contrastive Learning without Prefabricated Data Augmentationscited by 28
- 2023Neighbor Contrastive Learning on Learnable Graph Augmentationcited by 25
- 2021Graph Contrastive Learning for Anomaly Detectioncited by 22
- 2022Graph Contrastive Learning with Personalized Augmentationcited by 14
Built on by
Not cited yet.