mlsanityData to 7 Oct 2026

LAC: Graph Contrastive Learning with Learnable Augmentation in Continuous Space

arXiv 2410.15355 ↗First posted 20 Oct 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph Contrastive Learning frameworks have demonstrated success in generating high-quality node representations. The existing research on efficient data augmentation methods and ideal pretext tasks for graph contrastive learning remains limited, resulting in suboptimal node representation in the unsupervised setting. In this paper, we introduce LAC, a graph contrastive learning framework with learnable data augmentation in an orthogonal continuous space. To capture the representative information in the graph data during augmentation, we introduce a continuous view augmenter, that applies both a masked topology augmentation module and a cross-channel feature augmentation module to adaptively augment the topological information and the feature information within an orthogonal continuous space, respectively. The orthogonal nature of continuous space ensures that the augmentation process avoids dimension collapse. To enhance the effectiveness of pretext tasks, we propose an information-theoretic principle named InfoBal and introduce corresponding pretext tasks. These tasks enable the continuous view augmenter to maintain consistency in the representative information across views while maximizing diversity between views, and allow the encoder to fully utilize the representative information in the unsupervised setting. Our experimental results show that LAC significantly outperforms the state-of-the-art frameworks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 49 references that are in the map. First posted on arXiv 20 Oct 2024.

Builds on

37 of 49 references.

References · 37

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  4. 2017Deep Setscited by 1,394
  5. 2016Variational Graph Auto-Encoderscited by 1,373
  6. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  7. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  8. 2018Deep Graph Infomaxcited by 1,101
  9. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  10. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  11. 2020On Layer Normalization in the Transformer Architecturecited by 906
  12. 2020What Makes for Good Views for Contrastive Learning?cited by 843
25 more
  1. 2020Geom-GCN: Geometric Graph Convolutional Networkscited by 821
  2. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
  3. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  4. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
  5. 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 374
  6. 2021Graph Contrastive Learning Automatedcited by 287
  7. 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
  8. 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 184
  9. 2020Graph Information Bottleneckcited by 168
  10. 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 138
  11. 2023Specformer: Spectral Graph Neural Networks Meet Transformerscited by 102
  12. 2021Mining Latent Structures for Multimedia Recommendationcited by 79
  13. 2021AutoGCL: Automated Graph Contrastive Learning via Learnable View Generatorscited by 73
  14. 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
  15. 2021Generative and Contrastive Self-Supervised Learning for Graph Anomaly Detectioncited by 67
  16. 2021GRCN: Graph-Refined Convolutional Network for Multimedia Recommendation with Implicit Feedbackcited by 58
  17. 2022Graph Anomaly Detection via Multi-Scale Contrastive Learning Networks with Augmented Viewcited by 54
  18. 2022A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendationcited by 53
  19. 2022Spectral Feature Augmentation for Graph Contrastive Learning and Beyondcited by 49
  20. 2022Revisiting Graph Contrastive Learning from the Perspective of Graph Spectrumcited by 43
  21. 2022Spectral Augmentation for Self-Supervised Learning on Graphscited by 38
  22. 2022Bringing Your Own View: Graph Contrastive Learning without Prefabricated Data Augmentationscited by 28
  23. 2023Neighbor Contrastive Learning on Learnable Graph Augmentationcited by 25
  24. 2021Graph Contrastive Learning for Anomaly Detectioncited by 22
  25. 2022Graph Contrastive Learning with Personalized Augmentationcited by 14

Built on by

Not cited yet.