mlsanityData to 7 Oct 2026

Negative-Free Self-Supervised Gaussian Embedding of Graphs

arXiv 2411.01157 ↗First posted 2 Nov 2024cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Graph Contrastive Learning (GCL) has recently emerged as a promising graph self-supervised learning framework for learning discriminative node representations without labels. The widely adopted objective function of GCL benefits from two key properties: alignment and uniformity, which align representations of positive node pairs while uniformly distributing all representations on the hypersphere. The uniformity property plays a critical role in preventing representation collapse and is achieved by pushing apart augmented views of different nodes (negative pairs). As such, existing GCL methods inherently rely on increasing the quantity and quality of negative samples, resulting in heavy computational demands, memory overhead, and potential class collision issues. In this study, we propose a negative-free objective to achieve uniformity, inspired by the fact that points distributed according to a normalized isotropic Gaussian are uniformly spread across the unit hypersphere. Therefore, we can minimize the distance between the distribution of learned representations and the isotropic Gaussian distribution to promote the uniformity of node representations. Our method also distinguishes itself from other approaches by eliminating the need for a parameterized mutual information estimator, an additional projector, asymmetric structures, and, crucially, negative samples. Extensive experiments over seven graph benchmarks demonstrate that our proposal achieves competitive performance with fewer parameters, shorter training times, and lower memory consumption compared to existing GCL methods.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 38 of its 47 references that are in the map. First posted on arXiv 2 Nov 2024.

Builds on

38 of 47 references.

References · 38

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  4. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  5. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
  6. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  7. 2016Variational Graph Auto-Encoderscited by 1,373
  8. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  9. 2018Deep Graph Infomaxcited by 1,101
  10. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
  11. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  12. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
26 more
  1. 2020Deep Graph Contrastive Representation Learningcited by 535
  2. 2019A Theoretical Analysis of Contrastive Unsupervised Representation Learningcited by 530
  3. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  4. 2016f-GAN: Training Generative Neural Samplers using Variational Divergence Minimizationcited by 504
  5. 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 374
  6. 2021Graph Self-Supervised Learning: A Surveycited by 289
  7. 2020Whitening for Self-Supervised Representation Learningcited by 278
  8. 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 253
  9. 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
  10. 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 184
  11. 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 138
  12. 2021Augmentation-Free Self-Supervised Learning on Graphscited by 94
  13. 2021Graph Barlow Twins: A self-supervised representation learning framework for graphscited by 85
  14. 2023A Comprehensive Survey on Deep Graph Representation Learningcited by 72
  15. 2021Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learningcited by 70
  16. 2022Rethinking and Scaling Up Graph Contrastive Learning: An Extremely Efficient Approach with Group Discriminationcited by 67
  17. 2022COSTA: Covariance-Preserving Feature Augmentation for Graph Contrastive Learningcited by 38
  18. 2021Learning with Hyperspherical Uniformitycited by 35
  19. 2021Graph Communal Contrastive Learningcited by 34
  20. 2023Deep Temporal Graph Clusteringcited by 28
  21. 2023Self-Supervised Temporal Graph learning with Temporal and Structural Intensity Alignmentcited by 25
  22. 2023HomoGCL: Rethinking Homophily in Graph Contrastive Learningcited by 18
  23. 2022Relational Self-Supervised Learning on Graphscited by 11
  24. 2022Towards Generalizable Graph Contrastive Learning: An Information Theory Perspectivecited by 8
  25. 2022Graph Contrastive Learning with Implicit Augmentationscited by 7
  26. 2024Bootstrap Latents of Nodes and Neighbors for Graph Self-Supervised Learningcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.