mlsanityData to 7 Oct 2026

Rethinking and Simplifying Bootstrapped Graph Latents

arXiv 2312.02619 ↗First posted 5 Dec 2023cs.LGcited by 10

On the map: Synthetic data and self-improvement for LLMs → Synthetic reasoning data and bootstrapping

Abstract (arXiv)

Graph contrastive learning (GCL) has emerged as a representative paradigm in graph self-supervised learning, where negative samples are commonly regarded as the key to preventing model collapse and producing distinguishable representations. Recent studies have shown that GCL without negative samples can achieve state-of-the-art performance as well as scalability improvement, with bootstrapped graph latent (BGRL) as a prominent step forward. However, BGRL relies on a complex architecture to maintain the ability to scatter representations, and the underlying mechanisms enabling the success remain largely unexplored. In this paper, we introduce an instance-level decorrelation perspective to tackle the aforementioned issue and leverage it as a springboard to reveal the potential unnecessary model complexity within BGRL. Based on our findings, we present SGCL, a simple yet effective GCL framework that utilizes the outputs from two consecutive iterations as positive pairs, eliminating the negative samples. SGCL only requires a single graph augmentation and a single graph encoder without additional parameters. Extensive experiments conducted on various graph benchmarks demonstrate that SGCL can achieve competitive performance with fewer parameters, lower time and space costs, and significant convergence speedup.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Synthetic reasoning data and bootstrapping, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 31 of its 40 references that are in the map. First posted on arXiv 5 Dec 2023.

Builds on

31 of 40 references.

References · 31

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2017Graph Attention Networkscited by 8,854
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  6. 2017Inductive Representation Learning on Large Graphscited by 6,284
  7. 2016Layer Normalizationcited by 5,579
  8. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  9. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  10. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  11. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  12. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
19 more
  1. 2019Simplifying Graph Convolutional Networkscited by 1,470
  2. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  3. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  4. 2018Deep Graph Infomaxcited by 1,101
  5. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  6. 2020Contrastive Multi-View Representation Learning on Graphscited by 651
  7. 2020Deep Graph Contrastive Representation Learningcited by 535
  8. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  9. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  10. 2020Self-supervised Graph Learning for Recommendationcited by 305
  11. 2021Graph Self-Supervised Learning: A Surveycited by 289
  12. 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
  13. 2021Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillationcited by 151
  14. 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 138
  15. 2021Augmentation-Free Self-Supervised Learning on Graphscited by 94
  16. 2018An analytic theory of generalization dynamics and transfer learning in deep linear networkscited by 84
  17. 2020Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendationcited by 75
  18. 2022COSTA: Covariance-Preserving Feature Augmentation for Graph Contrastive Learningcited by 38
  19. 2022Self-Supervised Representation Learning via Latent Graph Predictioncited by 22

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 4; 2026: 1.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Graph Self-Contrast Representation Learning
  2. 2025Simple Graph Contrastive Learning via Fractional-order Neural Diffusion Networks
  3. 2026GCCM: Enhancing Generative Graph Prediction via Contrastive Consistency Model
  4. 2025Are LLMs Better GNN Helpers? Rethinking Robust Graph Learning under Deficiencies with Iterative Refinement
  5. 2024Unifying Generation and Prediction on Graphs with Latent Graph Diffusion
  6. 2024Bootstrapping Heterogeneous Graph Representation Learning via Large Language Models: A Generalized Approach
  7. 2025Generalizable LLM Learning of Graph Synthetic Data with Post-training Alignment
  8. 2024GraphEdit: Large Language Models for Graph Structure Learning