Rethinking and Simplifying Bootstrapped Graph Latents
On the map: Synthetic data and self-improvement for LLMs → Synthetic reasoning data and bootstrapping
Abstract (arXiv)
Graph contrastive learning (GCL) has emerged as a representative paradigm in graph self-supervised learning, where negative samples are commonly regarded as the key to preventing model collapse and producing distinguishable representations. Recent studies have shown that GCL without negative samples can achieve state-of-the-art performance as well as scalability improvement, with bootstrapped graph latent (BGRL) as a prominent step forward. However, BGRL relies on a complex architecture to maintain the ability to scatter representations, and the underlying mechanisms enabling the success remain largely unexplored. In this paper, we introduce an instance-level decorrelation perspective to tackle the aforementioned issue and leverage it as a springboard to reveal the potential unnecessary model complexity within BGRL. Based on our findings, we present SGCL, a simple yet effective GCL framework that utilizes the outputs from two consecutive iterations as positive pairs, eliminating the negative samples. SGCL only requires a single graph augmentation and a single graph encoder without additional parameters. Extensive experiments conducted on various graph benchmarks demonstrate that SGCL can achieve competitive performance with fewer parameters, lower time and space costs, and significant convergence speedup.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Synthetic reasoning data and bootstrapping, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 31 of its 40 references that are in the map. First posted on arXiv 5 Dec 2023.
Builds on
31 of 40 references.
References · 31
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2017Graph Attention Networkscited by 8,854
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2016Layer Normalizationcited by 5,579
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
19 more
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2018Deep Graph Infomaxcited by 1,101
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
- 2020Self-supervised Graph Learning for Recommendationcited by 305
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
- 2021Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillationcited by 151
- 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 138
- 2021Augmentation-Free Self-Supervised Learning on Graphscited by 94
- 2018An analytic theory of generalization dynamics and transfer learning in deep linear networkscited by 84
- 2020Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendationcited by 75
- 2022COSTA: Covariance-Preserving Feature Augmentation for Graph Contrastive Learningcited by 38
- 2022Self-Supervised Representation Learning via Latent Graph Predictioncited by 22
Built on by
Citing papers per year: 2024: 5; 2025: 4; 2026: 1.
10 papers.
- 2024Revisiting Modularity Maximization for Graph Clustering: A Contrastive Learning Perspectivecited by 18
- 2025One Prompt Fits All: Universal Graph Adaptation for Pretrained Modelscited by 11
- 2024A Survey on Self-Supervised Graph Foundation Models: Knowledge-Based Perspectivecited by 9
- 2024Bootstrap Latents of Nodes and Neighbors for Graph Self-Supervised Learningcited by 6
- 2025Diffusion on Graph: Augmentation of Graph Structure for Node Classificationcited by 4
- 2025Str-GCL: Structural Commonsense Driven Graph Contrastive Learningcited by 3
- 2024Revisiting Graph Autoencoders as Implicit Contrastive Learnerscited by 1
- 2025Transferable Parasitic Estimation via Graph Contrastive Learning and Label Rebalancing in AMS Circuitscited by 1
- 2024CYCLE: Cross-Year Contrastive Learning in Entity-Linkingcited by 0
- 2026Unified Graph Prompt Learning via Low-Rank Graph Message Promptingcited by 0
- 2026Unified Graph Prompt Learning via Low-Rank Graph Message Prompting13 Apr 2026
- 2025One Prompt Fits All: Universal Graph Adaptation for Pretrained Models26 Sep 2025
- 2025Str-GCL: Structural Commonsense Driven Graph Contrastive Learning9 Jul 2025
- 2025Transferable Parasitic Estimation via Graph Contrastive Learning and Label Rebalancing in AMS Circuits9 Jul 2025
- 2025Diffusion on Graph: Augmentation of Graph Structure for Node Classification16 Mar 2025
- 2024Revisiting Graph Autoencoders as Implicit Contrastive Learners14 Oct 2024
- 2024CYCLE: Cross-Year Contrastive Learning in Entity-Linking11 Oct 2024
- 2024Bootstrap Latents of Nodes and Neighbors for Graph Self-Supervised Learning9 Aug 2024
- 2024Revisiting Modularity Maximization for Graph Clustering: A Contrastive Learning Perspective20 Jun 2024
- 2024A Survey on Self-Supervised Graph Foundation Models: Knowledge-Based Perspective24 Mar 2024
Similar, not cited
Close in wording, no citation either way
- 2023Graph Self-Contrast Representation Learning
- 2025Simple Graph Contrastive Learning via Fractional-order Neural Diffusion Networks
- 2026GCCM: Enhancing Generative Graph Prediction via Contrastive Consistency Model
- 2025Are LLMs Better GNN Helpers? Rethinking Robust Graph Learning under Deficiencies with Iterative Refinement
- 2024Unifying Generation and Prediction on Graphs with Latent Graph Diffusion
- 2024Bootstrapping Heterogeneous Graph Representation Learning via Large Language Models: A Generalized Approach
- 2025Generalizable LLM Learning of Graph Synthetic Data with Post-training Alignment
- 2024GraphEdit: Large Language Models for Graph Structure Learning