# SAIL: Self-Augmented Graph Contrastive Learning

arXiv: https://arxiv.org/abs/2009.00934 · HTML: https://mlsanity.com/paper/2009.00934/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Sep 2020.

## Built on by (most cited first, 20 of 20)

- [LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendation](https://mlsanity.com/paper/2302.08191/) (2023)
- [Cluster-guided Contrastive Graph Clustering Network](https://mlsanity.com/paper/2301.01098/) (2023)
- [Heterogeneous Graph Masked Autoencoders](https://mlsanity.com/paper/2208.09957/) (2022)
- [Knowledge Distillation on Graphs: A Survey](https://mlsanity.com/paper/2302.00219/) (2023)
- [Self-Supervised Continual Graph Learning in Adaptive Riemannian Spaces](https://mlsanity.com/paper/2211.17068/) (2022)
- [A Survey of Deep Graph Clustering: Taxonomy, Challenge, Application, and Open Resource](https://mlsanity.com/paper/2211.12875/) (2022)
- [CONVERT:Contrastive Graph Clustering with Reliable Augmentation](https://mlsanity.com/paper/2308.08963/) (2023)
- [Self-Supervised Graph Structure Refinement for Graph Neural Networks](https://mlsanity.com/paper/2211.06545/) (2022)
- [Dual Test-time Training for Out-of-distribution Recommender System](https://mlsanity.com/paper/2407.15620/) (2024)
- [Supervised Contrastive Learning with Hard Negative Samples](https://mlsanity.com/paper/2209.00078/) (2022)
- [Accelerating Molecular Graph Neural Networks via Knowledge Distillation](https://mlsanity.com/paper/2306.14818/) (2023)
- [Towards Generalizable Graph Contrastive Learning: An Information Theory Perspective](https://mlsanity.com/paper/2211.10929/) (2022)
- [Graph-based Knowledge Distillation: A survey and experimental evaluation](https://mlsanity.com/paper/2302.14643/) (2023)
- [EasyST: A Simple Framework for Spatio-Temporal Prediction](https://mlsanity.com/paper/2409.06748/) (2024)
- [EGRC-Net: Embedding-induced Graph Refinement Clustering Network](https://mlsanity.com/paper/2211.10627/) (2022)
- [How Expressive are Graph Neural Networks in Recommendation?](https://mlsanity.com/paper/2308.11127/) (2023)
- [RCoCo: Contrastive Collective Link Prediction across Multiplex Network in Riemannian Space](https://mlsanity.com/paper/2403.01864/) (2024)
- [Contrastive Graph Few-Shot Learning](https://mlsanity.com/paper/2210.00084/) (2022)
- [Hierarchical Molecular Representation Learning via Fragment-Based Self-Supervised Embedding Prediction](https://mlsanity.com/paper/2602.20344/) (2026)
- [Pruned Traffic Trees: Native Semantic Compression with a Protocol-Structured Model Family for Encrypted Traffic Classification](https://mlsanity.com/paper/2608.21874/) (2026)

## Abstract (arXiv)

This paper studies learning node representations with graph neural networks (GNNs) for unsupervised scenario. Specifically, we derive a theoretical analysis and provide an empirical demonstration about the non-steady performance of GNNs over different graph datasets, when the supervision signals are not appropriately defined. The performance of GNNs depends on both the node feature smoothness and the locality of graph structure. To smooth the discrepancy of node proximity measured by graph topology and node feature, we proposed SAIL - a novel underlineSelf-underlineAugmented graph contrastunderlineive underlineLearning framework, with two complementary self-distilling regularization modules, i.e., intra- and inter-graph knowledge distillation. We demonstrate the competitive performance of SAIL on a variety of graph applications. Even with a single GNN layer, SAIL has consistently competitive or even better performance on various benchmark datasets, comparing with state-of-the-art baselines.
