FastGCL: Fast Self-Supervised Learning on Graphs via Contrastive Neighborhood Aggregation
Not on the map. Why?
Abstract (arXiv)
Graph contrastive learning (GCL), as a popular approach to graph self-supervised learning, has recently achieved a non-negligible effect. To achieve superior performance, the majority of existing GCL methods elaborate on graph data augmentation to construct appropriate contrastive pairs. However, existing methods place more emphasis on the complex graph data augmentation which requires extra time overhead, and pay less attention to developing contrastive schemes specific to encoder characteristics. We argue that a better contrastive scheme should be tailored to the characteristics of graph neural networks (e.g., neighborhood aggregation) and propose a simple yet effective method named FastGCL. Specifically, by constructing weighted-aggregated and non-aggregated neighborhood information as positive and negative samples respectively, FastGCL identifies the potential semantic information of data without disturbing the graph topology and node attributes, resulting in faster training and convergence speeds. Extensive experiments have been conducted on node classification and graph classification tasks, showing that FastGCL has competitive classification performance and significant training speedup compared to existing state-of-the-art methods.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 27 references that are in the map. First posted on arXiv 2 May 2022.
Builds on
21 of 27 references.
References · 21
- 2017Graph Attention Networkscited by 8,854
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2019A Theoretical Analysis of Contrastive Unsupervised Representation Learningcited by 530
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
9 more
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 253
- 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
- 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
- 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 184
- 2020Graph Information Bottleneckcited by 168
- 2021Self-supervised Learning on Graphs: Contrastive, Generative,or Predictivecited by 136
- 2021Augmentation-Free Self-Supervised Learning on Graphscited by 94
- 2021Graph Barlow Twins: A self-supervised representation learning framework for graphscited by 85
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1.
2 papers.