C-SAW: A Framework for Graph Sampling and Random Walk on GPUs
Not on the map. Why?
Abstract (arXiv)
Many applications require to learn, mine, analyze and visualize large-scale graphs. These graphs are often too large to be addressed efficiently using conventional graph processing technologies. Many applications have requirements to analyze, transform, visualize and learn large scale graphs. These graphs are often too large to be addressed efficiently using conventional graph processing technologies. Recent literatures convey that graph sampling/random walk could be an efficient solution. In this paper, we propose, to the best of our knowledge, the first GPU-based framework for graph sampling/random walk. First, our framework provides a generic API which allows users to implement a wide range of sampling and random walk algorithms with ease. Second, offloading this framework on GPU, we introduce warp-centric parallel selection, and two optimizations for collision migration. Third, towards supporting graphs that exceed GPU memory capacity, we introduce efficient data transfer optimizations for out-of-memory sampling, such as workload-aware scheduling and batched multi-instance sampling. In its entirety, our framework constantly outperforms the state-of-the-art projects. First, our framework provides a generic API which allows users to implement a wide range of sampling and random walk algorithms with ease. Second, offloading this framework on GPU, we introduce warp-centric parallel selection, and two novel optimizations for collision migration. Third, towards supporting graphs that exceed the GPU memory capacity, we introduce efficient data transfer optimizations for out-of-memory and multi-GPU sampling, such as workload-aware scheduling and batched multi-instance sampling. Taken together, our framework constantly outperforms the state of the art projects in addition to the capability of supporting a wide range of sampling and random walk algorithms.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 4; 2024: 4; 2025: 0; 2026: 1.
13 papers.
Sort:
- 2021BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessingcited by 50
- 2022Distributed Graph Neural Network Training: A Surveycited by 32
- 2021Scalable Graph Neural Network Training: The Case for Samplingcited by 11
- 2024Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batchcited by 10
- 2023GSplit: Scaling Graph Neural Network Training on Large Graphs via Split-Parallelismcited by 6
- 2023Distributed Matrix-Based Sampling for Graph Neural Network Trainingcited by 6
- 2023GNNFlow: A Distributed Framework for Continuous Temporal GNN Learning on Dynamic Graphscited by 5
- 2023Tango: rethinking quantization for graph neural network training on GPUscited by 4
- 2022Mining User-aware Multi-relations for Fake News Detection in Large Scale Online Social Networkscited by 3
- 2024FastGL: A GPU-Efficient Framework for Accelerating Sampling-Based GNN Training at Large Scalecited by 3
- 2024TASER: Temporal Adaptive Sampling for Fast and Accurate Dynamic Graph Representation Learningcited by 2
- 2024Towards Ideal Temporal Graph Neural Networks: Evaluations and Conclusions after 10,000 GPU Hourscited by 2
1 more
- 2026NOMAD: Generating Embeddings for Massive Distributed Graphs10 Apr 2026
- 2024Towards Ideal Temporal Graph Neural Networks: Evaluations and Conclusions after 10,000 GPU Hours28 Dec 2024
- 2024FastGL: A GPU-Efficient Framework for Accelerating Sampling-Based GNN Training at Large Scale23 Sep 2024
- 2024Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch1 Jun 2024
- 2024TASER: Temporal Adaptive Sampling for Fast and Accurate Dynamic Graph Representation Learning8 Feb 2024
- 2023GNNFlow: A Distributed Framework for Continuous Temporal GNN Learning on Dynamic Graphs29 Nov 2023
- 2023Distributed Matrix-Based Sampling for Graph Neural Network Training6 Nov 2023
- 2023Tango: rethinking quantization for graph neural network training on GPUs2 Aug 2023
- 2023GSplit: Scaling Graph Neural Network Training on Large Graphs via Split-Parallelism24 Mar 2023
- 2022Mining User-aware Multi-relations for Fake News Detection in Large Scale Online Social Networks21 Dec 2022
- 2022Distributed Graph Neural Network Training: A Survey1 Nov 2022
- 2021BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessing16 Dec 2021
1 more
- 2021BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessingcited by 50
- 2022Distributed Graph Neural Network Training: A Surveycited by 32
- 2021Scalable Graph Neural Network Training: The Case for Samplingcited by 11
- 2024Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batchcited by 10
- 2023GSplit: Scaling Graph Neural Network Training on Large Graphs via Split-Parallelismcited by 6
- 2023Distributed Matrix-Based Sampling for Graph Neural Network Trainingcited by 6
- 2023GNNFlow: A Distributed Framework for Continuous Temporal GNN Learning on Dynamic Graphscited by 5
- 2023Tango: rethinking quantization for graph neural network training on GPUscited by 4
- 2022Mining User-aware Multi-relations for Fake News Detection in Large Scale Online Social Networkscited by 3
- 2024FastGL: A GPU-Efficient Framework for Accelerating Sampling-Based GNN Training at Large Scalecited by 3
- 2024TASER: Temporal Adaptive Sampling for Fast and Accurate Dynamic Graph Representation Learningcited by 2
- 2024Towards Ideal Temporal Graph Neural Networks: Evaluations and Conclusions after 10,000 GPU Hourscited by 2
12 most cited of 13 All 13 (JSON)
- 2026NOMAD: Generating Embeddings for Massive Distributed Graphs10 Apr 2026
- 2024Towards Ideal Temporal Graph Neural Networks: Evaluations and Conclusions after 10,000 GPU Hours28 Dec 2024
- 2024FastGL: A GPU-Efficient Framework for Accelerating Sampling-Based GNN Training at Large Scale23 Sep 2024
- 2024Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch1 Jun 2024
- 2024TASER: Temporal Adaptive Sampling for Fast and Accurate Dynamic Graph Representation Learning8 Feb 2024
- 2023GNNFlow: A Distributed Framework for Continuous Temporal GNN Learning on Dynamic Graphs29 Nov 2023
- 2023Distributed Matrix-Based Sampling for Graph Neural Network Training6 Nov 2023
- 2023Tango: rethinking quantization for graph neural network training on GPUs2 Aug 2023
- 2023GSplit: Scaling Graph Neural Network Training on Large Graphs via Split-Parallelism24 Mar 2023
- 2022Mining User-aware Multi-relations for Fake News Detection in Large Scale Online Social Networks21 Dec 2022
- 2022Distributed Graph Neural Network Training: A Survey1 Nov 2022
- 2021BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessing16 Dec 2021
12 newest of 13 All 13 (JSON)