GraphSAINT: Graph Sampling Based Inductive Learning Method
Not on the map. Why?
Abstract (arXiv)
Graph Convolutional Networks (GCNs) are powerful models for learning representations of attributed graphs. To scale GCNs to large graphs, state-of-the-art methods use various layer sampling techniques to alleviate the "neighbor explosion" problem during minibatch training. We propose GraphSAINT, a graph sampling based inductive learning method that improves training efficiency and accuracy in a fundamentally different way. By changing perspective, GraphSAINT constructs minibatches by sampling the training graph, rather than the nodes or edges across GCN layers. Each iteration, a complete GCN is built from the properly sampled subgraph. Thus, we ensure fixed number of well-connected nodes in all layers. We further propose normalization technique to eliminate bias, and sampling algorithms for variance reduction. Importantly, we can decouple the sampling from the forward and backward propagation, and extend GraphSAINT with many architecture variants (e.g., graph attention, jumping connection). GraphSAINT demonstrates superior performance in both accuracy and training time on five large graphs, and achieves new state-of-the-art F1 scores for PPI (0.995) and Reddit (0.970).
Key facts. Cited by 618 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 104; 2022: 139; 2023: 124; 2024: 111; 2025: 80; 2026: 60.
618 papers.
Sort:
By area:
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2021OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphscited by 329
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
- 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 210
- 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
- 2021Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learningcited by 177
- 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
- 2021Training Graph Neural Networks with 1000 Layerscited by 169
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021Graph Condensation for Graph Neural Networkscited by 150
- 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 141
- 2021Graph Unlearningcited by 138
38 more
- 2021Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Predictioncited by 138
- 2022NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphscited by 137
- 2022Data Augmentation for Deep Graph Learning: A Surveycited by 133
- 2023SGFormer: Simplifying and Empowering Transformers for Large-Graph Representationscited by 133
- 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 132
- 2023Similarity of Neural Network Models: A Survey of Functional and Representational Measurescited by 131
- 2021You are AllSet: A Multiset Function Framework for Hypergraph Neural Networkscited by 127
- 2022How to Find Your Friendly Neighborhood: Graph Attention Design with Self-Supervisioncited by 102
- 2022Condensing Graphs via One-Step Gradient Matchingcited by 100
- 2022Decoupling the Depth and Scope of Graph Neural Networkscited by 94
- 2021GNNAutoScale: Scalable and Expressive Graph Neural Networks via Historical Embeddingscited by 90
- 2022Trustworthy Graph Neural Networks: Aspects, Methods and Trendscited by 89
- 2023DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusioncited by 87
- 2024Position: Graph Foundation Models are Already Herecited by 86
- 2022Graph Attention Multi-Layer Perceptroncited by 83
- 2021Graph Representation Learning in Biomedicinecited by 80
- 2021Scaling Up Graph Neural Networks Via Graph Coarseningcited by 80
- 2022BOND: Benchmarking Unsupervised Outlier Node Detection on Static Attributed Graphscited by 80
- 2023SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learningcited by 73
- 2021ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learningcited by 72
- 2023Structure-free Graph Condensation: From Large-scale Graphs to Condensed Graph-free Datacited by 71
- 2022A Survey on Graph Representation Learning Methodscited by 66
- 2021LinkTeller: Recovering Private Edges from Graph Neural Networks via Influence Analysiscited by 65
- 2022Learning to Reconstruct Missing Data from Spatiotemporal Graphs with Sparse Observationscited by 64
- 2021Gophormer: Ego-Graph Transformer for Node Classificationcited by 63
- 2022Understanding and Improving Graph Injection Attack by Promoting Unnoticeabilitycited by 62
- 2022Graph Condensation via Receptive Field Distribution Matchingcited by 60
- 2022Characterizing Graph Datasets for Node Classification: Homophily-Heterophily Dichotomy and Beyondcited by 60
- 2021Dissecting the Diffusion Process in Linear Graph Convolutional Networkscited by 58
- 2022A Comprehensive Study on Large-Scale Graph Training: Benchmarking and Rethinkingcited by 56
- 2021Graph Coarsening with Neural Networkscited by 55
- 2021Scalable and Adaptive Graph Neural Networks with Self-Label-Enhanced trainingcited by 54
- 2022Neighborhood-aware Scalable Temporal Network Representation Learningcited by 54
- 2025Position: Graph Learning Will Lose Relevance Due To Poor Benchmarkscited by 53
- 2022Scalable Spatiotemporal Graph Neural Networkscited by 52
- 2025PyG 2.0: Scalable Learning on Real World Graphscited by 52
- 2021BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessingcited by 50
- 2022A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphscited by 49
50 most cited of 618 All 618 (JSON)
- 2026NodeGround: A Node Classification Benchmark in the Graph Foundation Model Era30 Sep 2026
- 2026Message Passing Does More with Less for In-Context Learning on Graphs29 Sep 2026
- 2026Spectral Reversal: Counteracting Singular Value Bias for Graph Prompting26 Sep 2026
- 2026Scaffold: Support Graph Theory Based Sparsification for Graph Neural Networks25 Sep 2026
- 2026Moment-guided edge sampling24 Sep 2026
- 2026Scalable Subgraph Sampling via Resistance Curvature23 Sep 2026
- 2026QUARTET: Quad-branch cross-Attention and Random-walk Traces for Enhancing Transformers on Relational Graphs22 Sep 2026
- 2026GraphFAS: A Distributed System for Automated Graph Feature Generation and Selection in Industrial Transaction Networks8 Sep 2026
- 2026Rethinking Message Passing as Retrieval for Text-Attributed Graph Learning27 Aug 2026
- 2026Two-level domain-decomposition AdaGrad method for scalable training of graph neural networks23 Aug 2026
- 2026Self-Supervised Graph Representation Learning for In-The-Wild Wearable and Smartphone based Emotion Recognition23 Aug 2026
- 2026FinFraudBench: A Heterogeneous Graph Benchmark for Financial Fraud Detection15 Aug 2026
38 more
- 2026LGNNIC: Acceleration of Large-Scale GNN Training using SmartNICs7 Aug 2026
- 2026Edge Sparsification via Temporal Forman-Ricci Curvature for Dynamic Graph Learning7 Aug 2026
- 2026CoRe-GNN: Multilevel Message passing on Coarsened graphs3 Aug 2026
- 2026Towards Multi-Label Graph Foundation Models: from Single-Vector Representation Learning to Multi-Semantic Basis Learning31 Jul 2026
- 2026Train Small, Deploy Large: Zero-Shot GNN Transfer Through Geometric Renormalization30 Jul 2026
- 2026FedLSG: LLM-Enhanced Semantic Calibration for Federated Graph Backdoor Defense22 Jul 2026
- 2026One Model, Many Graphs: Learning over Attributed Graphs across Heterogeneous Modalities with Vision-Language Models21 Jul 2026
- 2026CA-DGCL: Dynamic Graph Continual Learning via Condensation and Attachment13 Jul 2026
- 2026Heterogeneous Graph Condensation via Role-Aware Clustering3 Jul 2026
- 2026Boundary Embedding Shaping with Adaptive Contrastive Learning for Graph Structural Disentanglement18 Jun 2026
- 2026Multimodal Graph Negative Learning11 Jun 2026
- 2026RADE: Random Add-Drop Edge as a Regularizer30 May 2026
- 2026Incorporating Deep Learning Design in Database Queries22 May 2026
- 2026SeedER: Seed-Expand-Retrieve for Efficient Knowledge Graph Retrieval22 May 2026
- 2026Learning over Positive and Negative Edges with Contrastive Message Passing18 May 2026
- 2026Position: Graph Condensation Needs a Reset -- Move Beyond Full-dataset Training and Model-Dependence17 May 2026
- 2026OgBench: A Framework for Evaluating Graph Neural Networks on Omics Data15 May 2026
- 2026Hierarchical Attention-based Graph Neural Network with Relevance-driven Pruning10 May 2026
- 2026Structure-Centric Graph Foundation Model via Geometric Bases9 May 2026
- 2026Attention-based graph neural networks: a survey9 May 2026
- 2026Trapping Attacker in Dilemma: Examining Internal Correlations and External Influences of Trigger for Defending GNN Backdoors8 May 2026
- 2026Rethinking Multi-Label Node Classification: Do Tuned Classic GNNs Suffice?2 May 2026
- 2026TypeBandit: Type-Level Context Allocation and Reweighting for Effective Attribute Completion in Heterogeneous Graph Neural Networks30 Apr 2026
- 2026Leveraging LLM-GNN Integration for Open-World Question Answering over Knowledge Graphs15 Apr 2026
- 2026Unified Graph Prompt Learning via Low-Rank Graph Message Prompting13 Apr 2026
- 2026Neighbourhood Transformer: Switchable Attention for Monophily-Aware Graph Learning10 Apr 2026
- 2026A Cross-graph Tuning-free GNN Prompting Framework1 Apr 2026
- 2026Sparse-by-Design Cross-Modality Prediction: L0-Gated Representations for Reliable and Efficient Learning26 Mar 2026
- 2026Attack by Unlearning: Unlearning-Induced Adversarial Attacks on Graph Neural Networks19 Mar 2026
- 2026GIST: Gauge-Invariant Spectral Transformers for Scalable Graph Neural Operators17 Mar 2026
- 2026Poisoning the Inner Prediction Logic of Graph Neural Networks for Clean-Label Backdoor Attacks5 Mar 2026
- 2026An LLM-Guided Query-Aware Inference System for GNN Models on Large Knowledge Graphs4 Mar 2026
- 2026Pharmacology Knowledge Graphs: Do We Need Chemical Structure for Drug Repurposing?2 Mar 2026
- 2026Normalisation and Initialisation Strategies for Graph Neural Networks in Blockchain Anomaly Detection27 Feb 2026
- 2026Training-Free Cross-Architecture Merging for Graph Neural Networks22 Feb 2026
- 2026From Classical to Topological Neural Networks Under Uncertainty10 Feb 2026
- 2026Urban Spatio-Temporal Foundation Models for Climate-Resilient Housing: Scaling Diffusion Transformers for Disaster Risk Prediction5 Feb 2026
- 2026MAGPrompt: Message-Adaptive Graph Prompt Tuning for Graph Neural Networks5 Feb 2026
50 newest of 618 All 618 (JSON)
- 2021On Representation Knowledge Distillation for Graph Neural Networkscited by 38
- 2022Geometer: Graph Few-Shot Class-Incremental Learning via Prototype Representationcited by 22
- 2022Compressing Deep Graph Neural Networks via Adversarial Knowledge Distillationcited by 18
- 2024Attention is all you need for boosting graph convolutional neural networkcited by 0
- 2024Attention is all you need for boosting graph convolutional neural network10 Mar 2024
- 2022Geometer: Graph Few-Shot Class-Incremental Learning via Prototype Representation27 May 2022
- 2022Compressing Deep Graph Neural Networks via Adversarial Knowledge Distillation24 May 2022
- 2021On Representation Knowledge Distillation for Graph Neural Networks9 Nov 2021
- 2021Graph Unlearningcited by 138
- 2024Towards Effective and General Graph Unlearning via Mutual Evolutioncited by 29
- 2025OpenGU: A Comprehensive Benchmark for Graph Unlearningcited by 8
- 2026FedLSG: LLM-Enhanced Semantic Calibration for Federated Graph Backdoor Defensecited by 0
- 2026FedLSG: LLM-Enhanced Semantic Calibration for Federated Graph Backdoor Defense22 Jul 2026
- 2025OpenGU: A Comprehensive Benchmark for Graph Unlearning6 Jan 2025
- 2024Towards Effective and General Graph Unlearning via Mutual Evolution22 Jan 2024
- 2021Graph Unlearning27 Mar 2021
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2021OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphscited by 329
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 311
- 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 210
- 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
- 2021Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learningcited by 177
- 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
- 2021Training Graph Neural Networks with 1000 Layerscited by 169
- 2021Equivariant Subgraph Aggregation Networkscited by 154
- 2021Graph Condensation for Graph Neural Networkscited by 150
- 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 141
- 2021Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Predictioncited by 138
12 most cited of 600 All 600 (JSON)
- 2026NodeGround: A Node Classification Benchmark in the Graph Foundation Model Era30 Sep 2026
- 2026Message Passing Does More with Less for In-Context Learning on Graphs29 Sep 2026
- 2026Spectral Reversal: Counteracting Singular Value Bias for Graph Prompting26 Sep 2026
- 2026Scaffold: Support Graph Theory Based Sparsification for Graph Neural Networks25 Sep 2026
- 2026Moment-guided edge sampling24 Sep 2026
- 2026Scalable Subgraph Sampling via Resistance Curvature23 Sep 2026
- 2026QUARTET: Quad-branch cross-Attention and Random-walk Traces for Enhancing Transformers on Relational Graphs22 Sep 2026
- 2026GraphFAS: A Distributed System for Automated Graph Feature Generation and Selection in Industrial Transaction Networks8 Sep 2026
- 2026Two-level domain-decomposition AdaGrad method for scalable training of graph neural networks23 Aug 2026
- 2026Self-Supervised Graph Representation Learning for In-The-Wild Wearable and Smartphone based Emotion Recognition23 Aug 2026
- 2026FinFraudBench: A Heterogeneous Graph Benchmark for Financial Fraud Detection15 Aug 2026
- 2026LGNNIC: Acceleration of Large-Scale GNN Training using SmartNICs7 Aug 2026
12 newest of 600 All 600 (JSON)