FastGCN: Fast Learning with Graph Convolutional Networks via Importance Sampling
Not on the map. Why?
Abstract (arXiv)
The graph convolutional networks (GCN) recently proposed by Kipf and Welling are an effective graph model for semi-supervised learning. This model, however, was originally designed to be learned with the presence of both training and test data. Moreover, the recursive neighborhood expansion across layers poses time and memory challenges for training with large, dense graphs. To relax the requirement of simultaneous availability of test data, we interpret graph convolutions as integral transforms of embedding functions under probability measures. Such an interpretation allows for the use of Monte Carlo approaches to consistently estimate the integrals, which in turn leads to a batched training scheme as we propose in this work---FastGCN. Enhanced with importance sampling, FastGCN not only is efficient for training but also generalizes well for inference. We show a comprehensive set of experiments to demonstrate its effectiveness compared with GCN and related models. In particular, training is orders of magnitude more efficient while predictions remain comparably accurate.
Key facts. Cited by 583 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 155; 2022: 140; 2023: 117; 2024: 84; 2025: 58; 2026: 29.
583 papers.
Sort:
By area:
- 2021OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphscited by 328
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 309
- 2024LLaGA: Large Language and Graph Assistantcited by 177
- 2021Training Graph Neural Networks with 1000 Layerscited by 169
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2021Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillationcited by 151
- 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
- 2022NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphscited by 137
- 2022Data Augmentation for Deep Graph Learning: A Surveycited by 132
- 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 131
- 2021ETA Prediction with Graph Neural Networks in Google Mapscited by 130
- 2021A Unified Lottery Ticket Hypothesis for Graph Neural Networkscited by 118
38 more
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2021Robustness of Graph Neural Networks at Scalecited by 100
- 2022Decoupling the Depth and Scope of Graph Neural Networkscited by 94
- 2021GNNAutoScale: Scalable and Expressive Graph Neural Networks via Historical Embeddingscited by 90
- 2022Graph Attention Multi-Layer Perceptroncited by 82
- 2021Scaling Up Graph Neural Networks Via Graph Coarseningcited by 80
- 2021Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classificationcited by 79
- 2021Towards Self-Explainable Graph Neural Networkcited by 75
- 2021NRGNN: Learning a Label Noise-Resistant Graph Neural Network on Sparsely and Noisily Labeled Graphscited by 73
- 2021ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learningcited by 72
- 2022Hierarchical Graph Transformer with Adaptive Node Samplingcited by 72
- 2021Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Futurecited by 67
- 2021Lorentzian Graph Convolutional Networkscited by 66
- 2022A Survey on Graph Representation Learning Methodscited by 66
- 2022FBNETGEN: Task-aware GNN-based fMRI Analysis via Functional Brain Network Generationcited by 66
- 2022Towards Robust Graph Neural Networks for Noisy Graphs with Sparse Labelscited by 63
- 2022Structural Entropy Guided Graph Hierarchical Poolingcited by 62
- 2021Graph Neural Networks Inspired by Classical Iterative Algorithmscited by 60
- 2024LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token Embeddingscited by 60
- 2021DistGNN: Scalable Distributed Training for Large-Scale Graph Neural Networkscited by 59
- 2021Dissecting the Diffusion Process in Linear Graph Convolutional Networkscited by 58
- 2021Simplifying approach to Node Classification in Graph Neural Networkscited by 56
- 2022A Comprehensive Study on Large-Scale Graph Training: Benchmarking and Rethinkingcited by 56
- 2021Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depthcited by 55
- 2021Scalable and Adaptive Graph Neural Networks with Self-Label-Enhanced trainingcited by 54
- 2022GREAD: Graph Neural Reaction-Diffusion Networkscited by 54
- 2024A Survey of Graph Neural Networks in Real world: Imbalance, Noise, Privacy and OOD Challengescited by 54
- 2021BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessingcited by 50
- 2022A*Net: A Scalable Path-based Reasoning Approach for Knowledge Graphscited by 49
- 2025PyG 2.0: Scalable Learning on Real World Graphscited by 49
- 2021Node Dependent Local Smoothing for Scalable Graph Learningcited by 45
- 2021Improving Subgraph Recognition with Variational Graph Information Bottleneckcited by 45
- 2024FedGTA: Topology-aware Averaging for Federated Graph Learningcited by 44
- 2022BNS-GCN: Efficient Full-Graph Training of Graph Convolutional Networks with Partition-Parallelism and Random Boundary Node Samplingcited by 43
- 2022Graph Neural Networks are Inherently Good Generalizers: Insights by Bridging GNNs and MLPscited by 42
- 2021Accelerating Large Scale Real-Time GNN Inference using Channel Pruningcited by 41
- 2021Improving Graph Neural Networks with Simple Architecture Designcited by 41
- 2021A Survey on Graph-Based Deep Learning for Computational Histopathologycited by 41
50 most cited of 583 All 583 (JSON)
- 2026Scaffold: Support Graph Theory Based Sparsification for Graph Neural Networks25 Sep 2026
- 2026Moment-guided edge sampling24 Sep 2026
- 2026Scalable Subgraph Sampling via Resistance Curvature23 Sep 2026
- 2026LGNNIC: Acceleration of Large-Scale GNN Training using SmartNICs7 Aug 2026
- 2026Edge Sparsification via Temporal Forman-Ricci Curvature for Dynamic Graph Learning7 Aug 2026
- 2026CoRe-GNN: Multilevel Message passing on Coarsened graphs3 Aug 2026
- 2026Differentiable Lifting for Topological Neural Networks2 Aug 2026
- 2026Graph Neural Multilevel Preconditioners for Iterative Solvers30 Jul 2026
- 2026Heterogeneous Graph Condensation via Role-Aware Clustering3 Jul 2026
- 2026Explaining Temporal Graph Neural Networks via Feature-induced Information Flow25 Jun 2026
- 2026FeLoG: Scalable and Efficient Distributed Graph Embedding with Feedback Loop Mechanism20 Jun 2026
- 2026RADE: Random Add-Drop Edge as a Regularizer30 May 2026
38 more
- 2026Implicit Regularization of Mini-Batch Training in Graph Neural Networks21 May 2026
- 2026Efficient Higher-order Subgraph Attribution via Message Passing21 May 2026
- 2026Position: Graph Condensation Needs a Reset -- Move Beyond Full-dataset Training and Model-Dependence17 May 2026
- 2026Hierarchical Attention-based Graph Neural Network with Relevance-driven Pruning10 May 2026
- 2026TypeBandit: Type-Level Context Allocation and Reweighting for Effective Attribute Completion in Heterogeneous Graph Neural Networks30 Apr 2026
- 2026Communication-free Sampling and 4D Hybrid Parallelism for Scalable Mini-batch GNN Training3 Apr 2026
- 2026Efficient and Scalable Granular-ball Graph Coarsening Method for Large-scale Graph Node Classification31 Mar 2026
- 2026Sparse-by-Design Cross-Modality Prediction: L0-Gated Representations for Reliable and Efficient Learning26 Mar 2026
- 2026Poisoning the Inner Prediction Logic of Graph Neural Networks for Clean-Label Backdoor Attacks5 Mar 2026
- 2026Normalisation and Initialisation Strategies for Graph Neural Networks in Blockchain Anomaly Detection27 Feb 2026
- 2026COMBA: Cross Batch Aggregation for Learning Large Graphs with Context Gating State Space Models19 Feb 2026
- 2026Generalizing GNNs with Tokenized Mixture of Experts9 Feb 2026
- 2026Bayesian Neighborhood Adaptation for Graph Neural Networks5 Feb 2026
- 2026Grappa: Gradient-Only Communication for Scalable Graph Neural Network Training2 Feb 2026
- 2026Community Norms in the Spotlight: Enabling Task-Agnostic Unsupervised Pre-Training to Benefit Online Social Media26 Jan 2026
- 2026InfGraND: An Influence-Guided GNN-to-MLP Knowledge Distillation12 Jan 2026
- 2026MQ-GNN: A Multi-Queue Pipelined Architecture for Scalable and Efficient GNN Training8 Jan 2026
- 2025BLISS: Bandit Layer Importance Sampling Strategy for Efficient Training of Graph Neural Networks26 Dec 2025
- 2025Toward Efficient Testing of Graph Neural Networks via Test Input Prioritization20 Dec 2025
- 2025ATLAS: Adaptive Topology-based Learning at Scale for Homophilic and Heterophilic Graphs16 Dec 2025
- 2025gHAWK: Local and Global Structure Encoding for Scalable Training of Graph Neural Networks on Knowledge Graphs9 Dec 2025
- 2025HGC-Herd: Efficient Heterogeneous Graph Condensation via Representative Node Herding8 Dec 2025
- 2025When Structure Doesn't Help: LLMs Do Not Read Text-Attributed Graphs as Effectively as We Expected20 Nov 2025
- 2025FuseSampleAgg: One-Pass Neighborhood Estimation for Budgeted Knowledge-Graph Refresh and Validation17 Nov 2025
- 2025VISAGNN: Versatile Staleness-Aware Efficient Training on Large-Scale Graphs16 Nov 2025
- 2025Image augmentation with invertible networks in interactive satellite image change detection21 Oct 2025
- 2025AGNES: Adaptive Graph Neural Network and Dynamic Programming Hybrid Framework for Real-Time Nanopore Seed Chaining15 Oct 2025
- 2025PruneGCRN: Minimizing and explaining spatio-temporal problems through node pruning12 Oct 2025
- 2025Analytical Survey of Learning with Low-Resource Data: From Analysis to Investigation10 Oct 2025
- 2025Label-frugal satellite image change detection with generative virtual exemplar learning8 Oct 2025
- 2025Bridging the Gap Between Multimodal Foundation Models and World Models4 Oct 2025
- 2025LHGEL: Large Heterogeneous Graph Ensemble Learning using Batch View Aggregation3 Oct 2025
- 2025Neighborhood Sampling Does Not Learn the Same Graph Neural Network26 Sep 2025
- 2025RapidGNN: Energy and Communication-Efficient Distributed Training on Large-Scale Graph Neural Networks5 Sep 2025
- 2025Multi-View Graph Convolution Network for Internal Talent Recommendation Based on Enterprise Emails28 Aug 2025
- 2025A Note on Graphon-Signal Analysis of Graph Neural Networks25 Aug 2025
- 2025On the Interplay between Graph Structure and Learning Algorithms in Graph Neural Networks20 Aug 2025
- 2025Online Continual Graph Learning5 Aug 2025
50 newest of 583 All 583 (JSON)
- 2026Generalizing GNNs with Tokenized Mixture of Expertscited by 1
- 2026Generalizing GNNs with Tokenized Mixture of Experts9 Feb 2026
- 2023Inductive Graph Unlearningcited by 30
- 2023Inductive Graph Unlearning6 Apr 2023
- 2021OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphscited by 328
- 2021Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methodscited by 309
- 2024LLaGA: Large Language and Graph Assistantcited by 177
- 2021Training Graph Neural Networks with 1000 Layerscited by 169
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2021Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillationcited by 151
- 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
- 2022NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphscited by 137
- 2022Data Augmentation for Deep Graph Learning: A Surveycited by 132
- 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 131
- 2021ETA Prediction with Graph Neural Networks in Google Mapscited by 130
- 2021A Unified Lottery Ticket Hypothesis for Graph Neural Networkscited by 118
12 most cited of 576 All 576 (JSON)
- 2026Scaffold: Support Graph Theory Based Sparsification for Graph Neural Networks25 Sep 2026
- 2026Moment-guided edge sampling24 Sep 2026
- 2026Scalable Subgraph Sampling via Resistance Curvature23 Sep 2026
- 2026LGNNIC: Acceleration of Large-Scale GNN Training using SmartNICs7 Aug 2026
- 2026Edge Sparsification via Temporal Forman-Ricci Curvature for Dynamic Graph Learning7 Aug 2026
- 2026CoRe-GNN: Multilevel Message passing on Coarsened graphs3 Aug 2026
- 2026Differentiable Lifting for Topological Neural Networks2 Aug 2026
- 2026Graph Neural Multilevel Preconditioners for Iterative Solvers30 Jul 2026
- 2026Heterogeneous Graph Condensation via Role-Aware Clustering3 Jul 2026
- 2026Explaining Temporal Graph Neural Networks via Feature-induced Information Flow25 Jun 2026
- 2026FeLoG: Scalable and Efficient Distributed Graph Embedding with Feedback Loop Mechanism20 Jun 2026
- 2026RADE: Random Add-Drop Edge as a Regularizer30 May 2026
12 newest of 576 All 576 (JSON)