FeatGraph: A Flexible and Efficient Backend for Graph Neural Network Systems
Not on the map. Why?
Abstract (arXiv)
Graph neural networks (GNNs) are gaining increasing popularity as a promising approach to machine learning on graphs. Unlike traditional graph workloads where each vertex/edge is associated with a scalar, GNNs attach a feature tensor to each vertex/edge. This additional feature dimension, along with consequently more complex vertex- and edge-wise computations, has enormous implications on locality and parallelism, which existing graph processing systems fail to exploit. This paper proposes FeatGraph to accelerate GNN workloads by co-optimizing graph traversal and feature dimension computation. FeatGraph provides a flexible programming interface to express diverse GNN models by composing coarse-grained sparse templates with fine-grained user-defined functions (UDFs) on each vertex/edge. FeatGraph incorporates optimizations for graph traversal into the sparse templates and allows users to specify optimizations for UDFs with a feature dimension schedule (FDS). FeatGraph speeds up end-to-end GNN training and inference by up to 32x on CPU and 7x on GPU.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 8; 2023: 13; 2024: 6; 2025: 4; 2026: 1.
36 papers.
Sort:
By area:
- 2022TorchSparse: Efficient Point Cloud Inference Enginecited by 72
- 2021DistGNN: Scalable Distributed Training for Large-Scale Graph Neural Networkscited by 59
- 2022SparseTIR: Composable Abstractions for Sparse Compilation in Deep Learningcited by 47
- 2022Distributed Graph Neural Network Training: A Surveycited by 32
- 2022Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysiscited by 29
- 2021Motif Prediction with Graph Neural Networkscited by 18
- 2023A Survey on Graph Neural Network Acceleration: Algorithms, Systems, and Customized Hardwarecited by 18
- 2023The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Surveycited by 13
- 2022Neural Graph Databasescited by 11
- 2022GNN at the Edge: Cost-Efficient Graph Neural Network Processing over Distributed Edge Serverscited by 11
- 2023HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformerscited by 10
- 2023Accelerating Sampling and Aggregation Operations in GNN Frameworks with GPU Initiated Direct Storage Accessescited by 6
24 more
- 2023Tango: rethinking quantization for graph neural network training on GPUscited by 4
- 2024Demystifying Higher-Order Graph Neural Networkscited by 4
- 2021A Data-Centric Optimization Framework for Machine Learningcited by 3
- 2021Accelerating SpMM Kernel with Cache-First Edge Sampling for Graph Neural Networkscited by 2
- 2022Scalable Graph Convolutional Network Training on Distributed-Memory Systemscited by 2
- 2023Knowledge Enhanced Graph Neural Networks for Graph Completioncited by 2
- 2023Serving Graph Neural Networks With Distributed Fog Servers For Smart IoT Servicescited by 2
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligencecited by 2
- 2024DF-GNN: Dynamic Fusion Framework for Attention Graph Neural Networks on GPUscited by 2
- 2023STen: Productive and Efficient Sparsity in PyTorchcited by 1
- 2023AdaptGear: Accelerating GNN Training via Adaptive Subgraph-Level Kernels on GPUscited by 1
- 2023Performance Optimization of Deep Learning Sparse Matrix Kernels on Intel Max Series GPUcited by 1
- 2024Single-GPU GNN Systems: Traps and Pitfallscited by 1
- 2024iSpLib: A Library for Accelerating Graph Neural Networks using Auto-tuned Sparse Operationscited by 1
- 2024Optimization of GNN Training Through Half-precisioncited by 1
- 2022Analysis and Optimization of GNN-Based Recommender Systems on Persistent Memorycited by 0
- 2023Scalable Neural Network Training over Distributed Graphscited by 0
- 2023Rosko: Row Skipping Outer Products for Sparse Matrix Multiplication Kernelscited by 0
- 2023STAG: Enabling Low Latency and Low Staleness of GNN-based Services with Dynamic Graphscited by 0
- 2025SparseTransX: Efficient Training of Translation-Based Knowledge Graph Embeddings Using Sparse Matrix Operationscited by 0
- 2025The Ubiquitous Sparse Matrix-Matrix Productscited by 0
- 2025Panther: A Cost-Effective Privacy-Preserving Framework for GNN Training and Inference Services in Cloud Environmentscited by 0
- 2025Morphling: Fast, Fused, and Flexible GNN Training at Scalecited by 0
- 2026Permutation-Equivariant Flow Matching for Alignment-Free Neural Weight Generationcited by 0
- 2026Permutation-Equivariant Flow Matching for Alignment-Free Neural Weight Generation26 Sep 2026
- 2025Morphling: Fast, Fused, and Flexible GNN Training at Scale1 Dec 2025
- 2025Panther: A Cost-Effective Privacy-Preserving Framework for GNN Training and Inference Services in Cloud Environments3 Nov 2025
- 2025The Ubiquitous Sparse Matrix-Matrix Products6 Aug 2025
- 2025SparseTransX: Efficient Training of Translation-Based Knowledge Graph Embeddings Using Sparse Matrix Operations24 Feb 2025
- 2024DF-GNN: Dynamic Fusion Framework for Attention Graph Neural Networks on GPUs25 Nov 2024
- 2024Optimization of GNN Training Through Half-precision2 Nov 2024
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligence7 Jul 2024
- 2024Demystifying Higher-Order Graph Neural Networks18 Jun 2024
- 2024iSpLib: A Library for Accelerating Graph Neural Networks using Auto-tuned Sparse Operations21 Mar 2024
- 2024Single-GPU GNN Systems: Traps and Pitfalls5 Feb 2024
- 2023HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformers30 Nov 2023
24 more
- 2023Performance Optimization of Deep Learning Sparse Matrix Kernels on Intel Max Series GPU1 Nov 2023
- 2023STAG: Enabling Low Latency and Low Staleness of GNN-based Services with Dynamic Graphs27 Sep 2023
- 2023Tango: rethinking quantization for graph neural network training on GPUs2 Aug 2023
- 2023Rosko: Row Skipping Outer Products for Sparse Matrix Multiplication Kernels8 Jul 2023
- 2023Serving Graph Neural Networks With Distributed Fog Servers For Smart IoT Services4 Jul 2023
- 2023Accelerating Sampling and Aggregation Operations in GNN Frameworks with GPU Initiated Direct Storage Accesses28 Jun 2023
- 2023A Survey on Graph Neural Network Acceleration: Algorithms, Systems, and Customized Hardware24 Jun 2023
- 2023AdaptGear: Accelerating GNN Training via Adaptive Subgraph-Level Kernels on GPUs27 May 2023
- 2023The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Survey23 May 2023
- 2023STen: Productive and Efficient Sparsity in PyTorch15 Apr 2023
- 2023Knowledge Enhanced Graph Neural Networks for Graph Completion27 Mar 2023
- 2023Scalable Neural Network Training over Distributed Graphs25 Feb 2023
- 2022Scalable Graph Convolutional Network Training on Distributed-Memory Systems9 Dec 2022
- 2022Distributed Graph Neural Network Training: A Survey1 Nov 2022
- 2022GNN at the Edge: Cost-Efficient Graph Neural Network Processing over Distributed Edge Servers31 Oct 2022
- 2022Neural Graph Databases20 Sep 2022
- 2022Analysis and Optimization of GNN-Based Recommender Systems on Persistent Memory25 Jul 2022
- 2022SparseTIR: Composable Abstractions for Sparse Compilation in Deep Learning11 Jul 2022
- 2022Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysis19 May 2022
- 2022TorchSparse: Efficient Point Cloud Inference Engine21 Apr 2022
- 2021A Data-Centric Optimization Framework for Machine Learning20 Oct 2021
- 2021Motif Prediction with Graph Neural Networks26 May 2021
- 2021Accelerating SpMM Kernel with Cache-First Edge Sampling for Graph Neural Networks21 Apr 2021
- 2021DistGNN: Scalable Distributed Training for Large-Scale Graph Neural Networks14 Apr 2021
- 2022TorchSparse: Efficient Point Cloud Inference Enginecited by 72
- 2021DistGNN: Scalable Distributed Training for Large-Scale Graph Neural Networkscited by 59
- 2022SparseTIR: Composable Abstractions for Sparse Compilation in Deep Learningcited by 47
- 2022Distributed Graph Neural Network Training: A Surveycited by 32
- 2022Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysiscited by 29
- 2021Motif Prediction with Graph Neural Networkscited by 18
- 2023A Survey on Graph Neural Network Acceleration: Algorithms, Systems, and Customized Hardwarecited by 18
- 2023The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Surveycited by 13
- 2022Neural Graph Databasescited by 11
- 2022GNN at the Edge: Cost-Efficient Graph Neural Network Processing over Distributed Edge Serverscited by 11
- 2023HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformerscited by 10
- 2023Accelerating Sampling and Aggregation Operations in GNN Frameworks with GPU Initiated Direct Storage Accessescited by 6
12 most cited of 35 All 35 (JSON)
- 2025Morphling: Fast, Fused, and Flexible GNN Training at Scale1 Dec 2025
- 2025Panther: A Cost-Effective Privacy-Preserving Framework for GNN Training and Inference Services in Cloud Environments3 Nov 2025
- 2025The Ubiquitous Sparse Matrix-Matrix Products6 Aug 2025
- 2025SparseTransX: Efficient Training of Translation-Based Knowledge Graph Embeddings Using Sparse Matrix Operations24 Feb 2025
- 2024DF-GNN: Dynamic Fusion Framework for Attention Graph Neural Networks on GPUs25 Nov 2024
- 2024Optimization of GNN Training Through Half-precision2 Nov 2024
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligence7 Jul 2024
- 2024Demystifying Higher-Order Graph Neural Networks18 Jun 2024
- 2024iSpLib: A Library for Accelerating Graph Neural Networks using Auto-tuned Sparse Operations21 Mar 2024
- 2024Single-GPU GNN Systems: Traps and Pitfalls5 Feb 2024
- 2023HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformers30 Nov 2023
- 2023Performance Optimization of Deep Learning Sparse Matrix Kernels on Intel Max Series GPU1 Nov 2023
12 newest of 35 All 35 (JSON)