D3-GNN: Dynamic Distributed Dataflow for Streaming Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Graph Neural Network (GNN) models on streaming graphs entail algorithmic challenges to continuously capture its dynamic state, as well as systems challenges to optimize latency, memory, and throughput during both inference and training. We present D3-GNN, the first distributed, hybrid-parallel, streaming GNN system designed to handle real-time graph updates under online query setting. Our system addresses data management, algorithmic, and systems challenges, enabling continuous capturing of the dynamic state of the graph and updating node representations with fault-tolerance and optimal latency, load-balance, and throughput. D3-GNN utilizes streaming GNN aggregators and an unrolled, distributed computation graph architecture to handle cascading graph updates. To counteract data skew and neighborhood explosion issues, we introduce inter-layer and intra-layer windowed forward pass solutions. Experiments on large-scale graph streams demonstrate that D3-GNN achieves high efficiency and scalability. Compared to DGL, D3-GNN achieves a significant throughput improvement of about 76x for streaming workloads. The windowed enhancement further reduces running times by around 10x and message volumes by up to 15x at higher parallelism.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 30 of its 70 references that are in the map. First posted on arXiv 10 Sep 2024.
Builds on
30 of 70 references.
References · 30
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
- 2018Link Prediction Based on Graph Neural Networkscited by 829
- 2019Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networkscited by 540
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
- 2022Vision GNN: An Image is Worth Graph of Nodescited by 185
18 more
- 2019AliGraph: A Comprehensive Graph Neural Network Platformcited by 152
- 2021A Survey of Graph Neural Networks for Recommender Systems: Challenges, Methods, and Directionscited by 144
- 2020DistDGL: Distributed Graph Neural Network Training for Billion-Scale Graphscited by 139
- 2016Motifs in Temporal Networkscited by 101
- 2018Streaming Graph Neural Networkscited by 91
- 2018Community Interaction and Conflict on the Webcited by 72
- 2020Streaming Graph Neural Networks via Continual Learningcited by 63
- 2022TGL: A General Framework for Temporal GNN Training on Billion-Scale Graphscited by 59
- 2018Deep Reasoning with Knowledge Graph for Social Relationship Understandingcited by 44
- 2021ConsisRec: Enhancing GNN for Social Recommendation via Consistent Neighbor Aggregationcited by 39
- 2021Distributed Hybrid CPU and GPU training for Graph Neural Networks on Billion-Scale Graphscited by 33
- 2022BRIGHT -- Graph Neural Networks in Real-Time Fraud Detectioncited by 15
- 2023The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Surveycited by 13
- 2022Characterizing and Understanding Distributed GNN Training on GPUscited by 7
- 2022The World of Graph Databases from An Industry Perspectivecited by 7
- 2021Partitioning sparse deep neural networks for scalable training and inferencecited by 4
- 2020Regular Path Query Evaluation on Streaming Graphscited by 2
- 2013StreamWorks - A system for Dynamic Graph Searchcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.