Serving Graph Neural Networks With Distributed Fog Servers For Smart IoT Services
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) have gained growing interest in miscellaneous applications owing to their outstanding ability in extracting latent representation on graph structures. To render GNN-based service for IoT-driven smart applications, traditional model serving paradigms usually resort to the cloud by fully uploading geo-distributed input data to remote datacenters. However, our empirical measurements reveal the significant communication overhead of such cloud-based serving and highlight the profound potential in applying the emerging fog computing. To maximize the architectural benefits brought by fog computing, in this paper, we present Fograph, a novel distributed real-time GNN inference framework that leverages diverse and dynamic resources of multiple fog nodes in proximity to IoT data sources. By introducing heterogeneity-aware execution planning and GNN-specific compression techniques, Fograph tailors its design to well accommodate the unique characteristics of GNN serving in fog environments. Prototype-based evaluation and case study demonstrate that Fograph significantly outperforms the state-of-the-art cloud serving and fog deployment by up to 5.39x execution speedup and 6.84x throughput improvement.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 39 of its 95 references that are in the map. First posted on arXiv 4 Jul 2023.
Builds on
39 of 95 references.
References · 39
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2019Graph Neural Networks for Social Recommendationcited by 711
- 2020Enhancing Graph Neural Network-based Fraud Detectors against Camouflaged Fraudsterscited by 248
- 2019Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computingcited by 225
27 more
- 2016Clipper: A Low-Latency Online Prediction Serving Systemcited by 191
- 2019AliGraph: A Comprehensive Graph Neural Network Platformcited by 152
- 2019Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computingcited by 150
- 2020DistDGL: Distributed Graph Neural Network Training for Billion-Scale Graphscited by 139
- 2019Convergence of Edge Computing and Deep Learning: A Comprehensive Surveycited by 120
- 2020Serving DNNs like Clockwork: Performance Predictability from the Bottom Upcited by 119
- 2020SPINN: Synergistic Progressive Inference of Neural Networks over Device and Cloudcited by 109
- 2020Degree-Quant: Quantization-Aware Training for Graph Neural Networkscited by 93
- 2020Computing Graph Neural Networks: A Survey from Algorithms to Acceleratorscited by 81
- 2020CoEdge: Cooperative DNN Inference with Adaptive Workload Partitioning over Heterogeneous Edge Devicescited by 65
- 2019Learning Decentralized Controllers for Robot Swarms with Graph Neural Networkscited by 62
- 2020GNNAdvisor: An Adaptive and Efficient Runtime System for GNN Acceleration on GPUscited by 51
- 2021Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless Threadscited by 51
- 2020Message-Aware Graph Attention Networks for Large-Scale Multi-Robot Path Planningcited by 41
- 2020How to Build a Graph-Based Deep Learning Architecture in Traffic Domain: A Surveycited by 38
- 2020FeatGraph: A Flexible and Efficient Backend for Graph Neural Network Systemscited by 36
- 2021Marius: Learning Massive Graph Embeddings on a Single Machinecited by 29
- 2022Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysiscited by 29
- 2020SGQuant: Squeezing the Last Bit on Graph Neural Networks with Specialized Quantizationcited by 25
- 2021Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecturecited by 25
- 2020SCALE-Net: Scalable Vehicle Trajectory Prediction Network under Random Number of Interacting Vehicles via Edge-enhanced Graph Convolutional Neural Networkcited by 18
- 2021DynO: Dynamic Onloading of Deep Neural Networks from Cloud to Devicecited by 17
- 2018Survey on Multi-Access Edge Computing for Internet of Things Realizationcited by 12
- 2022GNN at the Edge: Cost-Efficient Graph Neural Network Processing over Distributed Edge Serverscited by 11
- 2021From Cloud to Edge: A First Look at Public Edge Platformscited by 9
- 2020Graph Neural Networks-based Clustering for Social Internet of Thingscited by 7
- 2019Graphical Models in Meshed Distribution Grids: Topology estimation, change detection and limitationscited by 5
Built on by
Citing papers per year: 2024: 2.
2 papers.