A Survey on Deep Neural Network Partition over Cloud, Edge and End Devices
Not on the map. Why?
Abstract (arXiv)
Deep neural network (DNN) partition is a research problem that involves splitting a DNN into multiple parts and offloading them to specific locations. Because of the recent advancement in multi-access edge computing and edge intelligence, DNN partition has been considered as a powerful tool for improving DNN inference performance when the computing resources of edge and end devices are limited and the remote transmission of data from these devices to clouds is costly. This paper provides a comprehensive survey on the recent advances and challenges in DNN partition approaches over the cloud, edge, and end devices based on a detailed literature collection. We review how DNN partition works in various application scenarios, and provide a unified mathematical model of the DNN partition problem. We developed a five-dimensional classification framework for DNN partition approaches, consisting of deployment locations, partition granularity, partition constraints, optimization objectives, and optimization algorithms. Each existing DNN partition approache can be perfectly defined in this framework by instantiating each dimension into specific values. In addition, we suggest a set of metrics for comparing and evaluating the DNN partition approaches. Based on this, we identify and discuss research challenges that have not yet been investigated or fully addressed. We hope that this work helps DNN partition researchers by highlighting significant future research directions in this domain.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 16 of its 69 references that are in the map. First posted on arXiv 20 Apr 2023.
Builds on
16 of 69 references.
References · 16
- 2014Going Deeper with Convolutionscited by 4,241
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
- 2014Deep Learning in Neural Networks: An Overviewcited by 770
- 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 596
- 2017Distributed Deep Neural Networks over the Cloud, the Edge and End Devicescited by 120
- 2018JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing Servicescited by 80
- 2015Conditional Deep Learning for Energy-Efficient and Enhanced Pattern Recognitioncited by 67
- 2020CoEdge: Cooperative DNN Inference with Adaptive Workload Partitioning over Heterogeneous Edge Devicescited by 67
- 2018Edge Intelligence: On-Demand Deep Learning Model Co-Inference with Device-Edge Synergycited by 51
- 2018JALAD: Joint Accuracy- and Latency-Aware Deep Structure Decoupling for Edge-Cloud Executioncited by 40
- 2018Edge-Host Partitioning of Deep Neural Networks with Feature Space Encoding for Resource-Constrained Internet-of-Things Platformscited by 35
- 2018Deep Private-Feature Extractioncited by 30
4 more
- 2021AppealNet: An Efficient and Highly-Accurate Edge/Cloud Collaborative Architecture for DNN Inferencecited by 17
- 2020Joint Multi-User DNN Partitioning and Computational Resource Allocation for Collaborative Edge Intelligencecited by 12
- 2020Calibration-Aided Edge Inference Offloading via Adaptive Model Partitioning of Deep Neural Networkscited by 8
- 2020ShadowTutor: Distributed Partial Distillation for Mobile Video DNN Inferencecited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 2.
3 papers.