SmartSplit: Latency-Energy-Memory Optimisation for CNN Splitting on Smartphone Environment
Not on the map. Why?
Abstract (arXiv)
Artificial Intelligence has now taken centre stage in the smartphone industry owing to the need of bringing all processing close to the user and addressing privacy concerns. Convolution Neural Networks (CNNs), which are used by several AI applications, are highly resource and computation intensive. Although new generation smartphones come with AI-enabled chips, minimal memory and energy utilisation is essential as many applications are run concurrently on a smartphone. In light of this, optimising the workload on the smartphone by offloading a part of the processing to a cloud server is an important direction of research. In this paper, we analyse the feasibility of splitting CNNs between smartphones and cloud server by formulating a multi-objective optimisation problem that optimises the end-to-end latency, memory utilisation, and energy consumption. We design SmartSplit, a Genetic Algorithm with decision analysis based approach to solve the optimisation problem. Our experiments run with multiple CNN models show that splitting a CNN between a smartphone and a cloud server is feasible. The proposed approach, SmartSplit fares better when compared to other state-of-the-art approaches.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 52 references that are in the map. First posted on arXiv 1 Nov 2021.
Builds on
17 of 52 references.
References · 17
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
- 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 937
- 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 591
- 2018AI Benchmark: Running Deep Neural Networks on Android Smartphonescited by 75
- 2019BottleNet: A Deep Learning Architecture for Intelligent Mobile Cloud Computing Servicescited by 67
- 2017Depthwise Separable Convolutions for Neural Machine Translationcited by 26
- 2020Deep Learning in Industrial Internet of Things: Potentials, Challenges, and Emerging Applicationscited by 19
5 more
- 2020Joint Multi-User DNN Partitioning and Computational Resource Allocation for Collaborative Edge Intelligencecited by 12
- 2020Cluster Pruning: An Efficient Filter Pruning Method for Edge AI Vision Applicationscited by 10
- 2017CLBlast: A Tuned OpenCL BLAS Librarycited by 8
- 2015CNNdroid: GPU-Accelerated Execution of Trained Deep Convolutional Neural Networks on Androidcited by 4
- 2020Splitting Convolutional Neural Network Structures for Efficient Inferencecited by 2
Built on by
Not cited yet.