JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing Services
Not on the map. Why?
Abstract (arXiv)
Deep learning models are being deployed in many mobile intelligent applications. End-side services, such as intelligent personal assistants, autonomous cars, and smart home services often employ either simple local models on the mobile or complex remote models on the cloud. However, recent studies have shown that partitioning the DNN computations between the mobile and cloud can increase the latency and energy efficiencies. In this paper, we propose an efficient, adaptive, and practical engine, JointDNN, for collaborative computation between a mobile device and cloud for DNNs in both inference and training phase. JointDNN not only provides an energy and performance efficient method of querying DNNs for the mobile side but also benefits the cloud server by reducing the amount of its workload and communications compared to the cloud-only approach. Given the DNN architecture, we investigate the efficiency of processing some layers on the mobile device and some layers on the cloud server. We provide optimization formulations at layer granularity for forward- and backward-propagations in DNNs, which can adapt to mobile battery limitations and cloud server load constraints and quality of service. JointDNN achieves up to 18 and 32 times reductions on the latency and mobile energy consumption of querying DNNs compared to the status-quo approaches, respectively.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 18; 2023: 13; 2024: 14; 2025: 6; 2026: 8.
79 papers.
Sort:
By area:
- 2021Distributed Learning in Wireless Networks: Recent Progress and Future Challengescited by 125
- 2021Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challengescited by 114
- 2021AutoFL: Enabling Heterogeneity-Aware Energy Efficient Federated Learningcited by 39
- 2021Device-Cloud Collaborative Learning for Recommendationcited by 34
- 2021Supervised Compression for Resource-Constrained Edge Computing Systemscited by 31
- 2022BottleFit: Learning Compressed Representations in Deep Neural Networks for Effective and Efficient Split Computingcited by 28
- 2023Privacy-preserving Adversarial Facial Featurescited by 24
- 2022A Survey on Collaborative DNN Inference for Edge Intelligencecited by 23
- 2021Collaborative Intelligence: Challenges and Opportunitiescited by 18
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2023Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AIcited by 17
- 2022SC2 Benchmark: Supervised Compression for Split Computingcited by 14
38 more
- 2021Pipeline Parallelism for Inference on Heterogeneous Edge Computingcited by 13
- 2022SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systemscited by 13
- 2022Decentralized Low-Latency Collaborative Inference via Ensembles on the Edgecited by 9
- 2021Autodidactic Neurosurgeon: Collaborative Deep Inference for Mobile Edge Intelligence via Online Learningcited by 8
- 2023Enabling Resource-efficient AIoT System with Cross-level Optimization: A surveycited by 8
- 2021Lightweight Compression of Intermediate Neural Network Features for Collaborative Intelligencecited by 7
- 2022I-SPLIT: Deep Network Interpretability for Split Computingcited by 7
- 2021Single-Training Collaborative Object Detectors Adaptive to Bandwidth and Computationcited by 6
- 2022On-Device Learning with Cloud-Coordinated Data Augmentation for Extreme Model Personalization in Recommender Systemscited by 6
- 2022Privacy-Preserving Visual Localization with Event Camerascited by 6
- 2021CALTeC: Content-Adaptive Linear Tensor Completion for Collaborative Intelligencecited by 5
- 2022Online Learning for Orchestration of Inference in Multi-User End-Edge-Cloud Networkscited by 5
- 2022T-RECX: Tiny-Resource Efficient Convolutional neural networks with early-eXitcited by 5
- 2023Hierarchical Training of Deep Neural Networks Using Early Exitingcited by 5
- 2024Semantic Edge Computing and Semantic Communications in 6G Networks: A Unifying Survey and Research Challengescited by 5
- 2021Fingerprinting Multi-exit Deep Neural Network Models via Inference Timecited by 4
- 2024Distributed Semantic Segmentation with Efficient Joint Source and Task Decodingcited by 4
- 2022Edge-centric Optimization of Multi-modal ML-driven eHealth Applicationscited by 3
- 2023A Survey on Deep Neural Network Partition over Cloud, Edge and End Devicescited by 3
- 2023Training Latency Minimization for Model-Splitting Allowed Federated Edge Learningcited by 3
- 2023Progressive Neural Compression for Adaptive Image Offloading under Timing Constraintscited by 3
- 2024On the Impact of Black-box Deployment Strategies for Edge AI on Latency and Model Performancecited by 3
- 2024Early-Exit meets Model-Distributed Inference at Edge Networkscited by 3
- 2024Learning the Optimal Path and DNN Partition for Collaborative Edge Inferencecited by 3
- 2025Energy-Aware Deep Learning on Resource-Constrained Hardwarecited by 3
- 2022PARIS and ELSA: An Elastic Scheduling Algorithm for Reconfigurable Multi-GPU Inference Serverscited by 2
- 2022Adaptive Edge Offloading for Image Classification Under Rate Limitcited by 2
- 2022Privacy-Preserving Feature Coding for Machinescited by 2
- 2023DISCO: Distributed Inference with Sparse Communicationscited by 2
- 2024LAECIPS: Large Vision Model Assisted Adaptive Edge-Cloud Collaboration for IoT-based Embodied Intelligence Systemcited by 2
- 2024Socialized Learning: A Survey of the Paradigm Shift for Edge Intelligence in Networked Systemscited by 2
- 2024MTL-Split: Multi-Task Learning for Edge Devices using Split Computingcited by 2
- 2024Resource-Efficient Sensor Fusion via System-Wide Dynamic Gated Neural Networkscited by 2
- 2024Optimizing Edge Offloading Decisions for Object Detectioncited by 2
- 2024Priority-Aware Model-Distributed Inference at Edge Networkscited by 2
- 2025Privacy-Aware Joint DNN Model Deployment and Partitioning Optimization for Collaborative Edge Inference Servicescited by 2
- 2021DynaComm: Accelerating Distributed CNN Training between Edges and Clouds through Dynamic Communication Schedulingcited by 1
- 2022License Plate Privacy in Collaborative Visual Analysis of Traffic Scenescited by 1
50 most cited of 79 All 79 (JSON)
- 2026Partition-Aware Scheduling for Mobile Heterogeneous Inference Co-Execution13 Sep 2026
- 2026A Privacy Study of Sparse Collaborative Inference17 Aug 2026
- 2026HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inference1 Aug 2026
- 2026AirMoE: Statistic-Augmented Over-the-Air MoE for Collaborative Intelligence18 Jul 2026
- 2026CABLE: Cloud-Assisted Bandwidth-efficient LMM-based Encoding for V2X Systems17 Jun 2026
- 2026CONCORD: Asynchronous Sparse Aggregation for Device-Cloud RAG under Document Isolation13 Jun 2026
- 2026Delay-Adaptive Speculation Control for Low-Latency Edge-Cloud LLM Inference17 May 2026
- 2026Lightweight User-Personalization Method for Closed Split Computing16 Mar 2026
- 2025SMoFi: Step-wise Momentum Fusion for Split Federated Learning on Heterogeneous Data13 Nov 2025
- 2025Bayes-Split-Edge: Bayesian Optimization for Constrained Collaborative Inference in Wireless Edge Systems27 Oct 2025
- 2025Revisiting the Privacy Risks of Split Inference: A GAN-Based Data Reconstruction Attack via Progressive Feature Optimization28 Aug 2025
- 2025Energy-Aware Deep Learning on Resource-Constrained Hardware18 May 2025
38 more
- 2025LimitNet: Progressive, Content-Aware Image Offloading for Extremely Weak Devices & Networks18 Apr 2025
- 2025Privacy-Aware Joint DNN Model Deployment and Partitioning Optimization for Collaborative Edge Inference Services22 Feb 2025
- 2024Priority-Aware Model-Distributed Inference at Edge Networks16 Dec 2024
- 2024Semantic Edge Computing and Semantic Communications in 6G Networks: A Unifying Survey and Research Challenges27 Nov 2024
- 2024Optimizing Edge Offloading Decisions for Object Detection24 Oct 2024
- 2024Resource-Efficient Sensor Fusion via System-Wide Dynamic Gated Neural Networks22 Oct 2024
- 2024Learning the Optimal Path and DNN Partition for Collaborative Edge Inference2 Oct 2024
- 2024A QoE-Aware Split Inference Accelerating Algorithm for NOMA-based Edge Intelligence25 Sep 2024
- 2024Early-Exit meets Model-Distributed Inference at Edge Networks8 Aug 2024
- 2024Enhancing Split Computing and Early Exit Applications through Predefined Sparsity16 Jul 2024
- 2024Distributed Semantic Segmentation with Efficient Joint Source and Task Decoding15 Jul 2024
- 2024MTL-Split: Multi-Task Learning for Edge Devices using Split Computing8 Jul 2024
- 2024Socialized Learning: A Survey of the Paradigm Shift for Edge Intelligence in Networked Systems20 Apr 2024
- 2024LAECIPS: Large Vision Model Assisted Adaptive Edge-Cloud Collaboration for IoT-based Embodied Intelligence System16 Apr 2024
- 2024On the Impact of Black-box Deployment Strategies for Edge AI on Latency and Model Performance25 Mar 2024
- 2024Towards Integrated Fine-tuning and Inference when Generative AI meets Edge Intelligence5 Jan 2024
- 2023High Efficiency Inference Accelerating Algorithm for NOMA-based Mobile Edge Computing26 Dec 2023
- 2023Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AI21 Dec 2023
- 2023AccEPT: An Acceleration Scheme for Speeding Up Edge Pipeline-parallel Training10 Nov 2023
- 2023Facial Data Minimization: Shallow Model as Your Privacy Filter24 Oct 2023
- 2023Progressive Neural Compression for Adaptive Image Offloading under Timing Constraints8 Oct 2023
- 2023Adversarial Attacks to Latent Representations of Distributed Neural Networks in Split Computing29 Sep 2023
- 2023Enabling Resource-efficient AIoT System with Cross-level Optimization: A survey27 Sep 2023
- 2023Training Latency Minimization for Model-Splitting Allowed Federated Edge Learning21 Jul 2023
- 2023Privacy-preserving Adversarial Facial Features8 May 2023
- 2023A Survey on Deep Neural Network Partition over Cloud, Edge and End Devices20 Apr 2023
- 2023Hierarchical Training of Deep Neural Networks Using Early Exiting4 Mar 2023
- 2023DISCO: Distributed Inference with Sparse Communications22 Feb 2023
- 2023Real-Time High-Resolution Pedestrian Detection in Crowded Scenes via Parallel Edge Offloading20 Jan 2023
- 2022Privacy-Preserving Visual Localization with Event Cameras4 Dec 2022
- 2022Privacy-Preserving Feature Coding for Machines3 Oct 2022
- 2022I-SPLIT: Deep Network Interpretability for Split Computing23 Sep 2022
- 2022Edge-centric Optimization of Multi-modal ML-driven eHealth Applications4 Aug 2022
- 2022Adaptive Edge Offloading for Image Classification Under Rate Limit31 Jul 2022
- 2022A Survey on Collaborative DNN Inference for Edge Intelligence16 Jul 2022
- 2022T-RECX: Tiny-Resource Efficient Convolutional neural networks with early-eXit14 Jul 2022
- 2022Fault-Tolerant Collaborative Inference through the Edge-PRUNE Framework16 Jun 2022
- 2022Decentralized Low-Latency Collaborative Inference via Ensembles on the Edge7 Jun 2022
50 newest of 79 All 79 (JSON)
- 2021Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challengescited by 114
- 2022T-RECX: Tiny-Resource Efficient Convolutional neural networks with early-eXitcited by 5
- 2024Early-Exit meets Model-Distributed Inference at Edge Networkscited by 3
- 2026Delay-Adaptive Speculation Control for Low-Latency Edge-Cloud LLM Inferencecited by 0
- 2026Delay-Adaptive Speculation Control for Low-Latency Edge-Cloud LLM Inference17 May 2026
- 2024Early-Exit meets Model-Distributed Inference at Edge Networks8 Aug 2024
- 2022T-RECX: Tiny-Resource Efficient Convolutional neural networks with early-eXit14 Jul 2022
- 2021Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges8 Mar 2021
- 2021Distributed Learning in Wireless Networks: Recent Progress and Future Challengescited by 125
- 2021AutoFL: Enabling Heterogeneity-Aware Energy Efficient Federated Learningcited by 39
- 2021Device-Cloud Collaborative Learning for Recommendationcited by 34
- 2021Supervised Compression for Resource-Constrained Edge Computing Systemscited by 31
- 2022BottleFit: Learning Compressed Representations in Deep Neural Networks for Effective and Efficient Split Computingcited by 28
- 2023Privacy-preserving Adversarial Facial Featurescited by 24
- 2022A Survey on Collaborative DNN Inference for Edge Intelligencecited by 23
- 2021Collaborative Intelligence: Challenges and Opportunitiescited by 18
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2023Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AIcited by 17
- 2022SC2 Benchmark: Supervised Compression for Split Computingcited by 14
- 2021Pipeline Parallelism for Inference on Heterogeneous Edge Computingcited by 13
12 most cited of 71 All 71 (JSON)
- 2026Partition-Aware Scheduling for Mobile Heterogeneous Inference Co-Execution13 Sep 2026
- 2026A Privacy Study of Sparse Collaborative Inference17 Aug 2026
- 2026Lightweight User-Personalization Method for Closed Split Computing16 Mar 2026
- 2025SMoFi: Step-wise Momentum Fusion for Split Federated Learning on Heterogeneous Data13 Nov 2025
- 2025Bayes-Split-Edge: Bayesian Optimization for Constrained Collaborative Inference in Wireless Edge Systems27 Oct 2025
- 2025Revisiting the Privacy Risks of Split Inference: A GAN-Based Data Reconstruction Attack via Progressive Feature Optimization28 Aug 2025
- 2025Energy-Aware Deep Learning on Resource-Constrained Hardware18 May 2025
- 2025LimitNet: Progressive, Content-Aware Image Offloading for Extremely Weak Devices & Networks18 Apr 2025
- 2025Privacy-Aware Joint DNN Model Deployment and Partitioning Optimization for Collaborative Edge Inference Services22 Feb 2025
- 2024Priority-Aware Model-Distributed Inference at Edge Networks16 Dec 2024
- 2024Semantic Edge Computing and Semantic Communications in 6G Networks: A Unifying Survey and Research Challenges27 Nov 2024
- 2024Optimizing Edge Offloading Decisions for Object Detection24 Oct 2024
12 newest of 71 All 71 (JSON)