# Mobility and Cost Aware Inference Accelerating Algorithm for Edge Intelligence

arXiv: https://arxiv.org/abs/2312.16497 · HTML: https://mlsanity.com/paper/2312.16497/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 41 references that are in the map.
- First posted on arXiv 27 Dec 2023.

## Builds on (most cited first, 12 of 12)

- [A Survey on Multimodal Large Language Models](https://mlsanity.com/paper/2306.13549/) (2023)
- [Convex Optimization: Algorithms and Complexity](https://mlsanity.com/paper/1405.4980/) (2014)
- [Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing](https://mlsanity.com/paper/1910.05316/) (2019)
- [Distributed Deep Neural Networks over the Cloud, the Edge and End Devices](https://mlsanity.com/paper/1709.01921/) (2017)
- [CoEdge: Cooperative DNN Inference with Adaptive Workload Partitioning over Heterogeneous Edge Devices](https://mlsanity.com/paper/2012.03257/) (2020)
- [JALAD: Joint Accuracy- and Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution](https://mlsanity.com/paper/1812.10027/) (2018)
- [Edge-Host Partitioning of Deep Neural Networks with Feature Space Encoding for Resource-Constrained Internet-of-Things Platforms](https://mlsanity.com/paper/1802.03835/) (2018)
- [Generative AI-empowered Simulation for Autonomous Driving in Vehicular Mixed Reality Metaverses](https://mlsanity.com/paper/2302.08418/) (2023)
- [HFedMS: Heterogeneous Federated Learning with Memorable Data Semantics in Industrial Metaverse](https://mlsanity.com/paper/2211.03300/) (2022)
- [Joint Multi-User DNN Partitioning and Computational Resource Allocation for Collaborative Edge Intelligence](https://mlsanity.com/paper/2007.09072/) (2020)
- [Deep Learning Based Caching for Self-Driving Car in Multi-access Edge Computing](https://mlsanity.com/paper/1810.01548/) (2018)
- [Novel Wake-up Scheme for Energy-Efficient Low-Latency Mobile Devices in 5G Networks](https://mlsanity.com/paper/2001.00914/) (2020)

## Built on by (most cited first, 3 of 3)

- [OrderMoE: An expert similarity driven distributed edge MoE inference](https://mlsanity.com/paper/2607.17154/) (2026)
- [HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inference](https://mlsanity.com/paper/2608.00577/) (2026)
- [TopoCompress: Topology Aware Token Compression Algorithm for Distributed Edge MoE Inference](https://mlsanity.com/paper/2609.26061/) (2026)

## Abstract (arXiv)

The edge intelligence (EI) has been widely applied recently. Spliting the model between device, edge server, and cloud can improve the performance of EI greatly. The model segmentation without user mobility has been investigated deeply by previous works. However, in most use cases of EI, the end devices are mobile. Only a few works have been carried out on this aspect. These works still have many issues, such as ignoring the energy consumption of mobile device, inappropriate network assumption, and low effectiveness on adaptiving user mobility, etc. Therefore, for addressing the disadvantages of model segmentation and resource allocation in previous works, we propose mobility and cost aware model segmentation and resource allocation algorithm for accelerating the inference at edge (MCSA). Specfically, in the scenario without user mobility, the loop interation gradient descent (Li-GD) algorithm is provided. When the mobile user has a large model inference task needs to be calculated, it will take the energy consumption of mobile user, the communication and computing resource renting cost, and the inference delay into account to find the optimal model segmentation and resource allocation strategy. In the scenario with user mobility, the mobiity aware Li-GD (MLi-GD) algorithm is proposed to calculate the optimal strategy. Then, the properties of the proposed algorithms are investigated, including convergence, complexity, and approximation ratio. The experimental results demonstrate the effectiveness of the proposed algorithms.
