Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computing
Not on the map. Why?
Abstract (arXiv)
With the breakthroughs in deep learning, the recent years have witnessed a booming of artificial intelligence (AI) applications and services, spanning from personal assistant to recommendation systems to video/audio surveillance. More recently, with the proliferation of mobile computing and Internet-of-Things (IoT), billions of mobile and IoT devices are connected to the Internet, generating zillions Bytes of data at the network edge. Driving by this trend, there is an urgent need to push the AI frontiers to the network edge so as to fully unleash the potential of the edge big data. To meet this demand, edge computing, an emerging paradigm that pushes computing tasks and services from the network core to the network edge, has been widely recognized as a promising solution. The resulted new inter-discipline, edge AI or edge intelligence, is beginning to receive a tremendous amount of interest. However, research on edge intelligence is still in its infancy stage, and a dedicated venue for exchanging the recent advances of edge intelligence is highly desired by both the computer system and artificial intelligence communities. To this end, we conduct a comprehensive survey of the recent research efforts on edge intelligence. Specifically, we first review the background and motivation for artificial intelligence running at the network edge. We then provide an overview of the overarching architectures, frameworks and emerging key technologies for deep learning model towards training/inference at the network edge. Finally, we discuss future research opportunities on edge intelligence. We believe that this survey will elicit escalating attentions, stimulate fruitful discussions and inspire further research ideas on edge intelligence.
Key facts. Cited by 225 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 34; 2022: 40; 2023: 40; 2024: 47; 2025: 34; 2026: 30.
225 papers.
Sort:
By area:
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Surveycited by 125
- 2025Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonablecited by 120
- 2021Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applicationscited by 96
- 2021Federated Learning over Wireless Device-to-Device Networks: Algorithms and Convergence Analysiscited by 51
- 2021Task-Oriented Communication for Multi-Device Cooperative Edge Inferencecited by 47
- 2025Empowering Edge Intelligence: A Comprehensive Survey on On-Device AI Modelscited by 44
- 2021Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AIcited by 38
- 2023SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Modelscited by 36
- 2021Fusion of Federated Learning and Industrial Internet of Things: A Surveycited by 28
- 2021FedAdapt: Adaptive Offloading for IoT Devices in Federated Learningcited by 26
- 2024Galaxy: A Resource-Efficient Collaborative Edge AI System for In-situ Transformer Inferencecited by 25
- 2023Green Edge AI: A Contemporary Surveycited by 24
38 more
- 2022A Survey on Collaborative DNN Inference for Edge Intelligencecited by 23
- 2023Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiencescited by 21
- 2023FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUscited by 20
- 2021Optimal Model Placement and Online Model Splitting for Device-Edge Co-Inferencecited by 19
- 2021Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligencecited by 18
- 2021Multi-Exit Semantic Segmentation Networkscited by 18
- 2022The Cost of Training Machine Learning Models over Distributed Data Sourcescited by 18
- 2024PocketLLM: Enabling On-Device Fine-Tuning for Personalized LLMscited by 18
- 2022A Feature Memory Rearrangement Network for Visual Inspection of Textured Surface Defects Toward Edge Intelligent Manufacturingcited by 16
- 2023Accelerating Split Federated Learning over Wireless Communication Networkscited by 16
- 2023Holistic Network Virtualization and Pervasive Network Intelligence for 6Gcited by 14
- 2023A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Servicescited by 14
- 2021Enabling Design Methodologies and Future Trends for Edge AI: Specialization and Co-designcited by 13
- 2021Efficient Federated Meta-Learning over Multi-Access Wireless Networkscited by 13
- 2022Task-Oriented Communication for Edge Video Analyticscited by 13
- 2024Asteroid: Resource-Efficient Hybrid Pipeline Parallelism for Collaborative DNN Training on Heterogeneous Edge Devicescited by 13
- 2022Autonomy and Intelligence in the Computing Continuum: Challenges, Enablers, and Future Directions for Orchestrationcited by 12
- 2022Task-Oriented Over-the-Air Computation for Multi-Device Edge AIcited by 12
- 2022Predictive GAN-powered Multi-Objective Optimization for Hybrid Federated Split Learningcited by 11
- 2022GNN at the Edge: Cost-Efficient Graph Neural Network Processing over Distributed Edge Serverscited by 11
- 2023Unsupervised Deep Learning for IoT Time Seriescited by 11
- 2024Towards Robust and Efficient Cloud-Edge Elastic Model Adaptation via Selective Entropy Distillationcited by 11
- 2021Wirelessly Powered Federated Edge Learning: Optimal Tradeoffs Between Convergence and Power Transfercited by 10
- 2021DISTREAL: Distributed Resource-Aware Learning in Heterogeneous Systemscited by 10
- 2022Resource-Constrained Edge AI with Early Exit Predictioncited by 10
- 2022Device-Cloud Collaborative Recommendation via Meta Controllercited by 10
- 2022FedKNOW: Federated Continual Learning with Signature Task Knowledge Integration at Edgecited by 10
- 2023MimiC: Combating Client Dropouts in Federated Learning by Mimicking Central Updatescited by 10
- 2025SpecEdge: Scalable Edge-Assisted Serving Framework for Interactive LLMscited by 10
- 2021Relay-Assisted Cooperative Federated Learningcited by 9
- 2022Decentralized Low-Latency Collaborative Inference via Ensembles on the Edgecited by 9
- 2024Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Surveycited by 9
- 2024Beyond the Edge: An Advanced Exploration of Reinforcement Learning for Mobile Edge Computing, its Applications, and Future Research Trajectoriescited by 9
- 2024Benchmarking Edge AI Platforms for High-Performance ML Inferencecited by 9
- 2025DVFS-Aware DNN Inference on GPUs: Latency Modeling and Performance Analysiscited by 9
- 2025Greedy Low-Rank Gradient Compression for Distributed Learning with Convergence Guaranteescited by 9
- 2021Distributed CNN Inference on Resource-Constrained UAVs for Surveillance Systems: Design and Optimizationcited by 8
- 2023Edge-Based Video Analytics: A Surveycited by 8
50 most cited of 225 All 225 (JSON)
- 2026EdgeCraft: Automated Model Crafting for Edge IoT28 Sep 2026
- 2026Concurrent Split Learning Through Stable Client Clustering24 Sep 2026
- 2026LEAP-NBV: Lightweight Edge Active-Perception for Foundation-Model Next-Best-View Planning21 Sep 2026
- 2026How Do Prompt Variations Affect Energy Consumption in On-Device LLMs?1 Sep 2026
- 2026Intelligent Edge Computing31 Aug 2026
- 2026Joint Optimization of Memory and Computing Frequency for Energy-Efficient DNN Inference14 Aug 2026
- 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AI11 Aug 2026
- 2026TopoCompress: Topology Aware Token Compression Algorithm for Distributed Edge MoE Inference1 Aug 2026
- 2026HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inference1 Aug 2026
- 2026GQ-FSL: Green Quantized Federated Split Learning Framework for Wireless Edge Networks31 Jul 2026
- 2026A Self-Calibrating Agentic AI Framework for Autonomous Edge Resource Allocation24 Jul 2026
- 2026Clustered Edge Intelligence: Beyond Just Convergence of Edge Computing and AI23 Jul 2026
38 more
- 2026Leveraging AutoML for Sustainable Deep Learning: A Multi-Objective HPO Approach on Deep Shift Neural Networks22 Jun 2026
- 2026CONCORD: Asynchronous Sparse Aggregation for Device-Cloud RAG under Document Isolation13 Jun 2026
- 2026Edge-Constrained UAV Small-Object Detection with P2 Enhancement and Quantum-Inspired Lightweight Structure Search8 Jun 2026
- 2026AI-Native Closed-Loop Security for 6G-Enabled Cyber-Physical Systems: From Edge Detection to Network-Wide Mitigation6 Jun 2026
- 2026AI-IoT-Robotics Integration: Survey of Frameworks, Emerging Trends, and the Path Toward Connected Robotics31 May 2026
- 2026Beyond Scaling: Agents Are Heading to the Edge18 May 2026
- 2026EdgeServing: Deadline-Aware Multi-DNN Serving at the Edge7 May 2026
- 2026Internet of Everything in the 6G Era: Paradigms, Enablers, Potentials and Future Directions27 Apr 2026
- 2026SAGE: Training-Free Semantic Evidence Composition for Edge-Cloud Inference under Hard Uplink Budgets21 Apr 2026
- 2026A Comparative Study of CNN Optimization Methods for Edge AI: Exploring the Role of Early Exits16 Apr 2026
- 2026R2E-VID: Two-Stage Robust Routing via Temporal Gating for Elastic Edge-Cloud Video Inference3 Apr 2026
- 2026Beyond Freshness and Semantics: A Coupon-Collector Framework for Effective Status Updates27 Mar 2026
- 2026Shape and Substance: Dual-Layer Side-Channel Attacks on Local Vision-Language Models26 Mar 2026
- 2026WebPII: Benchmarking Visual PII Detection for Computer-Use Agents18 Mar 2026
- 2026Channel-Adaptive Edge AI: Maximizing Inference Throughput by Adapting Computational Complexity to Channel States3 Mar 2026
- 2026Node Learning: A Framework for Adaptive, Decentralised and Collaborative Network Edge AI18 Feb 2026
- 2026Future of Edge AI in biodiversity monitoring13 Feb 2026
- 2026Scalable Explainability-as-a-Service (XaaS) for Edge AI Systems4 Feb 2026
- 2025D2M: A Decentralized, Privacy-Preserving, Incentive-Compatible Data Marketplace for Collaborative Learning11 Dec 2025
- 2025An All-Reduce Compatible Top-K Compressor for Communication-Efficient Distributed Learning30 Oct 2025
- 2025Frustratingly Easy Task-aware Pruning for Large Language Models26 Oct 2025
- 2025Data Efficient Any Transformer-to-Mamba Distillation via Attention Bridge22 Oct 2025
- 2025STT-GS: Sample-Then-Transmit Edge Gaussian Splatting with Joint Client Selection and Power Control15 Oct 2025
- 2025Edge Artificial Intelligence: A Systematic Review of Evolution, Taxonomic Frameworks, and Future Horizons1 Oct 2025
- 2025Chiplet-Based RISC-V SoC with Modular AI Acceleration22 Sep 2025
- 2025Joint Memory Frequency and Computing Frequency Scaling for Energy-efficient DNN Inference22 Sep 2025
- 2025A Federated Fine-Tuning Paradigm of Foundation Models in Heterogenous Wireless Networks5 Sep 2025
- 2025Self-Organising Memristive Networks as Physical Learning Systems31 Aug 2025
- 2025Edge General Intelligence Through World Models and Agentic AI: Fundamentals, Solutions, and Challenges13 Aug 2025
- 2025Adaptive AI Agent Placement and Migration in Edge Intelligence Systems5 Aug 2025
- 2025Quality-of-Service Aware LLM Routing for Edge Computing with Multiple Experts1 Aug 2025
- 2025From LLMs to Edge: Parameter-Efficient Fine-Tuning on Edge Devices31 Jul 2025
- 2025Exploring Superposition and Interference in State-of-the-Art Low-Parameter Vision Models21 Jul 2025
- 2025Greedy Low-Rank Gradient Compression for Distributed Learning with Convergence Guarantees11 Jul 2025
- 2025Ampere: Communication-Efficient and High-Accuracy Split Federated Learning8 Jul 2025
- 2025Large Language Models for Crash Detection in Video: A Survey of Methods, Datasets, and Challenges2 Jul 2025
- 2025QPART: Adaptive Model Quantization and Dynamic Workload Balancing for Accuracy-aware Edge Inference30 Jun 2025
- 2025Guidelines for the Quality Assessment of Energy-Aware NAS Benchmarks21 May 2025
50 newest of 225 All 225 (JSON)
- 2022Resource-Constrained Edge AI with Early Exit Predictioncited by 10
- 2025SpecEdge: Scalable Edge-Assisted Serving Framework for Interactive LLMscited by 10
- 2023Adaptive DNN Surgery for Selfish Inference Acceleration with On-demand Edge Resourcecited by 2
- 2026A Comparative Study of CNN Optimization Methods for Edge AI: Exploring the Role of Early Exitscited by 0
- 2026EdgeServing: Deadline-Aware Multi-DNN Serving at the Edgecited by 0
- 2026EdgeServing: Deadline-Aware Multi-DNN Serving at the Edge7 May 2026
- 2026A Comparative Study of CNN Optimization Methods for Edge AI: Exploring the Role of Early Exits16 Apr 2026
- 2025SpecEdge: Scalable Edge-Assisted Serving Framework for Interactive LLMs16 May 2025
- 2023Adaptive DNN Surgery for Selfish Inference Acceleration with On-demand Edge Resource21 Jun 2023
- 2022Resource-Constrained Edge AI with Early Exit Prediction15 Jun 2022
- 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AIcited by 4
- 2025Adaptive AI Agent Placement and Migration in Edge Intelligence Systemscited by 3
- 2026Beyond Scaling: Agents Are Heading to the Edgecited by 1
- 2026A Self-Calibrating Agentic AI Framework for Autonomous Edge Resource Allocationcited by 0
- 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AI11 Aug 2026
- 2026A Self-Calibrating Agentic AI Framework for Autonomous Edge Resource Allocation24 Jul 2026
- 2026Beyond Scaling: Agents Are Heading to the Edge18 May 2026
- 2025Adaptive AI Agent Placement and Migration in Edge Intelligence Systems5 Aug 2025
- 2023SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Modelscited by 36
- 2025Mixture-of-Experts for Distributed Edge Computing with Channel-Aware Gating Functioncited by 5
- 2026HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inferencecited by 0
- 2026TopoCompress: Topology Aware Token Compression Algorithm for Distributed Edge MoE Inferencecited by 0
- 2026TopoCompress: Topology Aware Token Compression Algorithm for Distributed Edge MoE Inference1 Aug 2026
- 2026HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inference1 Aug 2026
- 2025Mixture-of-Experts for Distributed Edge Computing with Channel-Aware Gating Function1 Apr 2025
- 2023SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models29 Oct 2023
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Surveycited by 125
- 2021Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applicationscited by 96
- 2021Federated Learning over Wireless Device-to-Device Networks: Algorithms and Convergence Analysiscited by 51
- 2021Task-Oriented Communication for Multi-Device Cooperative Edge Inferencecited by 47
- 2025Empowering Edge Intelligence: A Comprehensive Survey on On-Device AI Modelscited by 44
- 2021Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AIcited by 38
- 2021Fusion of Federated Learning and Industrial Internet of Things: A Surveycited by 28
- 2021FedAdapt: Adaptive Offloading for IoT Devices in Federated Learningcited by 26
- 2024Galaxy: A Resource-Efficient Collaborative Edge AI System for In-situ Transformer Inferencecited by 25
- 2023Green Edge AI: A Contemporary Surveycited by 24
- 2022A Survey on Collaborative DNN Inference for Edge Intelligencecited by 23
- 2023Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiencescited by 21
12 most cited of 206 All 206 (JSON)
- 2026EdgeCraft: Automated Model Crafting for Edge IoT28 Sep 2026
- 2026Concurrent Split Learning Through Stable Client Clustering24 Sep 2026
- 2026LEAP-NBV: Lightweight Edge Active-Perception for Foundation-Model Next-Best-View Planning21 Sep 2026
- 2026How Do Prompt Variations Affect Energy Consumption in On-Device LLMs?1 Sep 2026
- 2026Intelligent Edge Computing31 Aug 2026
- 2026Joint Optimization of Memory and Computing Frequency for Energy-Efficient DNN Inference14 Aug 2026
- 2026GQ-FSL: Green Quantized Federated Split Learning Framework for Wireless Edge Networks31 Jul 2026
- 2026Clustered Edge Intelligence: Beyond Just Convergence of Edge Computing and AI23 Jul 2026
- 2026Leveraging AutoML for Sustainable Deep Learning: A Multi-Objective HPO Approach on Deep Shift Neural Networks22 Jun 2026
- 2026Edge-Constrained UAV Small-Object Detection with P2 Enhancement and Quantum-Inspired Lightweight Structure Search8 Jun 2026
- 2026AI-Native Closed-Loop Security for 6G-Enabled Cyber-Physical Systems: From Edge Detection to Network-Wide Mitigation6 Jun 2026
- 2026AI-IoT-Robotics Integration: Survey of Frameworks, Emerging Trends, and the Path Toward Connected Robotics31 May 2026
12 newest of 206 All 206 (JSON)