Beyond the Edge: An Advanced Exploration of Reinforcement Learning for Mobile Edge Computing, its Applications, and Future Research Trajectories
On the map: Deep reinforcement learning methods → RL for energy, networks and operations
Abstract (arXiv)
Mobile Edge Computing (MEC) broadens the scope of computation and storage beyond the central network, incorporating edge nodes close to end devices. This expansion facilitates the implementation of large-scale "connected things" within edge networks. The advent of applications necessitating real-time, high-quality service presents several challenges, such as low latency, high data rate, reliability, efficiency, and security, all of which demand resolution. The incorporation of reinforcement learning (RL) methodologies within MEC networks promotes a deeper understanding of mobile user behaviors and network dynamics, thereby optimizing resource use in computing and communication processes. This paper offers an exhaustive survey of RL applications in MEC networks, initially presenting an overview of RL from its fundamental principles to the latest advanced frameworks. Furthermore, it outlines various RL strategies employed in offloading, caching, and communication within MEC networks. Finally, it explores open issues linked with software and hardware platforms, representation, RL robustness, safe RL, large-scale scheduling, generalization, security, and privacy. The paper proposes specific RL techniques to mitigate these issues and provides insights into their practical applications.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in RL for energy, networks and operations, one of 15 directions in Deep reinforcement learning methods. Builds on 94 of its 240 references that are in the map. First posted on arXiv 22 Apr 2024.
Builds on
94 of 240 references.
References · 94
- 2017Attention Is All You Needcited by 60,361
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2015Trust Region Policy Optimizationcited by 2,580
- 2021Convex optimizationcited by 2,515
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,745
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
38 more
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 942
- 2015Pointer Networkscited by 895
- 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 785
- 2017Counterfactual Multi-Agent Policy Gradientscited by 751
- 2018QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 708
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
- 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 503
- 2017A Brief Survey of Deep Reinforcement Learningcited by 483
- 2016Learning to reinforcement learncited by 377
- 2016Learning Multiagent Communication with Backpropagationcited by 366
- 2017Residual Gated Graph ConvNetscited by 346
- 2017Deep Reinforcement Learning: An Overviewcited by 333
- 2020Responsive Safety in Reinforcement Learning by PID Lagrangian Methodscited by 316
- 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 269
- 2020Robust Deep Reinforcement Learning against Adversarial Perturbations on State Observationscited by 238
- 2013The Complexity of Decentralized Control of Markov Decision Processescited by 231
- 2019Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computingcited by 228
- 2018Closing the Sim-to-Real Loop: Adapting Simulation Randomization with Real World Experiencecited by 217
- 2017struc2vec: Learning Node Representations from Structural Identitycited by 215
- 2020Projection-Based Constrained Policy Optimizationcited by 203
- 2015Multiagent Cooperation and Competition with Deep Reinforcement Learningcited by 184
- 2013Causal Inference and Causal Explanation with Background Knowledgecited by 170
- 2018Applications of Deep Reinforcement Learning in Communications and Networking: A Surveycited by 167
- 2016An Actor-Critic Algorithm for Sequence Predictioncited by 159
- 2016Continuous Deep Q-Learning with Model-based Accelerationcited by 157
- 2018Model-Based Value Estimation for Efficient Model-Free Reinforcement Learningcited by 156
- 2020CRPO: A New Approach for Safe Reinforcement Learning with Convergence Guaranteecited by 134
- 2023A Tutorial on Meta-Reinforcement Learningcited by 108
- 2020Invariant Causal Prediction for Block MDPscited by 105
- 2021Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applicationscited by 97
- 2017Multiagent Bidirectionally-Coordinated Nets: Emergence of Human-level Coordination in Learning to Play StarCraft Combat Gamescited by 96
- 2019Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligencecited by 76
- 2022Saute RL: Almost Surely Safe Reinforcement Learning Using State Augmentationcited by 69
- 2020Single and Multi-Agent Deep Reinforcement Learning for AI-Enabled Wireless Networks: A Tutorialcited by 60
- 2019Reducing Overestimation Bias in Multi-Agent Domains Using Double Centralized Criticscited by 47
50 most cited of 94 All 94 (JSON)
Built on by
Citing papers per year: 2025: 6; 2026: 3.
9 papers.
- 2025Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Surveycited by 14
- 2025A Survey on Cloud-Edge-Terminal Collaborative Intelligence in AIoT Networkscited by 3
- 2025Generative AI-Enhanced Cooperative MEC of UAVs and Ground Stations for Unmanned Surface Vehiclescited by 1
- 2025ReaCritic: Reasoning Transformer-based DRL Critic-model Scaling For Wireless Networkscited by 1
- 2025Optimistic Learning for Communication Networkscited by 0
- 2025HCF: Hierarchical Cascade Framework for Distributed Multi-Stage Image Compressioncited by 0
- 2026WINFlowNets: Warm-up Integrated Networks Training of Generative Flow Networks for Robotics and Machine Fault Adaptationcited by 0
- 2026Internet of Everything in the 6G Era: Paradigms, Enablers, Potentials and Future Directionscited by 0
- 2026Learning-Based Collaborative MEC for LLM Inference with Soft-Deadline Awareness via Transformer-Enhanced PPOcited by 0
- 2026Learning-Based Collaborative MEC for LLM Inference with Soft-Deadline Awareness via Transformer-Enhanced PPO3 Aug 2026
- 2026Internet of Everything in the 6G Era: Paradigms, Enablers, Potentials and Future Directions27 Apr 2026
- 2026WINFlowNets: Warm-up Integrated Networks Training of Generative Flow Networks for Robotics and Machine Fault Adaptation18 Mar 2026
- 2025A Survey on Cloud-Edge-Terminal Collaborative Intelligence in AIoT Networks26 Aug 2025
- 2025HCF: Hierarchical Cascade Framework for Distributed Multi-Stage Image Compression4 Aug 2025
- 2025ReaCritic: Reasoning Transformer-based DRL Critic-model Scaling For Wireless Networks16 May 2025
- 2025Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Survey3 May 2025
- 2025Optimistic Learning for Communication Networks4 Apr 2025
- 2025Generative AI-Enhanced Cooperative MEC of UAVs and Ground Stations for Unmanned Surface Vehicles12 Feb 2025
Similar, not cited
Close in wording, no citation either way
- 2025RL-based Adaptive Task Offloading in Mobile-Edge Computing for Future IoT Networks ↗
- 2025A Novel Deep Reinforcement Learning Method for Computation Offloading in Multi-User Mobile Edge Computing with Decentralization
- 2023Multi-objective Deep Reinforcement Learning for Mobile Edge Computing
- 2025Generalizable Pareto-Optimal Offloading with Reinforcement Learning in Mobile Edge Computing
- 2025Cooperative Task Offloading through Asynchronous Deep Reinforcement Learning in Mobile Edge Computing for Future Networks
- 2024To Train or Not to Train: Balancing Efficiency and Training Cost in Deep Reinforcement Learning for Mobile Edge Computing
- 2024dRG-MEC: Decentralized Reinforced Green Offloading for MEC-enabled Cloud Network
- 2024Latency-Aware Resource Allocation for Mobile Edge Generation and Computing via Deep Reinforcement Learning