# Single and Multi-Agent Deep Reinforcement Learning for AI-Enabled Wireless Networks: A Tutorial

arXiv: https://arxiv.org/abs/2011.03615 · HTML: https://mlsanity.com/paper/2011.03615/

## Key facts

- Cited by 60 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 6 Nov 2020.

## Built on by (most cited first, 30 of 60)

- [AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges](https://mlsanity.com/paper/2505.10468/) (2025)
- [Distributed Learning in Wireless Networks: Recent Progress and Future Challenges](https://mlsanity.com/paper/2104.02151/) (2021)
- [Enhancing Deep Reinforcement Learning: A Tutorial on Generative Diffusion Models in Network Optimization](https://mlsanity.com/paper/2308.05384/) (2023)
- [Deep Multiagent Reinforcement Learning: Challenges and Directions](https://mlsanity.com/paper/2106.15691/) (2021)
- [Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligence](https://mlsanity.com/paper/2105.01798/) (2021)
- [AoI-Aware Resource Allocation for Platoon-Based C-V2X Networks via Multi-Agent Multi-Task Reinforcement Learning](https://mlsanity.com/paper/2105.04196/) (2021)
- [Causal Reasoning: Charting a Revolutionary Course for Next-Generation AI-Native Wireless Networks](https://mlsanity.com/paper/2309.13223/) (2023)
- [Multi-Agent Reinforcement Learning for Resources Allocation Optimization: A Survey](https://mlsanity.com/paper/2504.21048/) (2025)
- [Toward Enhanced Reinforcement Learning-Based Resource Management via Digital Twin: Opportunities, Applications, and Challenges](https://mlsanity.com/paper/2406.07857/) (2024)
- [Beyond the Edge: An Advanced Exploration of Reinforcement Learning for Mobile Edge Computing, its Applications, and Future Research Trajectories](https://mlsanity.com/paper/2404.14238/) (2024)
- [Intelligent Computing: The Latest Advances, Challenges and Future](https://mlsanity.com/paper/2211.11281/) (2022)
- [Toward Safe and Accelerated Deep Reinforcement Learning for Next-Generation Wireless Networks](https://mlsanity.com/paper/2209.13532/) (2022)
- [Safe and Accelerated Deep Reinforcement Learning-based O-RAN Slicing: A Hybrid Transfer Learning Approach](https://mlsanity.com/paper/2309.07265/) (2023)
- [Digital Twin Assisted Deep Reinforcement Learning for Online Admission Control in Sliced Network](https://mlsanity.com/paper/2310.09299/) (2023)
- [Semantic-Aware Resource Management for C-V2X Platooning via Multi-Agent Reinforcement Learning](https://mlsanity.com/paper/2411.04672/) (2024)
- [On the Near-Optimality of Local Policies in Large Cooperative Multi-Agent Reinforcement Learning](https://mlsanity.com/paper/2209.03491/) (2022)
- [Large Vision Model-Enhanced Digital Twin with Deep Reinforcement Learning for User Association and Load Balancing in Dynamic Wireless Networks](https://mlsanity.com/paper/2410.07611/) (2024)
- [Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Survey](https://mlsanity.com/paper/2108.04087/) (2021)
- [Deep Reinforcement Learning for Data-Driven Adaptive Scanning in Ptychography](https://mlsanity.com/paper/2203.15413/) (2022)
- [UAV-Assisted Space-Air-Ground Integrated Networks: A Technical Review of Recent Learning Algorithms](https://mlsanity.com/paper/2211.14931/) (2022)
- [Joint Computation Offloading and Resource Allocation for Uncertain Maritime MEC via Cooperation of UAVs and Vessels](https://mlsanity.com/paper/2506.15225/) (2025)
- [Deep Learning-based Techniques for Integrated Sensing and Communication Systems: State-of-the-Art, Challenges, and Opportunities](https://mlsanity.com/paper/2509.06968/) (2025)
- [Reinforcement Learning-Empowered Mobile Edge Computing for 6G Edge Intelligence](https://mlsanity.com/paper/2201.11410/) (2022)
- [Explainable AI over the Internet of Things (IoT): Overview, State-of-the-Art and Future Directions](https://mlsanity.com/paper/2211.01036/) (2022)
- [Map2Traj: Street Map Piloted Zero-shot Trajectory Generation with Diffusion Model](https://mlsanity.com/paper/2407.19765/) (2024)
- [MetaSTNet: Multimodal Meta-learning for Cellular Traffic Conformal Prediction](https://mlsanity.com/paper/2505.21553/) (2025)
- [Continuous-Time Value Iteration for Multi-Agent Reinforcement Learning](https://mlsanity.com/paper/2509.09135/) (2025)
- [AURA: Adaptive Unified Reasoning and Automation with LLM-Guided MARL for NextG Cellular Networks](https://mlsanity.com/paper/2511.17506/) (2025)
- [When Do Multi-Agent Systems Outperform? Analysing the Learning Efficiency of Agentic Systems](https://mlsanity.com/paper/2602.08272/) (2026)
- [Deep Reinforcement Learning for Power Control in Next-Generation WiFi Network Systems](https://mlsanity.com/paper/2211.01107/) (2022)

## Abstract (arXiv)

Deep Reinforcement Learning (DRL) has recently witnessed significant advances that have led to multiple successes in solving sequential decision-making problems in various domains, particularly in wireless communications. The future sixth-generation (6G) networks are expected to provide scalable, low-latency, ultra-reliable services empowered by the application of data-driven Artificial Intelligence (AI). The key enabling technologies of future 6G networks, such as intelligent meta-surfaces, aerial networks, and AI at the edge, involve more than one agent which motivates the importance of multi-agent learning techniques. Furthermore, cooperation is central to establishing self-organizing, self-sustaining, and decentralized networks. In this context, this tutorial focuses on the role of DRL with an emphasis on deep Multi-Agent Reinforcement Learning (MARL) for AI-enabled 6G networks. The first part of this paper will present a clear overview of the mathematical frameworks for single-agent RL and MARL. The main idea of this work is to motivate the application of RL beyond the model-free perspective which was extensively adopted in recent years. Thus, we provide a selective description of RL algorithms such as Model-Based RL (MBRL) and cooperative MARL and we highlight their potential applications in 6G wireless networks. Finally, we overview the state-of-the-art of MARL in fields such as Mobile Edge Computing (MEC), Unmanned Aerial Vehicles (UAV) networks, and cell-free massive MIMO, and identify promising future research directions. We expect this tutorial to stimulate more research endeavors to build scalable and decentralized systems based on MARL.
