# Handover and SINR-Aware Path Optimization in 5G-UAV mmWave Communication using DRL

arXiv: https://arxiv.org/abs/2504.02688 · HTML: https://mlsanity.com/paper/2504.02688/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods.
- Builds on 9 of its 25 references that are in the map.
- First posted on arXiv 3 Apr 2025.

## Placed in

- Deep reinforcement learning methods / [RL for robot navigation and UAV control](https://mlsanity.com/deeprl/rl-for-robot-navigation-and-uav-control/)

## Builds on (most cited first, 9 of 9)

- [Deep Reinforcement Learning with Double Q-learning](https://mlsanity.com/paper/1509.06461/) (2015)
- [DeepMIMO: A Generic Deep Learning Dataset for Millimeter Wave and Massive MIMO Applications](https://mlsanity.com/paper/1902.06435/) (2019)
- [Accessing From The Sky: A Tutorial on UAV Communications for 5G and Beyond](https://mlsanity.com/paper/1903.05289/) (2019)
- [A Comprehensive Overview on 5G-and-Beyond Networks with UAVs: From Communications to Sensing and Intelligence](https://mlsanity.com/paper/2010.09317/) (2020)
- [Trajectory Design and Power Control for Multi-UAV Assisted Wireless Networks: A Machine Learning Approach](https://mlsanity.com/paper/1812.07665/) (2018)
- [A Survey of Air-to-Ground Propagation Channel Modeling for Unmanned Aerial Vehicles](https://mlsanity.com/paper/1801.01656/) (2018)
- [Cellular-Enabled UAV Communication: A Connectivity-Constrained Trajectory Optimization Perspective](https://mlsanity.com/paper/1805.07182/) (2018)
- [Analysis of Reinforcement Learning Schemes for Trajectory Optimization of an Aerial Radio Unit](https://mlsanity.com/paper/2211.10524/) (2022)
- [Actor-Critic Scheduling for Path-Aware Air-to-Ground Multipath Multimedia Delivery](https://mlsanity.com/paper/2204.13343/) (2022)

## Abstract (arXiv)

Path planning and optimization for unmanned aerial vehicles (UAVs)-assisted next-generation wireless networks is critical for mobility management and ensuring UAV safety and ubiquitous connectivity, especially in dense urban environments with street canyons and tall buildings. Traditional statistical and model-based techniques have been successfully used for path optimization in communication networks. However, when dynamic channel propagation characteristics such as line-of-sight (LOS), interference, handover, and signal-to-interference and noise ratio (SINR) are included in path optimization, statistical and model-based path planning solutions become obsolete since they cannot adapt to the dynamic and time-varying wireless channels, especially in the mmWave bands. In this paper, we propose a novel model-free actor-critic deep reinforcement learning (AC-DRL) framework for path optimization in UAV-assisted 5G mmWave wireless networks, which combines four important aspects of UAV communication: textitflight time, handover, connectivity and SINR. We train an AC-RL agent that enables a UAV connected to a gNB to determine the optimal path to a desired destination in the shortest possible time with minimal gNB handover, while maintaining connectivity and the highest possible SINR. We train our model with data from a powerful ray tracing tool called Wireless InSite, which uses 3D images of the propagation environment and provides data that closely resembles the real propagation environment. The simulation results show that our system has superior performance in tracking high SINR compared to other selected RL algorithms.