Methods for Multi-objective Optimization PID Controller for quadrotor UAVs
On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control
Abstract (arXiv)
Integrating unmanned aerial vehicles into daily use requires controllers that ensure stable flight, efficient energy use, and reduced noise. Proportional integral derivative controllers remain standard but are highly sensitive to gain selection, with manual tuning often yielding suboptimal trade-offs. This paper studies different optimization techniques for the automated tuning of quadrotor proportional integral derivative gains under a unified simulation that couples a blade element momentum based aerodynamic model with a fast deep neural network surrogate, six degrees of freedom rigid body dynamics, turbulence, and a data driven acoustic surrogate model that predicts third octave spectra and propagates them to ground receivers. We compare three families of gradient-free optimizers: metaheuristics, Bayesian optimization, and deep reinforcement learning. Candidate controllers are evaluated using a composite cost function that incorporates multiple metrics, such as noise footprint and power consumption, simultaneously. Metaheuristics improve performance consistently, with Grey Wolf Optimization producing optimal results. Bayesian optimization is sample efficient but carries higher per iteration overhead and depends on the design domain. The reinforcement learning agents do not surpass the baseline in the current setup, suggesting the problem formulation requires further refinement. On unseen missions the best tuned controller maintains accurate tracking while reducing oscillations, power demand, and acoustic emissions. These results show that noise aware proportional integral derivative tuning through black box search can deliver quieter and more efficient flight without hardware changes.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 7 of its 70 references that are in the map. First posted on arXiv 22 Sep 2025.
Builds on
7 of 70 references.
References · 7
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2018A Tour of Reinforcement Learning: The View from Continuous Controlcited by 151
- 2019Deep Reinforcement Learning for Multi-objective Optimizationcited by 90
- 2023Comparison of High-Dimensional Bayesian Optimization Algorithms on BBOBcited by 19
- 2022Investigating Bayesian optimization for expensive-to-evaluate black box functions: Application in fluid dynamicscited by 6
- 2022A Novel Entropy-Maximizing TD3-based Reinforcement Learning for Automatic PID Tuningcited by 2
- 2024Drone Acoustic Analysis for Predicting Psychoacoustic Annoyance via Artificial Neural Networkscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Reinforcement Learning Based Prediction of PID Controller Gains for Quadrotor UAVs
- 2025Reactive Aerobatic Flight via Reinforcement Learning
- 2025RAPTOR: A Foundation Policy for Quadrotor Control
- 2026VisFly-Lab: Unified Differentiable Framework for First-Order Reinforcement Learning of Quadrotor Control
- 2024A Learning-based Quadcopter Controller with Extreme Adaptation
- 2025Dynamics-Invariant Quadrotor Control using Scale-Aware Deep Reinforcement Learning
- 2025Leveling the Playing Field: Carefully Comparing Classical and Learned Controllers for Quadrotor Trajectory Tracking
- 2024Multi-Fidelity Reinforcement Learning for Time-Optimal Quadrotor Re-planning