# Deep Reinforcement Learning based Local Planner for UAV Obstacle Avoidance using Demonstration Data

arXiv: https://arxiv.org/abs/2008.02521 · HTML: https://mlsanity.com/paper/2008.02521/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 6 Aug 2020.

## Built on by (most cited first, 3 of 3)

- [Vision-Based Deep Reinforcement Learning of UAV Autonomous Navigation Using Privileged Information](https://mlsanity.com/paper/2412.06313/) (2024)
- [Parallel Reinforcement Learning Simulation for Visual Quadrotor Navigation](https://mlsanity.com/paper/2209.11094/) (2022)
- [Path Planning Using Deep Deterministic Policy Gradient: A Reinforcement Learning Approach](https://mlsanity.com/paper/2606.07855/) (2026)

## Abstract (arXiv)

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge amount of data before they reach a reasonable performance. To speed up the DRL training process, we developed a novel learning framework which combines imitation learning and reinforcement learning and building upon Twin Delayed DDPG (TD3) algorithm. We newly introduced both policy and Q-value network are learned using the expert demonstration during the imitation phase. To tackle the distribution mismatch problem transfer from imitation to reinforcement learning, both TD-error and decayed imitation loss are used to update the pre-trained network when start interacting with the environment. The performances of the proposed algorithm are demonstrated on the challenging 3D UAV navigation problem using depth cameras and sketched in a variety of simulation environments.