Self-Predictive Representation for Autonomous UAV Object-Goal Navigation
On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control
Abstract (arXiv)
Autonomous Unmanned Aerial Vehicles (UAVs) have revolutionized industries through their versatility with applications including aerial surveillance, search and rescue, agriculture, and delivery. Their autonomous capabilities offer unique advantages, such as operating in large open space environments. Reinforcement Learning (RL) empowers UAVs to learn intricate navigation policies, enabling them to optimize flight behavior autonomously. However, one of its main challenge is the inefficiency in using data sample to achieve a good policy. In object-goal navigation (OGN) settings, target recognition arises as an extra challenge. Most UAV-related approaches use relative or absolute coordinates to move from an initial position to a predefined location, rather than to find the target directly. This study addresses the data sample efficiency issue in solving a 3D OGN problem, in addition to, the formalization of the unknown target location setting as a Markov decision process. Experiments are conducted to analyze the interplay of different state representation learning (SRL) methods for perception with a model-free RL algorithm for planning in an autonomous navigation system. The main contribution of this study is the development of the perception module, featuring a novel self-predictive model named AmelPred. Empirical results demonstrate that its stochastic version, AmelPredSto, is the best-performing SRL model when combined with actor-critic RL algorithms. The obtained results show substantial improvement in RL algorithms' efficiency by using AmelPredSto in solving the OGN problem.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 19 of its 50 references that are in the map. First posted on arXiv 22 Apr 2026.
Builds on
19 of 50 references.
References · 19
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
- 2018Soft Actor-Critic Algorithms and Applicationscited by 1,240
- 2020Data-Efficient Reinforcement Learning with Self-Predictive Representationscited by 318
- 2020Decoupling Representation Learning from Reinforcement Learningcited by 269
- 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 148
- 2018State Representation Learning for Control: An Overviewcited by 127
- 2024Bridging State and History Representations: Understanding Self-Predictive RLcited by 54
- 2019Transferable Representation Learning in Vision-and-Language Navigationcited by 48
- 2021Learning Markov State Abstractions for Deep Reinforcement Learningcited by 44
- 2022Understanding Self-Predictive Learning for Reinforcement Learningcited by 44
7 more
- 2021Learning a State Representation and Navigation in Cluttered and Dynamic Environmentscited by 41
- 2021Self-supervised Representation Learning with Relative Predictive Codingcited by 28
- 2021Representation Learning for Event-based Visuomotor Policiescited by 20
- 2019Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representationscited by 19
- 2020NavRep: Unsupervised Representations for Reinforcement Learning of Robot Navigation in Dynamic Human Environmentscited by 15
- 2023ENTL: Embodied Navigation Trajectory Learnercited by 11
- 2020Unmanned Aerial Vehicle for Internet of Everything: Opportunities and Challengescited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Reinforcement Learning for Autonomous Point-to-Point UAV Navigation
- 2026AION: Aerial Indoor Object-Goal Navigation Using Dual-Policy Reinforcement Learning
- 2025What Matters in RL-Based Methods for Object-Goal Navigation? An Empirical Study and A Unified Framework
- 2025SIGN: Safety-Aware Image-Goal Navigation for Autonomous Drones via Reinforcement Learning
- 2024On-policy Actor-Critic Reinforcement Learning for Multi-UAV Exploration
- 2026Vision-Guided Outdoor Flight and Obstacle Evasion via Reinforcement Learning
- 2026Lightweight Safe Reinforcement Learning for End-to-End UAV Navigation
- 2024Intercepting Unauthorized Aerial Robots in Controlled Airspace Using Reinforcement Learning