Hierarchical Robot Navigation in Novel Environments using Rough 2-D Maps
Not on the map. Why?
Abstract (arXiv)
In robot navigation, generalizing quickly to unseen environments is essential. Hierarchical methods inspired by human navigation have been proposed, typically consisting of a high-level landmark proposer and a low-level controller. However, these methods either require precise high-level information to be given in advance or need to construct such guidance from extensive interaction with the environment. In this work, we propose an approach that leverages a rough 2-D map of the environment to navigate in novel environments without requiring further learning. In particular, we introduce a dynamic topological map that can be initialized from the rough 2-D map along with a high-level planning approach for proposing reachable 2-D map patches of the intermediate landmarks between the start and goal locations. To use proposed 2-D patches, we train a deep generative model to generate intermediate landmarks in observation space which are used as subgoals by low-level goal-conditioned reinforcement learning. Importantly, because the low-level controller is only trained with local behaviors (e.g. go across the intersection, turn left at a corner) on existing environments, this framework allows us to generalize to novel environments given only a rough 2-D map, without requiring further learning. Experimental results demonstrate the effectiveness of the proposed framework in both seen and novel environments.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 14 of its 25 references that are in the map. First posted on arXiv 7 Jun 2021.
Builds on
14 of 25 references.
References · 14
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
- 2018World Modelscited by 1,444
- 2017Hindsight Experience Replaycited by 1,096
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2018Semi-parametric Topological Memory for Navigationcited by 203
- 2019Search on the Replay Buffer: Bridging Planning and Reinforcement Learningcited by 188
- 2019Planning with Goal-Conditioned Policiescited by 144
- 2018Temporal Difference Models: Model-Free Deep RL for Model-Based Controlcited by 89
- 2016An Uncertain Future: Forecasting from Static Images using Variational Autoencoderscited by 86
- 2019Mapping State Space using Landmarks for Universal Goal Reachingcited by 44
- 2017Deep Deterministic Policy Gradient for Urban Traffic Light Controlcited by 30
- 2020Hallucinative Topological Memory for Zero-Shot Visual Planningcited by 25
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 2; 2025: 0; 2026: 1.
4 papers.
- 2024One-shot Imitation in a Non-Stationary Environment via Multi-Modal Skillcited by 7
- 2024Feudal Networks for Visual Navigationcited by 4
- 2022Asynchronous, Option-Based Multi-Agent Policy Gradient: A Conditional Reasoning Approachcited by 0
- 2026FeudalNav: A Simple Framework for Visual Navigationcited by 0
- 2026FeudalNav: A Simple Framework for Visual Navigation15 Jan 2026
- 2024Feudal Networks for Visual Navigation19 Feb 2024
- 2024One-shot Imitation in a Non-Stationary Environment via Multi-Modal Skill13 Feb 2024
- 2022Asynchronous, Option-Based Multi-Agent Policy Gradient: A Conditional Reasoning Approach29 Mar 2022