mlsanityData to 7 Oct 2026

Hierarchical Robot Navigation in Novel Environments using Rough 2-D Maps

arXiv 2106.03665 ↗First posted 7 Jun 2021cs.RO cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

In robot navigation, generalizing quickly to unseen environments is essential. Hierarchical methods inspired by human navigation have been proposed, typically consisting of a high-level landmark proposer and a low-level controller. However, these methods either require precise high-level information to be given in advance or need to construct such guidance from extensive interaction with the environment. In this work, we propose an approach that leverages a rough 2-D map of the environment to navigate in novel environments without requiring further learning. In particular, we introduce a dynamic topological map that can be initialized from the rough 2-D map along with a high-level planning approach for proposing reachable 2-D map patches of the intermediate landmarks between the start and goal locations. To use proposed 2-D patches, we train a deep generative model to generate intermediate landmarks in observation space which are used as subgoals by low-level goal-conditioned reinforcement learning. Importantly, because the low-level controller is only trained with local behaviors (e.g. go across the intersection, turn left at a corner) on existing environments, this framework allows us to generalize to novel environments given only a rough 2-D map, without requiring further learning. Experimental results demonstrate the effectiveness of the proposed framework in both seen and novel environments.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 14 of its 25 references that are in the map. First posted on arXiv 7 Jun 2021.

Builds on

14 of 25 references.

References · 14

  1. 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
  2. 2018World Modelscited by 1,444
  3. 2017Hindsight Experience Replaycited by 1,096
  4. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
  5. 2018Semi-parametric Topological Memory for Navigationcited by 203
  6. 2019Search on the Replay Buffer: Bridging Planning and Reinforcement Learningcited by 188
  7. 2019Planning with Goal-Conditioned Policiescited by 144
  8. 2018Temporal Difference Models: Model-Free Deep RL for Model-Based Controlcited by 89
  9. 2016An Uncertain Future: Forecasting from Static Images using Variational Autoencoderscited by 86
  10. 2019Mapping State Space using Landmarks for Universal Goal Reachingcited by 44
  11. 2017Deep Deterministic Policy Gradient for Urban Traffic Light Controlcited by 30
  12. 2020Hallucinative Topological Memory for Zero-Shot Visual Planningcited by 25
2 more
  1. 2017Intention-Net: Integrating Planning and Deep Learning for Goal-Directed Autonomous Navigationcited by 19
  2. 2017Teaching a Machine to Read Maps with Deep Reinforcement Learningcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 0; 2024: 2; 2025: 0; 2026: 1.

4 papers.