FeudalNav: A Simple Framework for Visual Navigation
Not on the map. Why?
Abstract (arXiv)
Visual navigation for robotics is inspired by the human ability to navigate environments using visual cues and memory, eliminating the need for detailed maps. In unseen, unmapped, or GPS-denied settings, traditional metric map-based methods fall short, prompting a shift toward learning-based approaches with minimal exploration. In this work, we develop a hierarchical framework that decomposes the navigation decision-making process into multiple levels. Our method learns to select subgoals through a simple, transferable waypoint selection network. A key component of the approach is a latent-space memory module organized solely by visual similarity, as a proxy for distance. This alternative to graph-based topological representations proves sufficient for navigation tasks, providing a compact, light-weight, simple-to-train navigator that can find its way to the goal in novel locations. We show competitive results with a suite of SOTA methods in Habitat AI environments without using any odometry in training or inference. An additional contribution leverages the interpretablility of the framework for interactive navigation. We consider the question: how much direction intervention/interaction is needed to achieve success in all trials? We demonstrate that even minimal human involvement can significantly enhance overall navigation performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 51 of its 62 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
51 of 62 references.
References · 51
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2021A Minimalist Approach to Offline Reinforcement Learningcited by 882
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
- 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 328
- 2020Learning to Explore using Active Neural SLAMcited by 308
38 more
- 2024Navigation World Modelscited by 262
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
- 2018Semi-parametric Topological Memory for Navigationcited by 203
- 2020Neural Topological SLAM for Visual Navigationcited by 193
- 2019Search on the Replay Buffer: Bridging Planning and Reinforcement Learningcited by 188
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
- 2021Goal-Conditioned Reinforcement Learning with Imagined Subgoalscited by 129
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
- 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 106
- 2022Navigating to Objects in the Real Worldcited by 104
- 2018Learning to Navigate in Cities Without a Mapcited by 103
- 2023GOAT: GO to Any Thingcited by 89
- 2018Hierarchical Imitation and Reinforcement Learningcited by 88
- 2020ViNG: Learning Open-World Navigation with Visual Goalscited by 77
- 2022Offline Visual Representation Learning for Embodied Navigationcited by 74
- 2022Zero Experience Required: Plug & Play Modular Transfer Learning for Semantic Visual Navigationcited by 66
- 2021Memory-Augmented Reinforcement Learning for Image-Goal Navigationcited by 64
- 2021No RL, No Simulation: Learning to Navigate without Navigatingcited by 63
- 2019HRL4IN: Hierarchical Reinforcement Learning for Interactive Navigation with Mobile Manipulatorscited by 52
- 2023Renderable Neural Radiance Map for Visual Navigationcited by 51
- 2021Learning to Map for Active Semantic Goal Navigationcited by 47
- 2022Topological Semantic Graph Memory for Image-Goal Navigationcited by 43
- 2019A Behavioral Approach to Visual Navigation with Graph Localization Networkscited by 40
- 2020Ask Your Humans: Using Human Instructions to Improve Generalization in Reinforcement Learningcited by 32
- 2020Learning to plan with uncertain topological mapscited by 29
- 2022Offline Reinforcement Learning for Visual Navigationcited by 28
- 2022Last-Mile Embodied Visual Navigationcited by 25
- 2020EgoMap: Projective mapping and structured egocentric memory for Deep RLcited by 23
- 2022Unsupervised Visual Representation Learning by Synchronous Momentum Groupingcited by 22
- 2018Visual Memory for Robust Path Followingcited by 16
- 2023End-to-End (Instance)-Image Goal Navigation through Correspondence as an Emergent Phenomenoncited by 16
- 2024MemoNav: Working Memory Model for Visual Navigationcited by 13
- 2021MaAST: Map Attention with Semantic Transformersfor Efficient Visual Navigationcited by 11
- 2021Hierarchies of Planning and Reinforcement Learning for Robot Navigationcited by 11
- 2023One-4-All: Neural Potential Fields for Embodied Navigationcited by 7
- 2023Metric-Free Exploration for Topological Mapping by Task and Motion Imitation in Feature Spacecited by 7
- 2023Learning with a Mole: Transferable latent spatial representations for navigation without reconstructioncited by 6
- 2021Hierarchical Robot Navigation in Novel Environments using Rough 2-D Mapscited by 4
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.