Neural Topological SLAM for Visual Navigation
Not on the map. Why?
Abstract (arXiv)
This paper studies the problem of image-goal navigation which involves navigating to the location indicated by a goal image in a novel previously unseen environment. To tackle this problem, we design topological representations for space that effectively leverage semantics and afford approximate geometric reasoning. At the heart of our representations are nodes with associated semantic features, that are interconnected using coarse geometric information. We describe supervised learning-based algorithms that can build, maintain and use such representations under noisy actuation. Experimental study in visually and physically realistic simulation suggests that our method builds effective representations that capture structural regularities and efficiently solve long-horizon navigation problems. We observe a relative improvement of more than 50% over existing methods that study this task.
Key facts. Cited by 193 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 34; 2022: 48; 2023: 29; 2024: 36; 2025: 26; 2026: 20.
193 papers.
Sort:
By area:
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
- 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 256
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 187
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
- 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 162
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
- 2022Open-vocabulary Queryable Scene Representations for Real World Planningcited by 159
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
- 2021Unconstrained Scene Generation with Locally Conditioned Radiance Fieldscited by 130
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 127
38 more
- 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 125
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
- 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 117
- 2022Habitat-Matterport 3D Semantics Datasetcited by 109
- 2022Navigating to Objects in the Real Worldcited by 104
- 2021Structured Scene Memory for Vision-Language Navigationcited by 95
- 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 93
- 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
- 2022Offline Visual Representation Learning for Embodied Navigationcited by 74
- 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
- 2023OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNavcited by 68
- 2022Zero Experience Required: Plug & Play Modular Transfer Learning for Semantic Visual Navigationcited by 66
- 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Modelscited by 66
- 2021Memory-Augmented Reinforcement Learning for Image-Goal Navigationcited by 64
- 2021No RL, No Simulation: Learning to Navigate without Navigatingcited by 63
- 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
- 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hintscited by 55
- 2024PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigatorscited by 55
- 2022Instance-Specific Image Goal Navigation: Training Embodied Agents to Find Object Instancescited by 53
- 2021Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networkscited by 50
- 2023Navigating to Objects Specified by Imagescited by 50
- 2024GaussNav: Gaussian Splatting for Visual Navigationcited by 49
- 2021SASRA: Semantically-aware Spatio-temporal Reasoning Agent for Vision-and-Language Navigation in Continuous Environmentscited by 48
- 2021Learning to Map for Active Semantic Goal Navigationcited by 47
- 2023SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real Worldcited by 47
- 2022Retrospectives on the Embodied AI Workshopcited by 46
- 2023Learning Navigational Visual Representations with Semantic Map Supervisioncited by 40
- 2024Towards Generalist Robot Learning from Internet Video: A Surveycited by 40
- 2022Continuous Scene Representations for Embodied AIcited by 39
- 2021Interesting Object, Curious Agent: Learning Task-Agnostic Explorationcited by 38
- 2021Move2Hear: Active Audio-Visual Source Separationcited by 35
- 2021Differentiable SLAM-net: Learning Particle SLAM for Visual Navigationcited by 34
- 2021Hierarchical Object-to-Zone Graph for Object Navigationcited by 34
- 2022Uncertainty-driven Planner for Exploration and Navigationcited by 31
- 2022Towards Versatile Embodied Navigationcited by 26
- 2024TANGO: Training-free Embodied AI Agents for Open-world Taskscited by 26
- 2021Differentiable Spatial Planning using Transformerscited by 25
- 2022Last-Mile Embodied Visual Navigationcited by 25
50 most cited of 193 All 193 (JSON)
- 2026Improving Offline Goal-Conditioned Reinforcement Learning via Selective Reward Stimulation16 Sep 2026
- 2026Macro-Action Topological Navigation under Noisy Localization using Reinforcement Learning24 Aug 2026
- 2026BioVLN: A Simulation Platform for Visual Language Navigation in Biomedical Laboratories29 Jul 2026
- 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation11 Jun 2026
- 2026WISE: A Long-Horizon Agent in Minecraft with Why-Which Reasoning11 Jun 2026
- 2026EvoMemNav: Efficient Self-Evolving Fine-Grained Memory for Zero-Shot Embodied Navigation2 Jun 2026
- 2026PlatonicNav: Unveiling Semantic Correspondence in Navigation with Platonic Topological Maps1 Jun 2026
- 2026Hierarchical Semantic-Augmented Navigation: Optimal Transport and Graph-Driven Reasoning for Vision-Language Navigation1 Jun 2026
- 20263D Gaussian Map with Open-Set Semantic Grouping for Vision-Language Navigation26 May 2026
- 2026LASAR: Towards Spatio-temporal Reasoning with Latent Cognitive Map16 May 2026
- 2026NavOne: One-Step Global Planning for Vision-Language Navigation on Top-Down Maps7 May 2026
- 2026Plug-and-Play Label Map Diffusion for Universal Goal-Oriented Navigation7 May 2026
38 more
- 2026Multi-Scale Gaussian-Language Map for Zero-shot Embodied Navigation and Reasoning3 May 2026
- 2026Scene Representation using 360deg Saliency Graph and its Application in Vision-based Indoor Navigation20 Mar 2026
- 2026From Reactive to Map-Based AI: Tuned Local LLMs for Semantic Zone Inference in Object-Goal Navigation9 Mar 2026
- 2026How Far Can We Go with Pixels Alone? A Pilot Study on Screen-Only Navigation in Commercial 3D ARPGs21 Feb 2026
- 2026Dynamic Topology Awareness: Breaking the Granularity Rigidity in Vision-Language Navigation29 Jan 2026
- 2026FeudalNav: A Simple Framework for Visual Navigation15 Jan 2026
- 2026PanoSAMic: Panoramic Image Segmentation from SAM Feature Encoding and Dual View Fusion12 Jan 2026
- 2026Residual Cross-Modal Fusion Networks for Audio-Visual Navigation11 Jan 2026
- 2025YOPO-Nav: Visual Navigation using 3DGS Graphs from One-Pass Videos10 Dec 2025
- 2025Wanderland: Geometrically Grounded Simulation for Open-World Embodied AI25 Nov 2025
- 2025Thinking in 360deg: Humanoid Visual Search in the Wild25 Nov 2025
- 2025IndustryNav: Exploring Spatial Reasoning of Embodied Agents in Dynamic Industrial Navigation21 Nov 2025
- 2025SplatSearch: Instance Image Goal Navigation for Mobile Robots using 3D Gaussian Splatting and Diffusion Models17 Nov 2025
- 2025Dream to Recall: Imagination-Guided Experience Retrieval for Memory-Persistent Vision-and-Language Navigation9 Oct 2025
- 2025Iterative Residual Cross-Attention Mechanism: An Integrated Approach for Audio-Visual Navigation Tasks30 Sep 2025
- 2025Decision-Driven Semantic Object Exploration for Legged Robots via Confidence-Calibrated Perception and Topological Subgoal Selection25 Sep 2025
- 2025ObjectReact: Learning Object-Relative Control for Visual Navigation11 Sep 2025
- 2025TANGO: Traversability-Aware Navigation with Local Metric Control for Topological Goals10 Sep 2025
- 2025SkeNa: Learning to Navigate Unseen Environments Based on Abstract Hand-Drawn Maps5 Aug 2025
- 2025IGL-Nav: Incremental 3D Gaussian Localization for Image-goal Navigation1 Aug 2025
- 2025What does really matter in image goal navigation?2 Jul 2025
- 2025FastMap: Real-Time Semantic Map Completion via Bitwise Masked Modeling9 Jun 2025
- 2025Hierarchical Scoring with 3D Gaussian Splatting for Instance Image-Goal Navigation9 Jun 2025
- 2025A Survey of Robotic Navigation and Manipulation with Physics Simulators in the Era of Embodied AI1 May 2025
- 2025SmallPlan: Leverage Small Language Models for Sequential Path Planning with Simulation-Powered, LLM-Guided Distillation1 May 2025
- 2025RSRNav: Reasoning Spatial Relationship for Image-Goal Navigation25 Apr 2025
- 2025Think Hierarchically, Act Dynamically: Hierarchical Multi-modal Fusion and Reasoning for Vision-and-Language Navigation23 Apr 2025
- 2025NaviDiffusor: Cost-Guided Diffusion Model for Visual Navigation14 Apr 2025
- 2025RANa: Retrieval-Augmented Navigation4 Apr 2025
- 2025Fine-Grained Instruction-Guided Graph Reasoning for Vision-and-Language Navigation14 Mar 2025
- 2025Image-Goal Navigation Using Refined Feature Guidance and Scene Graph Enhancement14 Mar 2025
- 2025Reasoning in visual navigation of end-to-end trained agents: a dynamical systems approach11 Mar 2025
- 2025NavigateDiff: Visual Predictors are Zero-Shot Navigation Assistants19 Feb 2025
- 2025REGNav: Room Expert Guided Image-Goal Navigation15 Feb 2025
- 2024FloNa: Floor Plan Guided Embodied Visual Navigation24 Dec 2024
- 2024NFL-BA: Near-Field Light Bundle Adjustment for SLAM in Dynamic Lighting17 Dec 2024
- 2024SAME: Learning Generic Language-Guided Visual Navigation with State-Adaptive Mixture of Experts7 Dec 2024
- 2024TANGO: Training-free Embodied AI Agents for Open-world Tasks5 Dec 2024
50 newest of 193 All 193 (JSON)
- 2024TopV-Nav: Unlocking the Top-View Spatial Reasoning Potential of MLLM for Zero-shot Object Navigationcited by 15
- 2025IndustryNav: Exploring Spatial Reasoning of Embodied Agents in Dynamic Industrial Navigationcited by 5
- 2024Hierarchical Spatial Proximity Reasoning for Vision-and-Language Navigationcited by 2
- 2024Diffusion as Reasoning: Enhancing Object Navigation via Diffusion Model Conditioned on LLM-based Object-Room Knowledgecited by 1
- 2026Hierarchical Semantic-Augmented Navigation: Optimal Transport and Graph-Driven Reasoning for Vision-Language Navigationcited by 1
- 2026LASAR: Towards Spatio-temporal Reasoning with Latent Cognitive Mapcited by 0
- 2026WISE: A Long-Horizon Agent in Minecraft with Why-Which Reasoningcited by 0
- 2026WISE: A Long-Horizon Agent in Minecraft with Why-Which Reasoning11 Jun 2026
- 2026Hierarchical Semantic-Augmented Navigation: Optimal Transport and Graph-Driven Reasoning for Vision-Language Navigation1 Jun 2026
- 2026LASAR: Towards Spatio-temporal Reasoning with Latent Cognitive Map16 May 2026
- 2025IndustryNav: Exploring Spatial Reasoning of Embodied Agents in Dynamic Industrial Navigation21 Nov 2025
- 2024TopV-Nav: Unlocking the Top-View Spatial Reasoning Potential of MLLM for Zero-shot Object Navigation25 Nov 2024
- 2024Diffusion as Reasoning: Enhancing Object Navigation via Diffusion Model Conditioned on LLM-based Object-Room Knowledge29 Oct 2024
- 2024Hierarchical Spatial Proximity Reasoning for Vision-and-Language Navigation18 Mar 2024
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
- 2025NaviDiffusor: Cost-Guided Diffusion Model for Visual Navigationcited by 23
- 2025SplatSearch: Instance Image Goal Navigation for Mobile Robots using 3D Gaussian Splatting and Diffusion Modelscited by 1
- 2026Plug-and-Play Label Map Diffusion for Universal Goal-Oriented Navigationcited by 0
- 2026Plug-and-Play Label Map Diffusion for Universal Goal-Oriented Navigation7 May 2026
- 2025SplatSearch: Instance Image Goal Navigation for Mobile Robots using 3D Gaussian Splatting and Diffusion Models17 Nov 2025
- 2025NaviDiffusor: Cost-Guided Diffusion Model for Visual Navigation14 Apr 2025
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Exploration11 Oct 2023
- 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Modelscited by 66
- 2023Co-NavGPT: Multi-Robot Cooperative Visual Semantic Navigation Using Vision Language Modelscited by 8
- 2023Multimodal Large Language Model for Visual Navigationcited by 8
- 2026PlatonicNav: Unveiling Semantic Correspondence in Navigation with Platonic Topological Mapscited by 0
- 2026PlatonicNav: Unveiling Semantic Correspondence in Navigation with Platonic Topological Maps1 Jun 2026
- 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Models16 Feb 2024
- 2023Multimodal Large Language Model for Visual Navigation12 Oct 2023
- 2023Co-NavGPT: Multi-Robot Cooperative Visual Semantic Navigation Using Vision Language Models11 Oct 2023
- 2024TANGO: Training-free Embodied AI Agents for Open-world Taskscited by 26
- 2025RANa: Retrieval-Augmented Navigationcited by 2
- 2025RANa: Retrieval-Augmented Navigation4 Apr 2025
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
- 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 256
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 187
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
- 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 162
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
- 2022Open-vocabulary Queryable Scene Representations for Real World Planningcited by 159
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
- 2021Unconstrained Scene Generation with Locally Conditioned Radiance Fieldscited by 130
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 127
- 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 125
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
12 most cited of 168 All 168 (JSON)
- 2026Macro-Action Topological Navigation under Noisy Localization using Reinforcement Learning24 Aug 2026
- 2026BioVLN: A Simulation Platform for Visual Language Navigation in Biomedical Laboratories29 Jul 2026
- 20263D Gaussian Map with Open-Set Semantic Grouping for Vision-Language Navigation26 May 2026
- 2026NavOne: One-Step Global Planning for Vision-Language Navigation on Top-Down Maps7 May 2026
- 2026Multi-Scale Gaussian-Language Map for Zero-shot Embodied Navigation and Reasoning3 May 2026
- 2026Scene Representation using 360deg Saliency Graph and its Application in Vision-based Indoor Navigation20 Mar 2026
- 2026From Reactive to Map-Based AI: Tuned Local LLMs for Semantic Zone Inference in Object-Goal Navigation9 Mar 2026
- 2026How Far Can We Go with Pixels Alone? A Pilot Study on Screen-Only Navigation in Commercial 3D ARPGs21 Feb 2026
- 2026Dynamic Topology Awareness: Breaking the Granularity Rigidity in Vision-Language Navigation29 Jan 2026
- 2026FeudalNav: A Simple Framework for Visual Navigation15 Jan 2026
- 2026PanoSAMic: Panoramic Image Segmentation from SAM Feature Encoding and Dual View Fusion12 Jan 2026
- 2026Residual Cross-Modal Fusion Networks for Audio-Visual Navigation11 Jan 2026
12 newest of 168 All 168 (JSON)