Navigating to Objects in Unseen Environments by Distance Prediction
Not on the map. Why?
Abstract (arXiv)
Object Goal Navigation (ObjectNav) task is to navigate an agent to an object category in unseen environments without a pre-built map. In this paper, we solve this task by predicting the distance to the target using semantically-related objects as cues. Based on the estimated distance to the target object, our method directly choose optimal mid-term goals that are more likely to have a shorter path to the target. Specifically, based on the learned knowledge, our model takes a bird's-eye view semantic map as input, and estimates the path length from the frontier map cells to the target object. With the estimated distance map, the agent could simultaneously explore the environment and navigate to the target objects based on a simple human-designed strategy. Empirical results in visually realistic simulation environments show that the proposed method outperforms a wide range of baselines on success rate and efficiency. Real-robot experiment also demonstrates that our method generalizes well to the real world. Video at https://www.youtube.com/watch?v=R79pWVGFKS4
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 36 of its 62 references that are in the map. First posted on arXiv 8 Feb 2022.
Builds on
36 of 62 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2017Mask R-CNNcited by 7,277
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2018On Evaluation of Embodied Navigation Agentscited by 547
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 366
- 2020Learning to Explore using Active Neural SLAMcited by 316
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 212
- 2018Semi-parametric Topological Memory for Navigationcited by 209
24 more
- 2016Learning to Navigate in Complex Environmentscited by 198
- 2020Neural Topological SLAM for Visual Navigationcited by 195
- 2016Value Iteration Networkscited by 160
- 2017Neural Episodic Controlcited by 151
- 2019Learning Exploration Policies for Navigationcited by 116
- 2018Building Generalizable Agents with a Realistic and Rich 3D Environmentcited by 109
- 2018Episodic Curiosity through Reachabilitycited by 109
- 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 107
- 2020Occupancy Anticipation for Efficient Exploration and Navigationcited by 106
- 2018Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learningcited by 93
- 2017Neural Map: Structured Memory for Deep Reinforcement Learningcited by 90
- 2018Visual Representations for Semantic Target Driven Navigationcited by 89
- 2016Control of Memory, Active Perception, and Action in Minecraftcited by 61
- 2021Learning to Map for Active Semantic Goal Navigationcited by 50
- 2019Bayesian Relational Memory for Semantic Visual Navigationcited by 48
- 2020SSCNav: Confidence-Aware Semantic Scene Completion for Visual Semantic Navigationcited by 44
- 2021Visual Navigation with Spatial Attentioncited by 43
- 2016Learning to Act by Predicting the Futurecited by 36
- 2020Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigationcited by 34
- 2017Im2Pano3D: Extrapolating 360 Structure and Semantics Beyond the Field of Viewcited by 25
- 2020Exploiting Scene-specific Features for Object Goal Navigationcited by 20
- 2021Environment Predictive Coding for Embodied Agentscited by 12
- 2021POMP++: Pomcp-based Active Visual Search in unknown indoor environmentscited by 4
- 2021Spatial Imagination With Semantic Cognition for Mobile Robotscited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 6; 2024: 5; 2025: 4.
16 papers.
Sort:
By area:
- 2022Navigating to Objects in the Real Worldcited by 106
- 2023OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNavcited by 70
- 2023Learning Navigational Visual Representations with Semantic Map Supervisioncited by 43
- 2023Object Goal Navigation with Recursive Implicit Mapscited by 16
- 2024TopV-Nav: Unlocking the Top-View Spatial Reasoning Potential of MLLM for Zero-shot Object Navigationcited by 15
- 2024Tag Map: A Text-Based Map for Spatial Reasoning and Navigation with Large Language Modelscited by 12
- 2023ENTL: Embodied Navigation Trajectory Learnercited by 11
- 2023MOPA: Modular Object Navigation with PointGoal Agentscited by 11
- 2024Personalized Instance-based Navigation Toward User-Specific Objects in Realistic Environmentscited by 11
- 2024Perception Matters: Enhancing Embodied AI with Uncertainty-Aware Semantic Segmentationcited by 6
- 2023Learning to Explore Informative Trajectories and Samples for Embodied Perceptioncited by 3
- 2025Distilling LLM Prior to Flow Model for Generalizable Agent's Imagination in Object Goal Navigationcited by 3
4 more
- 2024IN-Sight: Interactive Navigation through Sightcited by 2
- 2025SEA: Semantic Map Prediction for Active Exploration of Uncertain Areascited by 2
- 2025FOM-Nav: Frontier-Object Maps for Object Goal Navigationcited by 1
- 2025ImagineNav++: Prompting Vision-Language Models as Embodied Navigator through Scene Imaginationcited by 1
- 2025ImagineNav++: Prompting Vision-Language Models as Embodied Navigator through Scene Imagination19 Dec 2025
- 2025FOM-Nav: Frontier-Object Maps for Object Goal Navigation30 Nov 2025
- 2025SEA: Semantic Map Prediction for Active Exploration of Uncertain Areas22 Oct 2025
- 2025Distilling LLM Prior to Flow Model for Generalizable Agent's Imagination in Object Goal Navigation13 Aug 2025
- 2024TopV-Nav: Unlocking the Top-View Spatial Reasoning Potential of MLLM for Zero-shot Object Navigation25 Nov 2024
- 2024Personalized Instance-based Navigation Toward User-Specific Objects in Realistic Environments23 Oct 2024
- 2024Tag Map: A Text-Based Map for Spatial Reasoning and Navigation with Large Language Models23 Sep 2024
- 2024Perception Matters: Enhancing Embodied AI with Uncertainty-Aware Semantic Segmentation5 Aug 2024
- 2024IN-Sight: Interactive Navigation through Sight1 Aug 2024
- 2023Object Goal Navigation with Recursive Implicit Maps10 Aug 2023
- 2023Learning Navigational Visual Representations with Semantic Map Supervision23 Jul 2023
- 2023MOPA: Modular Object Navigation with PointGoal Agents7 Apr 2023
4 more
- 2023ENTL: Embodied Navigation Trajectory Learner5 Apr 2023
- 2023Learning to Explore Informative Trajectories and Samples for Embodied Perception20 Mar 2023
- 2023OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNav14 Mar 2023
- 2022Navigating to Objects in the Real World2 Dec 2022
- 2023ENTL: Embodied Navigation Trajectory Learnercited by 11
- 2023ENTL: Embodied Navigation Trajectory Learner5 Apr 2023
- 2022Navigating to Objects in the Real Worldcited by 106
- 2023OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNavcited by 70
- 2023Learning Navigational Visual Representations with Semantic Map Supervisioncited by 43
- 2023Object Goal Navigation with Recursive Implicit Mapscited by 16
- 2023MOPA: Modular Object Navigation with PointGoal Agentscited by 11
- 2024Personalized Instance-based Navigation Toward User-Specific Objects in Realistic Environmentscited by 11
- 2024Perception Matters: Enhancing Embodied AI with Uncertainty-Aware Semantic Segmentationcited by 6
- 2023Learning to Explore Informative Trajectories and Samples for Embodied Perceptioncited by 3
- 2024IN-Sight: Interactive Navigation through Sightcited by 2
- 2025FOM-Nav: Frontier-Object Maps for Object Goal Navigationcited by 1
- 2025FOM-Nav: Frontier-Object Maps for Object Goal Navigation30 Nov 2025
- 2024Personalized Instance-based Navigation Toward User-Specific Objects in Realistic Environments23 Oct 2024
- 2024Perception Matters: Enhancing Embodied AI with Uncertainty-Aware Semantic Segmentation5 Aug 2024
- 2024IN-Sight: Interactive Navigation through Sight1 Aug 2024
- 2023Object Goal Navigation with Recursive Implicit Maps10 Aug 2023
- 2023Learning Navigational Visual Representations with Semantic Map Supervision23 Jul 2023
- 2023MOPA: Modular Object Navigation with PointGoal Agents7 Apr 2023
- 2023Learning to Explore Informative Trajectories and Samples for Embodied Perception20 Mar 2023
- 2023OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNav14 Mar 2023
- 2022Navigating to Objects in the Real World2 Dec 2022