mlsanityData to 14 Oct 2026

Navigating to Objects in Unseen Environments by Distance Prediction

arXiv 2202.03735 ↗First posted 8 Feb 2022cs.RO cs.CVcited by 16

Not on the map. Why?

Abstract (arXiv)

Object Goal Navigation (ObjectNav) task is to navigate an agent to an object category in unseen environments without a pre-built map. In this paper, we solve this task by predicting the distance to the target using semantically-related objects as cues. Based on the estimated distance to the target object, our method directly choose optimal mid-term goals that are more likely to have a shorter path to the target. Specifically, based on the learned knowledge, our model takes a bird's-eye view semantic map as input, and estimates the path length from the frontier map cells to the target object. With the estimated distance map, the agent could simultaneously explore the environment and navigate to the target objects based on a simple human-designed strategy. Empirical results in visually realistic simulation environments show that the proposed method outperforms a wide range of baselines on success rate and efficiency. Real-robot experiment also demonstrates that our method generalizes well to the real world. Video at https://www.youtube.com/watch?v=R79pWVGFKS4

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 36 of its 62 references that are in the map. First posted on arXiv 8 Feb 2022.

Builds on

36 of 62 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2017Mask R-CNNcited by 7,277
  4. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  5. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  6. 2018On Evaluation of Embodied Navigation Agentscited by 547
  7. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
  8. 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 366
  9. 2020Learning to Explore using Active Neural SLAMcited by 316
  10. 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
  11. 2017Cognitive Mapping and Planning for Visual Navigationcited by 212
  12. 2018Semi-parametric Topological Memory for Navigationcited by 209
24 more
  1. 2016Learning to Navigate in Complex Environmentscited by 198
  2. 2020Neural Topological SLAM for Visual Navigationcited by 195
  3. 2016Value Iteration Networkscited by 160
  4. 2017Neural Episodic Controlcited by 151
  5. 2019Learning Exploration Policies for Navigationcited by 116
  6. 2018Building Generalizable Agents with a Realistic and Rich 3D Environmentcited by 109
  7. 2018Episodic Curiosity through Reachabilitycited by 109
  8. 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 107
  9. 2020Occupancy Anticipation for Efficient Exploration and Navigationcited by 106
  10. 2018Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learningcited by 93
  11. 2017Neural Map: Structured Memory for Deep Reinforcement Learningcited by 90
  12. 2018Visual Representations for Semantic Target Driven Navigationcited by 89
  13. 2016Control of Memory, Active Perception, and Action in Minecraftcited by 61
  14. 2021Learning to Map for Active Semantic Goal Navigationcited by 50
  15. 2019Bayesian Relational Memory for Semantic Visual Navigationcited by 48
  16. 2020SSCNav: Confidence-Aware Semantic Scene Completion for Visual Semantic Navigationcited by 44
  17. 2021Visual Navigation with Spatial Attentioncited by 43
  18. 2016Learning to Act by Predicting the Futurecited by 36
  19. 2020Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigationcited by 34
  20. 2017Im2Pano3D: Extrapolating 360 Structure and Semantics Beyond the Field of Viewcited by 25
  21. 2020Exploiting Scene-specific Features for Object Goal Navigationcited by 20
  22. 2021Environment Predictive Coding for Embodied Agentscited by 12
  23. 2021POMP++: Pomcp-based Active Visual Search in unknown indoor environmentscited by 4
  24. 2021Spatial Imagination With Semantic Cognition for Mobile Robotscited by 3

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 6; 2024: 5; 2025: 4.

16 papers.

Sort:

By area: