mlsanityData to 7 Oct 2026

Hierarchical Object-to-Zone Graph for Object Navigation

arXiv 2109.02066 ↗First posted 5 Sep 2021cs.CVcited by 34

Not on the map. Why?

Abstract (arXiv)

The goal of object navigation is to reach the expected objects according to visual information in the unseen environments. Previous works usually implement deep models to train an agent to predict actions in real-time. However, in the unseen environment, when the target object is not in egocentric view, the agent may not be able to make wise decisions due to the lack of guidance. In this paper, we propose a hierarchical object-to-zone (HOZ) graph to guide the agent in a coarse-to-fine manner, and an online-learning mechanism is also proposed to update HOZ according to the real-time observation in new environments. In particular, the HOZ graph is composed of scene nodes, zone nodes and object nodes. With the pre-learned HOZ graph, the real-time observation and the target goal, the agent can constantly plan an optimal path from zone to zone. In the estimated path, the next potential zone is regarded as sub-goal, which is also fed into the deep reinforcement learning model for action prediction. Our methods are evaluated on the AI2-Thor simulator. In addition to widely used evaluation metrics SR and SPL, we also propose a new evaluation metric of SAE that focuses on the effective action rate. Experimental results demonstrate the effectiveness and efficiency of our proposed method.

Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 34 of its 45 references that are in the map. First posted on arXiv 5 Sep 2021.

Builds on

34 of 45 references.

References · 34

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  5. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  6. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
  7. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  8. 2018On Evaluation of Embodied Navigation Agentscited by 526
  9. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
  10. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
  11. 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
  12. 2020Learning to Explore using Active Neural SLAMcited by 308
22 more
  1. 2016CAD2RL: Real Single-Image Flight without a Single Real Imagecited by 227
  2. 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
  3. 2018Semi-parametric Topological Memory for Navigationcited by 203
  4. 2020Neural Topological SLAM for Visual Navigationcited by 193
  5. 2016Learning to Navigate in Complex Environmentscited by 192
  6. 2020RoboTHOR: An Open Simulation-to-Real Embodied AI Platformcited by 190
  7. 2018Zero-shot Recognition via Semantic Embeddings and Knowledge Graphscited by 155
  8. 2018Visual Semantic Navigation using Scene Priorscited by 127
  9. 2019Learning Exploration Policies for Navigationcited by 113
  10. 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 106
  11. 2018Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learningcited by 91
  12. 2018Visual Representations for Semantic Target Driven Navigationcited by 89
  13. 2017Self-supervised Deep Reinforcement Learning with Generalized Computation Graphs for Robot Navigationcited by 74
  14. 2016The More You Know: Using Knowledge Graphs for Image Classificationcited by 63
  15. 2020Learning Object Relation Graph and Tentative Policy for Visual Navigationcited by 62
  16. 2019Combining Optimal Control and Learning for Visual Navigation in Novel Environmentscited by 50
  17. 2019Bayesian Relational Memory for Semantic Visual Navigationcited by 48
  18. 2019A Behavioral Approach to Visual Navigation with Graph Localization Networkscited by 40
  19. 2019Unsupervised Reinforcement Learning of Transferable Meta-Skills for Embodied Navigationcited by 39
  20. 2019Scaling Local Control to Large-Scale Topological Navigationcited by 37
  21. 2015segDeepM: Exploiting Segmentation and Context in Deep Neural Networks for Object Detectioncited by 7
  22. 2015Learning Contextual Dependencies with Convolutional Hierarchical Recurrent Neural Networkscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 5; 2023: 9; 2024: 11; 2025: 3; 2026: 5.

34 papers.

Sort:

By area:

  1. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
  2. 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
  3. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 117
  4. 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 106
  5. 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 63
  6. 2023How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontierscited by 53
  7. 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 34
  8. 2022Search for or Navigate to? Dual Adaptive Thinking for Object Navigationcited by 19
  9. 2024g3D-LF: Generalizable 3D-Language Feature Fields for Embodied Taskscited by 18
  10. 2022Unbiased Directed Object Attention Graph for Object Navigationcited by 17
  11. 2024Instance-aware Exploration-Verification-Exploitation for Instance ImageGoal Navigationcited by 15
  12. 2023Graph based Environment Representation for Vision-and-Language Navigation in Continuous Environmentscited by 9
22 more
  1. 2025ForesightNav: Learning Scene Imagination for Efficient Explorationcited by 9
  2. 2023Multiple Thinking Achieving Meta-Ability Decoupling for Object Navigationcited by 8
  3. 2024Aligning Knowledge Graph with Visual Perception for Object-goal Navigationcited by 8
  4. 2025EfficientNav: Towards On-Device Object-Goal Navigation with Navigation Map Caching and Retrievalcited by 5
  5. 2022Spatial Relation Graph and Graph Convolutional Network for Object Goal Navigationcited by 3
  6. 2023Implicit Obstacle Map-driven Indoor Navigation Model for Robust Obstacle Avoidancecited by 3
  7. 2023Building Category Graphs Representation with Spatial and Temporal Attention for Visual Navigationcited by 2
  8. 2026PSG-Nav: Probabilistic Scene Graph Navigation via Multiverse Decision Makingcited by 2
  9. 2022Unsupervised Visual Odometry and Action Integration for PointGoal Navigation in Indoor Environmentcited by 1
  10. 2023Task-Driven Graph Attention for Hierarchical Relational Object Navigationcited by 1
  11. 2023Learning to Terminate in Object Navigationcited by 1
  12. 2024RobKiNet: Robotic Kinematics Informed Neural Network for Optimal Robot Configuration Predictioncited by 1
  13. 2021Symmetry-aware Neural Architecture for Embodied Visual Navigationcited by 0
  14. 2024Temporal-Spatial Object Relations Modeling for Vision-and-Language Navigationcited by 0
  15. 2024Leveraging Unknown Objects to Construct Labeled-Unlabeled Meta-Relationships for Zero-Shot Object Navigationcited by 0
  16. 2024Efficient Strategy Learning by Decoupling Searching and Pathfinding for Object Navigationcited by 0
  17. 2024Semantic Environment Atlas for Object-Goal Navigationcited by 0
  18. 2025Collision-Aware Object-Goal Visual Navigation via Two-Stage Deep Reinforcement Learningcited by 0
  19. 2026CoReLIN: Constraint-based Reasoning for Zero-shot Lifelong Interactive Navigationcited by 0
  20. 2026SR-Nav: Spatial Relationships Matter for Zero-shot Object Goal Navigationcited by 0
  21. 2026GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigationcited by 0
  22. 2026Graph-MambaNav: Spatial-Temporal Graph Mamba Leveraging Object-Relation Knowledge for Object-Goal Navigationcited by 0