AERR-Nav: Adaptive Exploration-Recovery-Reminiscing Strategy for Zero-Shot Object Navigation
Not on the map. Why?
Abstract (arXiv)
Zero-Shot Object Navigation (ZSON) in unknown multi-floor environments presents a significant challenge. Recent methods, mostly based on semantic value greedy waypoint selection, spatial topology-enhanced memory, and Multimodal Large Language Model (MLLM) as a decision-making framework, have led to improvements. However, these architectures struggle to balance exploration and exploitation for ZSON when encountering unseen environments, especially in multi-floor settings, such as robots getting stuck at narrow intersections, endlessly wandering, or failing to find stair entrances. To overcome these challenges, we propose AERR-Nav, a Zero-Shot Object Navigation framework that dynamically adjusts its state based on the robot's environment. Specifically, AERR-Nav has the following two key advantages: (1) An Adaptive Exploration-Recovery-Reminiscing Strategy, enables robots to dynamically transition between three states, facilitating specialized responses to diverse navigation scenarios. (2) An Adaptive Exploration State featuring Fast and Slow-Thinking modes helps robots better balance exploration, exploitation, and higher-level reasoning based on evolving environmental information. Extensive experiments on the HM3D and MP3D benchmarks demonstrate that our AERR-Nav achieves state-of-the-art performance among zero-shot methods. Comprehensive ablation studies further validate the efficacy of our proposed strategy and modules.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 45 of its 49 references that are in the map. First posted on arXiv 18 Mar 2026.
Builds on
45 of 49 references.
References · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2023Segment Anythingcited by 8,195
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,103
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,314
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,299
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,360
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 803
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 583
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2023Recognize Anything: A Strong Image Tagging Modelcited by 306
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
33 more
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 177
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 152
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
- 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 126
- 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 118
- 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 106
- 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 92
- 20243D-Mem: 3D Scene Memory for Embodied Exploration and Reasoningcited by 74
- 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Modelscited by 66
- 2024ImagineNav: Prompting Vision-Language Models as Embodied Navigator through Scene Imaginationcited by 38
- 2024CogNav: Cognitive Process Modeling for Object Goal Navigation with LLMscited by 32
- 2024Prioritized Semantic Learning for Zero-shot Instance Navigationcited by 30
- 2025ApexNav: An Adaptive Exploration Strategy for Zero-Shot Object Navigation with Target-centric Semantic Fusioncited by 29
- 2022Object Memory Transformer for Object Goal Navigationcited by 19
- 2024SEEK: Semantic Reasoning for Object Goal Navigation in Real World Inspection Taskscited by 18
- 2024Zero-shot Object Navigation with Vision-Language Models Reasoningcited by 18
- 2025BeliefMapNav: 3D Voxel-Based Belief Map for Zero-Shot Object Navigationcited by 18
- 2023Object Goal Navigation with Recursive Implicit Mapscited by 16
- 2025Open Scene Graphs for Open-World Object-Goal Navigationcited by 14
- 2024Multi-Floor Zero-Shot Object Navigation Policycited by 12
- 2024VLN-Game: Vision-Language Equilibrium Search for Zero-Shot Semantic Navigationcited by 11
- 2025CL-CoTNav: Closed-Loop Hierarchical Chain-of-Thought for Zero-Shot Object-Goal Navigation with Vision-Language Modelscited by 11
- 2025Stairway to Success: An Online Floor-Aware Zero-Shot Object-Goal Navigation Framework via LLM-Driven Coarse-to-Fine Explorationcited by 10
- 2020Efficient Robotic Object Search via HIEM: Hierarchical Policy Learning with Intrinsic-Extrinsic Modelingcited by 9
- 2023Exploitation-Guided Exploration for Semantic Embodied Navigationcited by 9
- 2026SpatialNav: Leveraging Spatial Scene Graphs for Zero-Shot Vision-and-Language Navigationcited by 9
- 2024LOC-ZSON: Language-driven Object-Centric Zero-Shot Object Retrieval and Navigationcited by 8
- 2025Handle Object Navigation as Weighted Traveling Repairman Problemcited by 3
- 20263DGSNav: Enhancing Vision-Language Model Reasoning for Object Navigation via Active 3D Gaussian Splattingcited by 3
- 2025SemNav: A Model-Based Planner for Zero-Shot Object Goal Navigation Using Vision-Foundation Modelscited by 2
- 2025SSR-ZSON: Zero-Shot Object Navigation via Spatial-Semantic Relations within a Hierarchical Exploration Frameworkcited by 2
- 2025What Matters in RL-Based Methods for Object-Goal Navigation? An Empirical Study and A Unified Frameworkcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025History-Augmented Vision-Language Models for Frontier-Based Zero-Shot Object Navigation
- 2025MAG-Nav: Language-Driven Object Navigation Leveraging Memory-Reserved Active Grounding ↗
- 2026ZONDA: Zero-shot Object Navigation with Dynamic Avoidance in Multi-floor Environments ↗
- 2026CATNAV: Cached Vision-Language Traversability for Efficient Zero-Shot Robot Navigation
- 2026MarvisNav: Making Memory Visible on Route Choices for Zero-Shot Object Navigation ↗
- 2025PanoNav: Mapless Zero-Shot Object Navigation with Panoramic Scene Parsing and Dynamic Memory
- 2025VLN-Zero: Rapid Exploration and Cache-Enabled Neurosymbolic Vision-Language Planning for Zero-Shot Transfer in Robot Navigation
- 2026Hydra-Nav: Object Navigation via Adaptive Dual-Process Reasoning