ConsistNav: Closing the Action Consistency Gap in Zero-Shot Object Navigation with Semantic Executive Control
Not on the map. Why?
Abstract (arXiv)
Zero-shot object navigation has advanced rapidly with open-vocabulary detectors, image--text models, and language-guided exploration. However, even after current methods detect a plausible target hypothesis, the agent may still oscillate between exploration and pursuit, or abandon the object near success. We identify this failure mode as an action consistency gap: semantic evidence is repeatedly reinterpreted at each step without persistent commitment across the episode. We introduce ConsistNav, a training-free zero-shot ObjectNav framework built around a semantic executive composed of three coordinated modules: Finite-State Executive Controller stages target pursuit through guarded semantic phases; Persistent Candidate Memory accumulates cross-frame target evidence into stable object hypotheses; and Stability-Aware Action Control suppresses rotational stagnation, ineffective pursuit, and unverified stopping. This design changes neither the detector nor the low-level planner; instead, it controls when semantic evidence should influence navigation and when it should be suppressed or revisited. We conduct extensive experiments on HM3D and MP3D, where ConsistNav achieves state-of-the-art results among compared zero-shot ObjectNav methods and improves SR by 11.4% and SPL by 7.9% over the controlled baseline on MP3D. Ablation studies and real-world deployment experiments further demonstrate the effectiveness and robustness of the proposed executive mechanism.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 45 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
39 of 45 references.
References · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2021Grounded Language-Image Pre-trainingcited by 1,156
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 906
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2018On Evaluation of Embodied Navigation Agentscited by 547
27 more
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
- 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 352
- 2020Learning to Explore using Active Neural SLAMcited by 316
- 2022Simple Open-Vocabulary Object Detection with Vision Transformerscited by 305
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 205
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2021Simple but Effective: CLIP Embeddings for Embodied AIcited by 191
- 2019Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mappingcited by 184
- 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 178
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 150
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 135
- 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 127
- 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 120
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 117
- 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 109
- 2017Behavior Trees in Robotics and AI: An Introductioncited by 107
- 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 93
- 2023OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNavcited by 70
- 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Modelscited by 67
- 2023SayNav: Grounding Large Language Models for Dynamic Planning to Navigation in New Environmentscited by 53
- 2025ApexNav: An Adaptive Exploration Strategy for Zero-Shot Object Navigation with Target-centric Semantic Fusioncited by 30
- 2024TriHelper: Zero-Shot Object Navigation with Dynamic Assistancecited by 25
Built on by
Citing papers per year: 2026: 1.
1 paper.