Schr"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation
Not on the map. Why?
Abstract (arXiv)
Zero-shot object navigation (ZSON) requires robots to find target objects in unseen environments without task-specific fine-tuning or pre-built maps, a key capability for general-purpose service robots. Yet methods that perform well in simulation often degrade in cluttered real-world scenes with severe occlusion and latent hazards, where large unseen regions make single-scene inference brittle and unsafe. We propose Schr"odinger's Navigator, a belief-aware framework that reasons at inference time over multiple trajectory-conditioned imagined 3D futures. Given candidate paths, a trajectory-conditioned 3D world model predicts hypothetical observations and maintains a superposition of plausible scene realizations rather than committing to one map. An adaptive occluder-aware sampler directs imagination to uncertainty-critical regions, while a Future-Aware Value Map (FAVM) aggregates imagined futures for robust, proactive action selection. Experiments in simulation and on a physical Go2 quadruped show that Schr"odinger's Navigator outperforms strong ZSON baselines, improving hidden-target discovery and risk-aware waypoint selection in occlusion-heavy navigation scenarios. These results highlight imagined 3D futures as a scalable and generalizable strategy for zero-shot navigation in uncertain real-world environments.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 50 of its 60 references that are in the map. First posted on arXiv 24 Dec 2025.
Builds on
50 of 60 references.
References · 50
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2024GPT-4o System Cardcited by 4,467
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
- 2018On Evaluation of Embodied Navigation Agentscited by 526
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 435
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
- 2020Learning to Explore using Active Neural SLAMcited by 308
- 2024Navigation World Modelscited by 262
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
38 more
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 177
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 150
- 2017Imagination-Augmented Agents for Deep Reinforcement Learningcited by 137
- 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 126
- 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 118
- 2021Pathdreamer: A World Model for Indoor Navigationcited by 117
- 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 116
- 2020Occupancy Anticipation for Efficient Exploration and Navigationcited by 104
- 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 91
- 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 82
- 2023Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skillcited by 75
- 2023General Object Foundation Model for Images and Videos at Scalecited by 71
- 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Modelscited by 66
- 2024VoroNav: Voronoi-based Zero-shot Object Navigation with Large Language Modelcited by 55
- 2023How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontierscited by 53
- 2023Renderable Neural Radiance Map for Visual Navigationcited by 51
- 2021Visual Navigation with Spatial Attentioncited by 43
- 2019A Behavioral Approach to Visual Navigation with Graph Localization Networkscited by 40
- 2024ImagineNav: Prompting Vision-Language Models as Embodied Navigator through Scene Imaginationcited by 38
- 2024CogNav: Cognitive Process Modeling for Object Goal Navigation with LLMscited by 32
- 2025FlashWorld: High-quality 3D Scene Generation within Secondscited by 30
- 2022Zero-shot object goal visual navigationcited by 29
- 2025ApexNav: An Adaptive Exploration Strategy for Zero-Shot Object Navigation with Target-centric Semantic Fusioncited by 29
- 2024TriHelper: Zero-Shot Object Navigation with Dynamic Assistancecited by 24
- 2021Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perceptioncited by 22
- 2024GAMap: Zero-Shot Object Goal Navigation with Multi-Scale Geometric-Affordance Guidancecited by 22
- 2025BeliefMapNav: 3D Voxel-Based Belief Map for Zero-Shot Object Navigationcited by 18
- 2024X-MOBILITY: End-To-End Generalizable Navigation via World Modelingcited by 15
- 2025DreamNav: A Trajectory-Based Imaginative Framework for Zero-Shot Vision-and-Language Navigationcited by 15
- 2025Do Visual Imaginations Improve Vision-and-Language Navigation Agents?cited by 14
- 2017Provably Safe Robot Navigation with Obstacle Uncertaintycited by 12
- 2025NavigateDiff: Visual Predictors are Zero-Shot Navigation Assistantscited by 11
- 2025ForesightNav: Learning Scene Imagination for Efficient Explorationcited by 9
- 2025VISTA: Generative Visual Imagination for Vision-and-Language Navigationcited by 8
- 2025VISTAv2: World Imagination for Indoor Vision-and-Language Navigationcited by 6
- 2023ProxMaP: Proximal Occupancy Map Prediction for Efficient Indoor Robot Navigationcited by 2
- 2022OA-MPC: Occlusion-Aware MPC for Guaranteed Safe Robot Navigation with Unseen Dynamic Obstaclescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026SpatialAnt: Autonomous Zero-Shot Robot Navigation via Active Scene Reconstruction and Visual Anticipation
- 2025Imaginative World Modeling with Scene Graphs for Embodied Agent Navigation
- 2026Imagine-TAMP: Imagination-Guided Task and Motion Planning in Partial Observability ↗
- 2025Towards Unified World Models for Visual Navigation via Memory-Augmented Planning and Foresight
- 2026CATNAV: Cached Vision-Language Traversability for Efficient Zero-Shot Robot Navigation
- 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning
- 2026Rectified Schr"odinger Bridge Matching for Few-Step Visual Navigation
- 2025AstraNav-World: World Model for Foresight Control and Consistency