NavForesee: A Unified Vision-Language World Model for Hierarchical Planning and Dual-Horizon Navigation Prediction
On the map: World models → World models for navigation
Abstract (arXiv)
Embodied navigation for long-horizon tasks, guided by complex natural language instructions, remains a formidable challenge in artificial intelligence. Existing agents often struggle with robust long-term planning about unseen environments, leading to high failure rates. To address these limitations, we introduce NavForesee, a novel Vision-Language Model (VLM) that unifies high-level language planning and predictive world model imagination within a single, unified framework. Our approach empowers a single VLM to concurrently perform planning and predictive foresight. Conditioned on the full instruction and historical observations, the model is trained to understand the navigation instructions by decomposing the task, tracking its progress, and formulating the subsequent sub-goal. Simultaneously, it functions as a generative world model, providing crucial foresight by predicting short-term environmental dynamics and long-term navigation milestones. The VLM's structured plan guides its targeted prediction, while the imagined future provides rich context to inform the navigation actions, creating a powerful internal feedback loop of perception-planning/prediction-action. We demonstrate through extensive experiments on the R2R-CE and RxR-CE benchmark that NavForesee achieves highly competitive performance in complex scenarios. Our work highlights the immense potential of fusing explicit language planning with implicit spatiotemporal prediction, paving the way for more intelligent and capable embodied agents.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 49 of its 51 references that are in the map. First posted on arXiv 1 Dec 2025.
Builds on
49 of 51 references.
Closest ancestors · 4
Same direction, newest first
- 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environments30 Jun
- 2024Navigation World Models4 Dec
- 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussions20 Sep
- 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigation14 Aug
Other references · 45
- 2023Visual Instruction Tuningcited by 7,792
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
- 2023LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planningcited by 206
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 187
33 more
- 2023Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifierscited by 170
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 150
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 127
- 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 125
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 117
- 2020Topological Planning with Transformers for Vision-and-Language Navigationcited by 115
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
- 2020Language and Visual Entity Relationship Graph for Agent Navigationcited by 100
- 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
- 2023Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detectioncited by 88
- 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 87
- 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
- 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 80
- 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoningcited by 77
- 2020Evolving Graphical Planner: Contextual Global Planning for Vision-and-Language Navigationcited by 71
- 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 63
- 2023A2Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Modelscited by 61
- 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 60
- 2025Back to the Features: DINO as a Foundation for Video World Modelscited by 56
- 2021SASRA: Semantically-aware Spatio-temporal Reasoning Agent for Vision-and-Language Navigation in Continuous Environmentscited by 48
- 2024DINO-Foresight: Looking into the Future with DINOcited by 44
- 2024ImagineNav: Prompting Vision-Language Models as Embodied Navigator through Scene Imaginationcited by 38
- 2025Nav-R1: Reasoning and Navigation in Embodied Scenescited by 37
- 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 34
- 20221st Place Solutions for RxR-Habitat Vision-and-Language Navigation Competition (CVPR 2022)cited by 30
- 2025CorrectNav: Self-Correction Flywheel Empowers Vision-Language-Action Navigation Modelcited by 26
- 2025LaDi-WM: A Latent Diffusion-based World Model for Predictive Manipulationcited by 24
- 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigationcited by 19
- 2025FlexVLN: Flexible Adaptation for Diverse Vision-and-Language Navigation Taskscited by 16
- 2025DreamNav: A Trajectory-Based Imaginative Framework for Zero-Shot Vision-and-Language Navigationcited by 15
- 2025GaussianVLM: Scene-centric 3D Vision-Language Models using Language-aligned Gaussian Splats for Embodied Reasoning and Beyondcited by 12
Built on by
Citing papers per year: 2026: 15.
15 papers.
Sort:
By area:
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigationcited by 23
- 2026Dual-Anchoring: Addressing State Drift in Vision-Language Navigationcited by 7
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigationcited by 5
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Modelcited by 5
- 2026Explore Like Humans: Autonomous Exploration with Online SG-Memo Construction for Embodied Agentscited by 3
- 2026World Models as Group Actionscited by 3
- 2026PROSPECT: Unified Streaming Vision-Language Navigation via Semantic--Spatial Fusion and Latent Predictive Representationcited by 2
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigationcited by 2
- 2026SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigationcited by 2
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigationcited by 1
- 2026What Limits Vision-and-Language Navigation ?cited by 0
- 2026ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memorycited by 0
3 more
- 2026ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoningcited by 0
- 2026Towards Dual-Brain Minimal Sufficient Representation for Vision-Language Navigationcited by 0
- 2026From Semantic Grounding to Decision Optimization: A Unified Framework for Long-Horizon UAV Vision-Language Navigationcited by 0
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation31 Aug 2026
- 2026From Semantic Grounding to Decision Optimization: A Unified Framework for Long-Horizon UAV Vision-Language Navigation10 Aug 2026
- 2026Towards Dual-Brain Minimal Sufficient Representation for Vision-Language Navigation25 Jul 2026
- 2026ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoning14 Jul 2026
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Model11 Jul 2026
- 2026ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memory11 Jul 2026
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation29 Jun 2026
- 2026World Models as Group Actions23 May 2026
- 2026What Limits Vision-and-Language Navigation ?13 May 2026
- 2026SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigation30 Apr 2026
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation27 Apr 2026
- 2026Explore Like Humans: Autonomous Exploration with Online SG-Memo Construction for Embodied Agents21 Apr 2026
3 more
- 2026Dual-Anchoring: Addressing State Drift in Vision-Language Navigation19 Apr 2026
- 2026PROSPECT: Unified Streaming Vision-Language Navigation via Semantic--Spatial Fusion and Latent Predictive Representation4 Mar 2026
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigation12 Feb 2026
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigationcited by 23
- 2026Dual-Anchoring: Addressing State Drift in Vision-Language Navigationcited by 7
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Modelcited by 5
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigationcited by 2
- 2026SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigationcited by 2
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigationcited by 1
- 2026What Limits Vision-and-Language Navigation ?cited by 0
- 2026From Semantic Grounding to Decision Optimization: A Unified Framework for Long-Horizon UAV Vision-Language Navigationcited by 0
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation31 Aug 2026
- 2026From Semantic Grounding to Decision Optimization: A Unified Framework for Long-Horizon UAV Vision-Language Navigation10 Aug 2026
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Model11 Jul 2026
- 2026What Limits Vision-and-Language Navigation ?13 May 2026
- 2026SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigation30 Apr 2026
- 2026AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation27 Apr 2026
- 2026Dual-Anchoring: Addressing State Drift in Vision-Language Navigation19 Apr 2026
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigation12 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning
- 2025Towards Unified World Models for Visual Navigation via Memory-Augmented Planning and Foresight
- 2026WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Models
- 2025WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigation
- 2026PreAct-Nav: Agentic Reasoning Before Action for Urban Navigation
- 2026Policy-Guided World Model Planning for Language-Conditioned Visual Navigation
- 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation
- 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems