mlsanityData to 7 Oct 2026

NavForesee: A Unified Vision-Language World Model for Hierarchical Planning and Dual-Horizon Navigation Prediction

arXiv 2512.01550 ↗First posted 1 Dec 2025cs.RO cs.CVcited by 15

On the map: World models → World models for navigation

Abstract (arXiv)

Embodied navigation for long-horizon tasks, guided by complex natural language instructions, remains a formidable challenge in artificial intelligence. Existing agents often struggle with robust long-term planning about unseen environments, leading to high failure rates. To address these limitations, we introduce NavForesee, a novel Vision-Language Model (VLM) that unifies high-level language planning and predictive world model imagination within a single, unified framework. Our approach empowers a single VLM to concurrently perform planning and predictive foresight. Conditioned on the full instruction and historical observations, the model is trained to understand the navigation instructions by decomposing the task, tracking its progress, and formulating the subsequent sub-goal. Simultaneously, it functions as a generative world model, providing crucial foresight by predicting short-term environmental dynamics and long-term navigation milestones. The VLM's structured plan guides its targeted prediction, while the imagined future provides rich context to inform the navigation actions, creating a powerful internal feedback loop of perception-planning/prediction-action. We demonstrate through extensive experiments on the R2R-CE and RxR-CE benchmark that NavForesee achieves highly competitive performance in complex scenarios. Our work highlights the immense potential of fusing explicit language planning with implicit spatiotemporal prediction, paving the way for more intelligent and capable embodied agents.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 49 of its 51 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

49 of 51 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environments30 Jun
  2. 2024Navigation World Models4 Dec
  3. 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussions20 Sep
  4. 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigation14 Aug

Other references · 45

  1. 2023Visual Instruction Tuningcited by 7,792
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  4. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  5. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
  6. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
  7. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  8. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
  9. 2023LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planningcited by 206
  10. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
  11. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
  12. 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 187
33 more
  1. 2023Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifierscited by 170
  2. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
  3. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 150
  4. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
  5. 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 127
  6. 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 125
  7. 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 117
  8. 2020Topological Planning with Transformers for Vision-and-Language Navigationcited by 115
  9. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
  10. 2020Language and Visual Entity Relationship Graph for Agent Navigationcited by 100
  11. 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
  12. 2023Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detectioncited by 88
  13. 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 87
  14. 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
  15. 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 80
  16. 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoningcited by 77
  17. 2020Evolving Graphical Planner: Contextual Global Planning for Vision-and-Language Navigationcited by 71
  18. 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 63
  19. 2023A2Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Modelscited by 61
  20. 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 60
  21. 2025Back to the Features: DINO as a Foundation for Video World Modelscited by 56
  22. 2021SASRA: Semantically-aware Spatio-temporal Reasoning Agent for Vision-and-Language Navigation in Continuous Environmentscited by 48
  23. 2024DINO-Foresight: Looking into the Future with DINOcited by 44
  24. 2024ImagineNav: Prompting Vision-Language Models as Embodied Navigator through Scene Imaginationcited by 38
  25. 2025Nav-R1: Reasoning and Navigation in Embodied Scenescited by 37
  26. 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 34
  27. 20221st Place Solutions for RxR-Habitat Vision-and-Language Navigation Competition (CVPR 2022)cited by 30
  28. 2025CorrectNav: Self-Correction Flywheel Empowers Vision-Language-Action Navigation Modelcited by 26
  29. 2025LaDi-WM: A Latent Diffusion-based World Model for Predictive Manipulationcited by 24
  30. 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigationcited by 19
  31. 2025FlexVLN: Flexible Adaptation for Diverse Vision-and-Language Navigation Taskscited by 16
  32. 2025DreamNav: A Trajectory-Based Imaginative Framework for Zero-Shot Vision-and-Language Navigationcited by 15
  33. 2025GaussianVLM: Scene-centric 3D Vision-Language Models using Language-aligned Gaussian Splats for Embodied Reasoning and Beyondcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 15.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning
  2. 2025Towards Unified World Models for Visual Navigation via Memory-Augmented Planning and Foresight
  3. 2026WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Models
  4. 2025WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigation
  5. 2026PreAct-Nav: Agentic Reasoning Before Action for Urban Navigation
  6. 2026Policy-Guided World Model Planning for Language-Conditioned Visual Navigation
  7. 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation
  8. 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems