mlsanityData to 14 Oct 2026

FantasyVLN: Unified Multimodal Chain-of-Thought Reasoning for Vision-Language Navigation

arXiv 2601.13976 ↗First posted 20 Jan 2026cs.CV cs.ROcited by 3

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Achieving human-level performance in Vision-and-Language Navigation (VLN) requires an embodied agent to jointly understand multimodal instructions and visual-spatial context while reasoning over long action sequences. Recent works, such as NavCoT and NavGPT-2, demonstrate the potential of Chain-of-Thought (CoT) reasoning for improving interpretability and long-horizon planning. Moreover, multimodal extensions like OctoNav-R1 and CoT-VLA further validate CoT as a promising pathway toward human-like navigation reasoning. However, existing approaches face critical drawbacks: purely textual CoTs lack spatial grounding and easily overfit to sparse annotated reasoning steps, while multimodal CoTs incur severe token inflation by generating imagined visual observations, making real-time navigation impractical. In this work, we propose FantasyVLN, a unified implicit reasoning framework that preserves the benefits of CoT reasoning without explicit token overhead. Specifically, imagined visual tokens are encoded into a compact latent space using a pretrained Visual AutoRegressor (VAR) during CoT reasoning training, and the model jointly learns from textual, visual, and multimodal CoT modes under a unified multi-CoT strategy. At inference, our model performs direct instruction-to-action mapping while still enjoying reasoning-aware representations. Extensive experiments on LH-VLN show that our approach achieves reasoning-aware yet real-time navigation, improving success rates and efficiency while reducing inference latency by an order of magnitude compared to explicit CoT methods.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 34 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

9 of 34 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025OctoNav: Towards Generalist Embodied Navigation11 Jun

Other references · 8

  1. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
  2. 2025Diffusion Transformers with Representation Autoencoderscited by 295
  3. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
  4. 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 117
  5. 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 36
  6. 2025Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thoughtcited by 35
  7. 2025VISTA: Generative Visual Imagination for Vision-and-Language Navigationcited by 9
  8. 2025RBF++: Quantifying and Optimizing Reasoning Boundaries across Measurable and Unmeasurable Capabilities for Chain-of-Thought Reasoningcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation
  2. 2025EvolveNav: Empowering LLM-Based Vision-Language Navigation via Self-Improving Embodied Reasoning
  3. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision
  4. 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoning
  5. 2025UNeMo: Collaborative Visual-Language Reasoning and Navigation via a Multimodal World Model
  6. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models
  7. 2026DualCoT-VLA: Visual-Linguistic Chain of Thought via Parallel Reasoning for Vision-Language-Action Models
  8. 2025VLN-MME: Diagnosing MLLMs as Language-guided Visual Navigation agents