FantasyVLN: Unified Multimodal Chain-of-Thought Reasoning for Vision-Language Navigation
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Achieving human-level performance in Vision-and-Language Navigation (VLN) requires an embodied agent to jointly understand multimodal instructions and visual-spatial context while reasoning over long action sequences. Recent works, such as NavCoT and NavGPT-2, demonstrate the potential of Chain-of-Thought (CoT) reasoning for improving interpretability and long-horizon planning. Moreover, multimodal extensions like OctoNav-R1 and CoT-VLA further validate CoT as a promising pathway toward human-like navigation reasoning. However, existing approaches face critical drawbacks: purely textual CoTs lack spatial grounding and easily overfit to sparse annotated reasoning steps, while multimodal CoTs incur severe token inflation by generating imagined visual observations, making real-time navigation impractical. In this work, we propose FantasyVLN, a unified implicit reasoning framework that preserves the benefits of CoT reasoning without explicit token overhead. Specifically, imagined visual tokens are encoded into a compact latent space using a pretrained Visual AutoRegressor (VAR) during CoT reasoning training, and the model jointly learns from textual, visual, and multimodal CoT modes under a unified multi-CoT strategy. At inference, our model performs direct instruction-to-action mapping while still enjoying reasoning-aware representations. Extensive experiments on LH-VLN show that our approach achieves reasoning-aware yet real-time navigation, improving success rates and efficiency while reducing inference latency by an order of magnitude compared to explicit CoT methods.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 34 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
9 of 34 references.
Closest ancestors · 1
Same direction, newest first
Other references · 8
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
- 2025Diffusion Transformers with Representation Autoencoderscited by 295
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 117
- 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 36
- 2025Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thoughtcited by 35
- 2025VISTA: Generative Visual Imagination for Vision-and-Language Navigationcited by 9
- 2025RBF++: Quantifying and Optimizing Reasoning Boundaries across Measurable and Unmeasurable Capabilities for Chain-of-Thought Reasoningcited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026OptiSight: Bridging Semantic Reasoning and Geometric Control for Embodied Navigation24 Aug 2026
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Model11 Jul 2026
- 2026LatentPilot: Scene-Aware Vision-and-Language Navigation by Dreaming Ahead with Latent Visual Reasoning31 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation
- 2025EvolveNav: Empowering LLM-Based Vision-Language Navigation via Self-Improving Embodied Reasoning
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision
- 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoning
- 2025UNeMo: Collaborative Visual-Language Reasoning and Navigation via a Multimodal World Model
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models
- 2026DualCoT-VLA: Visual-Linguistic Chain of Thought via Parallel Reasoning for Vision-Language-Action Models
- 2025VLN-MME: Diagnosing MLLMs as Language-guided Visual Navigation agents