Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Vision-Language Navigation (VLN) is a critical task for developing embodied agents that can follow natural language instructions to navigate in complex real-world environments. Recent advances in VLN by large pretrained models have significantly improved generalization and instruction grounding compared to traditional approaches. However, the role of reasoning strategies in navigation-an action-centric, long-horizon task-remains underexplored, despite Chain-of-Thought (CoT) reasoning's demonstrated success in static tasks like visual question answering. To address this gap, we conduct the first systematic evaluation of reasoning strategies for VLN, including No-Think (direct action prediction), Pre-Think (reason before action), and Post-Think (reason after action). Surprisingly, our findings reveal the Inference-time Reasoning Collapse issue, where inference-time reasoning degrades navigation accuracy, highlighting the challenges of integrating reasoning into VLN. Based on this insight, we propose Aux-Think, a framework that trains models to internalize structured reasoning patterns through CoT supervision, while inferring action directly without reasoning in online prediction. To support this framework, we release R2R-CoT-320k, the first Chain-of-Thought annotated dataset for VLN. Extensive experiments show that Aux-Think reduces training effort greatly and achieves the best performance under the same data scale.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. First posted on arXiv 17 May 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 5; 2026: 16.
21 papers.
Sort:
By area:
- 2025MonoDream: Monocular Vision-Language Navigation with Panoramic Dreamingcited by 16
- 2025NavForesee: A Unified Vision-Language World Model for Hierarchical Planning and Dual-Horizon Navigation Predictioncited by 16
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigationcited by 12
- 2026VLingNav: Embodied Navigation with Adaptive Reasoning and Visual-Assisted Linguistic Memorycited by 10
- 2025Vision to Geometry: 3D Spatial Memory for Sequential Embodied MLLM Reasoning and Explorationcited by 5
- 2025D3D-VLP: Dynamic 3D Vision-Language-Planning Model for Embodied Grounding and Navigationcited by 5
- 2026textscNaVIDA: Vision-Language Navigation with Inverse Dynamics Augmentationcited by 5
- 2026MapDream: Task-Driven Map Learning for Vision-Language Navigationcited by 4
- 2026GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigationcited by 2
- 2026SVLL: Staged Vision-Language Learning for Physically Grounded Embodied Task Planningcited by 1
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memorycited by 1
- 2026A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigationcited by 1
9 more
- 2026SC2-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environmentscited by 1
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigationcited by 1
- 2026HiRO-Nav: Hybrid ReasOning Enables Efficient Embodied Navigationcited by 0
- 2026NavOne: One-Step Global Planning for Vision-Language Navigation on Top-Down Mapscited by 0
- 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generationcited by 0
- 2026PanoVLN: Towards Effective Panoramic Vision-and-Language Navigationcited by 0
- 2026Seek Before You Move: Evidence Seeking for Progress Grounding in Vision-Language Navigationcited by 0
- 2026StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language Navigationcited by 0
- 2026GuidedNav: Shaping Vision-Language Navigation Representations through Pre-action Attention and Spatial Guidancecited by 0
- 2026GuidedNav: Shaping Vision-Language Navigation Representations through Pre-action Attention and Spatial Guidance9 Oct 2026
- 2026StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language Navigation5 Oct 2026
- 2026Seek Before You Move: Evidence Seeking for Progress Grounding in Vision-Language Navigation29 Sep 2026
- 2026PanoVLN: Towards Effective Panoramic Vision-and-Language Navigation28 Sep 2026
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation31 Aug 2026
- 2026SC2-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environments1 Aug 2026
- 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation12 Jul 2026
- 2026A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation9 Jul 2026
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory22 Jun 2026
- 2026GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigation21 May 2026
- 2026NavOne: One-Step Global Planning for Vision-Language Navigation on Top-Down Maps7 May 2026
- 2026HiRO-Nav: Hybrid ReasOning Enables Efficient Embodied Navigation9 Apr 2026
9 more
- 2026SVLL: Staged Vision-Language Learning for Physically Grounded Embodied Task Planning12 Mar 2026
- 2026MapDream: Task-Driven Map Learning for Vision-Language Navigation30 Jan 2026
- 2026textscNaVIDA: Vision-Language Navigation with Inverse Dynamics Augmentation26 Jan 2026
- 2026VLingNav: Embodied Navigation with Adaptive Reasoning and Visual-Assisted Linguistic Memory13 Jan 2026
- 2025D3D-VLP: Dynamic 3D Vision-Language-Planning Model for Embodied Grounding and Navigation14 Dec 2025
- 2025Vision to Geometry: 3D Spatial Memory for Sequential Embodied MLLM Reasoning and Exploration2 Dec 2025
- 2025NavForesee: A Unified Vision-Language World Model for Hierarchical Planning and Dual-Horizon Navigation Prediction1 Dec 2025
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigation26 Nov 2025
- 2025MonoDream: Monocular Vision-Language Navigation with Panoramic Dreaming4 Aug 2025
- 2025Vision to Geometry: 3D Spatial Memory for Sequential Embodied MLLM Reasoning and Explorationcited by 5
- 2026GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigationcited by 2
- 2026HiRO-Nav: Hybrid ReasOning Enables Efficient Embodied Navigationcited by 0
- 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generationcited by 0
- 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation12 Jul 2026
- 2026GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigation21 May 2026
- 2026HiRO-Nav: Hybrid ReasOning Enables Efficient Embodied Navigation9 Apr 2026
- 2025Vision to Geometry: 3D Spatial Memory for Sequential Embodied MLLM Reasoning and Exploration2 Dec 2025
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigationcited by 12
- 2025D3D-VLP: Dynamic 3D Vision-Language-Planning Model for Embodied Grounding and Navigationcited by 5
- 2026textscNaVIDA: Vision-Language Navigation with Inverse Dynamics Augmentationcited by 5
- 2026MapDream: Task-Driven Map Learning for Vision-Language Navigationcited by 4
- 2026A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigationcited by 1
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigationcited by 1
- 2026NavOne: One-Step Global Planning for Vision-Language Navigation on Top-Down Mapscited by 0
- 2026Seek Before You Move: Evidence Seeking for Progress Grounding in Vision-Language Navigationcited by 0
- 2026GuidedNav: Shaping Vision-Language Navigation Representations through Pre-action Attention and Spatial Guidancecited by 0
- 2026GuidedNav: Shaping Vision-Language Navigation Representations through Pre-action Attention and Spatial Guidance9 Oct 2026
- 2026Seek Before You Move: Evidence Seeking for Progress Grounding in Vision-Language Navigation29 Sep 2026
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation31 Aug 2026
- 2026A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation9 Jul 2026
- 2026NavOne: One-Step Global Planning for Vision-Language Navigation on Top-Down Maps7 May 2026
- 2026MapDream: Task-Driven Map Learning for Vision-Language Navigation30 Jan 2026
- 2026textscNaVIDA: Vision-Language Navigation with Inverse Dynamics Augmentation26 Jan 2026
- 2025D3D-VLP: Dynamic 3D Vision-Language-Planning Model for Embodied Grounding and Navigation14 Dec 2025
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigation26 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026FantasyVLN: Unified Multimodal Chain-of-Thought Reasoning for Vision-Language Navigation
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models
- 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Model
- 2024End-to-End Navigation with Vision Language Models: Transforming Spatial Reasoning into Question-Answering
- 2025EvolveNav: Empowering LLM-Based Vision-Language Navigation via Self-Improving Embodied Reasoning
- 2024MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chains
- 2026What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behavior