FSR-VLN: Fast and Slow Reasoning for Vision-Language Navigation with Hierarchical Multi-modal Scene Graph
Not on the map. Why?
Abstract (arXiv)
Visual-Language Navigation (VLN) is a fundamental challenge in robotic systems, with broad applications for the deployment of embodied agents in real-world environments. Despite recent advances, existing approaches are limited in long-range spatial reasoning, often exhibiting low success rates and high inference latency, particularly in long-range navigation tasks. To address these limitations, we propose FSR-VLN, a vision-language navigation system that combines a Hierarchical Multi-modal Scene Graph (HMSG) with Fast-to-Slow Navigation Reasoning (FSR). The HMSG provides a multi-modal map representation supporting progressive retrieval, from coarse room-level localization to fine-grained goal view and object identification. Building on HMSG, FSR first performs fast matching to efficiently select candidate rooms, views, and objects, then applies VLM-driven refinement for final goal selection. We evaluated FSR-VLN across four comprehensive indoor datasets collected by humanoid robots, utilizing 87 instructions that encompass a diverse range of object categories. FSR-VLN achieves state-of-the-art (SOTA) performance in all datasets, measured by the retrieval success rate (RSR), while reducing the response time by 82% compared to VLM-based methods on tour videos by activating slow reasoning only when fast intuition fails. Furthermore, we integrate FSR-VLN with speech interaction, planning, and control modules on a Unitree-G1 humanoid robot, enabling natural language interaction and real-time navigation.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Sep 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026HIMM: Human-Inspired Long-Term Memory Modeling for Embodied Exploration and Question Answeringcited by 3
- 2026Explore Like Humans: Autonomous Exploration with Online SG-Memo Construction for Embodied Agentscited by 3
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoningcited by 3
- 2026WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Modelscited by 2
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memorycited by 1
- 2026Towards Open Environments and Instructions: General Vision-Language Navigation via Fast-Slow Interactive Reasoningcited by 0
- 2026HaltNav: Reactive Visual Halting over Lightweight Topological Priors for Robust Vision-Language Navigationcited by 0
- 2026OpenBelief-Nav: Evidence-Preserving Object Memory for Open-Vocabulary Language-Guided Navigationcited by 0
- 2026CGFM-Nav: Cognitive Graph-Field Memory for Semantic-Guided Lifelong Multimodal Embodied Navigationcited by 0
- 2026Finder: Agentic Closed-Loop Object Finding for Embodied Groundingcited by 0
- 2026Query, Align, and Distill: Navigation-Aware Cross-Modal Interaction for Efficient Vision-and-Language Navigationcited by 0
- 2026Query, Align, and Distill: Navigation-Aware Cross-Modal Interaction for Efficient Vision-and-Language Navigation27 Sep 2026
- 2026Finder: Agentic Closed-Loop Object Finding for Embodied Grounding16 Sep 2026
- 2026CGFM-Nav: Cognitive Graph-Field Memory for Semantic-Guided Lifelong Multimodal Embodied Navigation29 Aug 2026
- 2026OpenBelief-Nav: Evidence-Preserving Object Memory for Open-Vocabulary Language-Guided Navigation14 Aug 2026
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory22 Jun 2026
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoning8 Jun 2026
- 2026Explore Like Humans: Autonomous Exploration with Online SG-Memo Construction for Embodied Agents21 Apr 2026
- 2026WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Models9 Apr 2026
- 2026HaltNav: Reactive Visual Halting over Lightweight Topological Priors for Robust Vision-Language Navigation13 Mar 2026
- 2026HIMM: Human-Inspired Long-Term Memory Modeling for Embodied Exploration and Question Answering17 Feb 2026
- 2026Towards Open Environments and Instructions: General Vision-Language Navigation via Fast-Slow Interactive Reasoning14 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026A Deployable Embodied Vision-Language Navigation System with Hierarchical Cognition and Context-Aware Exploration ↗
- 2025DyNaVLM: Zero-Shot Vision-Language Navigation System with Dynamic Viewpoints and Self-Refining Graph Memory
- 2026AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigation
- 2026Hierarchical Semantic-Augmented Navigation: Optimal Transport and Graph-Driven Reasoning for Vision-Language Navigation
- 2026OmniVLN: Omnidirectional 3D Perception and Token-Efficient LLM Reasoning for Visual-Language Navigation across Air and Ground Platforms
- 2026VISOR: VIsual Spatial Object Reasoning for Language-driven Object Navigation
- 2026TagaVLM: Topology-Aware Global Action Reasoning for Vision-Language Navigation
- 2025VLN-MME: Diagnosing MLLMs as Language-guided Visual Navigation agents