Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigation
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
While recent large vision-language models (VLMs) have improved generalization in vision-language navigation (VLN), existing methods typically rely on end-to-end pipelines that map vision-language inputs directly to short-horizon discrete actions. Such designs often produce fragmented motions, incur high latency, and struggle with real-world challenges like dynamic obstacle avoidance. We propose DualVLN, the first dual-system VLN foundation model that synergistically integrates high-level reasoning with low-level action execution. System 2, a VLM-based global planner, "grounds slowly" by predicting mid-term waypoint goals via image-grounded reasoning. System 1, a lightweight, multi-modal conditioning Diffusion Transformer policy, "moves fast" by leveraging both explicit pixel goals and latent features from System 2 to generate smooth and accurate trajectories. The dual-system design enables robust real-time control and adaptive local decision-making in complex, dynamic environments. By decoupling training, the VLM retains its generalization, while System 1 achieves interpretable and effective local navigation. DualVLN outperforms prior methods across all VLN benchmarks and real-world experiments demonstrate robust long-horizon planning and real-time adaptability in dynamic environments.
Key facts. Cited by 62 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. First posted on arXiv 9 Dec 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 2; 2026: 60.
62 papers.
Sort:
By area:
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigationcited by 25
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigationcited by 11
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation Systemcited by 11
- 2026TIC-VLA: A Think-in-Control Vision-Language-Action Model for Robot Navigation in Dynamic Environmentscited by 10
- 2026Sparse Video Generation Propels Real-World Beyond-the-View Vision-Language Navigationcited by 10
- 2026AgentVLN: Towards Agentic Vision-and-Language Navigationcited by 9
- 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agentscited by 8
- 2026Dual-Anchoring: Addressing State Drift in Vision-Language Navigationcited by 7
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigationcited by 7
- 2025LoGoPlanner: Localization Grounded Navigation Policy with Metric-aware Visual Geometrycited by 6
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Modelcited by 6
- 2026World-Action Models for Robot Learning and Control: A Surveycited by 6
38 more
- 2026Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-horizon Manipulationcited by 5
- 2026Structured Observation Language for Efficient and Generalizable Vision-Language Navigationcited by 3
- 2026Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigationcited by 3
- 2026Ask When It Pays: Cost-Aware Open-Ended Interaction for Instance Goal Navigationcited by 3
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoningcited by 3
- 2026Robostral Navigatecited by 3
- 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harnesscited by 3
- 2025Efficient-VLN: A Simple yet Strong Baseline for Efficient Vision-Language Navigationcited by 2
- 2026WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Modelscited by 2
- 2026POINav: Benchmarking and Enhancing Final-Meters Arrival in Real-World Vision-Language Navigationcited by 2
- 2026Goal2Pixel: Grounding Goals to Pixels for Vision-Language Navigationcited by 2
- 2026LIME: Learning Intent-aware Camera Motion from Egocentric Videocited by 2
- 2026HAM-VLN: Harnessing Hierarchical Agentic Memory for Zero-Shot Vision-and-Language Navigationcited by 2
- 2026OmniEcho: Audio-Visual Spatial Understanding for Omni-Modal Embodied Agentscited by 2
- 2026What Limits Vision-and-Language Navigation ?cited by 1
- 2026Image2Sim: Scaling Embodied Navigation via Generative Neural Simulatorcited by 1
- 2026A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigationcited by 1
- 2026X-NavDP: Generalizing Navigation Diffusion Policy to Novel Behavior and Embodiments with Group Q-score Reweighted Matchingcited by 1
- 2026SC2-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environmentscited by 1
- 2026Embodied-Navigator: Point, Think, Memorize, and Align for Efficient Navigationcited by 1
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigationcited by 1
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Modelcited by 1
- 2026HaltNav: Reactive Visual Halting over Lightweight Topological Priors for Robust Vision-Language Navigationcited by 0
- 2026LatentPilot: Scene-Aware Vision-and-Language Navigation by Dreaming Ahead with Latent Visual Reasoningcited by 0
- 2026From Imitation to Alignment: Human-Preference Flow Policies for Long-Horizon Sidewalk Navigationcited by 0
- 2026TopoExplore: Homology as an Exploration Signalcited by 0
- 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generationcited by 0
- 2026Learning to Navigate with Minimal Parameters: Decomposing Visual Navigation Through Closed-Form Geometric Interfacescited by 0
- 2026ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoningcited by 0
- 2026Goal-oriented Navigation Instruction Generation with Tour Video Priorscited by 0
- 2026Decoupling Planning and Control for Instructable Agentscited by 0
- 2026One MLLM, One Call: Efficient Zero-Shot Vision-and-Language Navigation via Spatial-Aware Waypointscited by 0
- 2026AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigationcited by 0
- 2026Visual Cue Guided Video Planning for Generalizable Robot Navigationcited by 0
- 2026What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behaviorcited by 0
- 2026Affordance-Conditioned Decision Making: Bridging the Semantic-Spatial Gap in Zero-Shot Cross-Floor Vision-and-Language Navigationcited by 0
- 2026RECAST: Recasting Vision-Language Semantics into an Actionable Cost Map for Robot Navigationcited by 0
- 2026FINE: Future-Informed Navigation Encoding for Data-Efficient Vision-Language Navigationcited by 0
50 most cited of 62 All 62 (JSON)
- 2026Interactive Navigation Beyond Reachability: Benchmark and Agentic Framework12 Oct 2026
- 2026Data-Centric Recursive Self-Improvement for Navigation via Policy-Synchronized Language-Action Dual Bootstrapping11 Oct 2026
- 2026FireNav: Decision-Oriented Reconstruction Evidence Routing for Vision-Language Navigation in Indoor Fire Environments11 Oct 2026
- 2026GG-Nav: Goal-oriented Grounding Chain-of-Thought Elicits Reasoning in Navigation Foundation Models10 Oct 2026
- 2026NavGPT-3: Harnessing Context in a Hierarchical Navigation Runtime7 Oct 2026
- 2026StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language Navigation5 Oct 2026
- 2026GeoScaffold: Learning Compact Geometric Latents via Reconstruction for Efficient Vision-Language Navigation2 Oct 2026
- 2026NavHarness: Adaptive Goals for Agentic Vision-Language Navigation30 Sep 2026
- 2026AVERT-VLN: Abstention-aware Visual Error Recovery and Training for Vision-and-Language Navigation30 Sep 2026
- 2026UniWAM Technical Report: Unified Mobile Manipulation via Mixed-Stream World-Action Modeling and Manipulation Anchor Pose Supervision30 Sep 2026
- 2026PanoVLN: Towards Effective Panoramic Vision-and-Language Navigation28 Sep 2026
- 2026VCN-Bench: A Video-Contextualized Navigation Benchmark for Spatial Reasoning over Prior Visual Experience28 Sep 2026
38 more
- 2026FINE: Future-Informed Navigation Encoding for Data-Efficient Vision-Language Navigation26 Sep 2026
- 2026RECAST: Recasting Vision-Language Semantics into an Actionable Cost Map for Robot Navigation26 Sep 2026
- 2026Affordance-Conditioned Decision Making: Bridging the Semantic-Spatial Gap in Zero-Shot Cross-Floor Vision-and-Language Navigation26 Sep 2026
- 2026What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behavior21 Sep 2026
- 2026OmniEcho: Audio-Visual Spatial Understanding for Omni-Modal Embodied Agents20 Sep 2026
- 2026Visual Cue Guided Video Planning for Generalizable Robot Navigation15 Sep 2026
- 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness14 Sep 2026
- 2026World-Action Models for Robot Learning and Control: A Survey13 Sep 2026
- 2026AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigation10 Sep 2026
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model8 Sep 2026
- 2026One MLLM, One Call: Efficient Zero-Shot Vision-and-Language Navigation via Spatial-Aware Waypoints6 Sep 2026
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation31 Aug 2026
- 2026Decoupling Planning and Control for Instructable Agents27 Aug 2026
- 2026Embodied-Navigator: Point, Think, Memorize, and Align for Efficient Navigation18 Aug 2026
- 2026Goal-oriented Navigation Instruction Generation with Tour Video Priors9 Aug 2026
- 2026SC2-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environments1 Aug 2026
- 2026HAM-VLN: Harnessing Hierarchical Agentic Memory for Zero-Shot Vision-and-Language Navigation31 Jul 2026
- 2026X-NavDP: Generalizing Navigation Diffusion Policy to Novel Behavior and Embodiments with Group Q-score Reweighted Matching30 Jul 2026
- 2026Robostral Navigate22 Jul 2026
- 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agents14 Jul 2026
- 2026ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoning14 Jul 2026
- 2026Learning to Navigate with Minimal Parameters: Decomposing Visual Navigation Through Closed-Form Geometric Interfaces13 Jul 2026
- 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation12 Jul 2026
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Model11 Jul 2026
- 2026TopoExplore: Homology as an Exploration Signal10 Jul 2026
- 2026A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation9 Jul 2026
- 2026Image2Sim: Scaling Embodied Navigation via Generative Neural Simulator7 Jul 2026
- 2026Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-horizon Manipulation6 Jul 2026
- 2026LIME: Learning Intent-aware Camera Motion from Egocentric Video2 Jul 2026
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation29 Jun 2026
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System16 Jun 2026
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation14 Jun 2026
- 2026From Imitation to Alignment: Human-Preference Flow Policies for Long-Horizon Sidewalk Navigation10 Jun 2026
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoning8 Jun 2026
- 2026Ask When It Pays: Cost-Aware Open-Ended Interaction for Instance Goal Navigation2 Jun 2026
- 2026Goal2Pixel: Grounding Goals to Pixels for Vision-Language Navigation1 Jun 2026
- 2026POINav: Benchmarking and Enhancing Final-Meters Arrival in Real-World Vision-Language Navigation27 May 2026
- 2026Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigation26 May 2026
50 newest of 62 All 62 (JSON)
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation Systemcited by 11
- 2026AgentVLN: Towards Agentic Vision-and-Language Navigationcited by 9
- 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agentscited by 8
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoningcited by 3
- 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harnesscited by 3
- 2026HAM-VLN: Harnessing Hierarchical Agentic Memory for Zero-Shot Vision-and-Language Navigationcited by 2
- 2026ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoningcited by 0
- 2026NavHarness: Adaptive Goals for Agentic Vision-Language Navigationcited by 0
- 2026NavGPT-3: Harnessing Context in a Hierarchical Navigation Runtimecited by 0
- 2026Interactive Navigation Beyond Reachability: Benchmark and Agentic Frameworkcited by 0
- 2026Interactive Navigation Beyond Reachability: Benchmark and Agentic Framework12 Oct 2026
- 2026NavGPT-3: Harnessing Context in a Hierarchical Navigation Runtime7 Oct 2026
- 2026NavHarness: Adaptive Goals for Agentic Vision-Language Navigation30 Sep 2026
- 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness14 Sep 2026
- 2026HAM-VLN: Harnessing Hierarchical Agentic Memory for Zero-Shot Vision-and-Language Navigation31 Jul 2026
- 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agents14 Jul 2026
- 2026ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoning14 Jul 2026
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System16 Jun 2026
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoning8 Jun 2026
- 2026AgentVLN: Towards Agentic Vision-and-Language Navigation18 Mar 2026
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigationcited by 11
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigationcited by 7
- 2026World-Action Models for Robot Learning and Control: A Surveycited by 6
- 2026WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Modelscited by 2
- 2026SC2-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environmentscited by 1
- 2026Decoupling Planning and Control for Instructable Agentscited by 0
- 2026UniWAM Technical Report: Unified Mobile Manipulation via Mixed-Stream World-Action Modeling and Manipulation Anchor Pose Supervisioncited by 0
- 2026UniWAM Technical Report: Unified Mobile Manipulation via Mixed-Stream World-Action Modeling and Manipulation Anchor Pose Supervision30 Sep 2026
- 2026World-Action Models for Robot Learning and Control: A Survey13 Sep 2026
- 2026Decoupling Planning and Control for Instructable Agents27 Aug 2026
- 2026SC2-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environments1 Aug 2026
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation29 Jun 2026
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation14 Jun 2026
- 2026WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Models9 Apr 2026
- 2026Embodied-Navigator: Point, Think, Memorize, and Align for Efficient Navigationcited by 1
- 2026LatentPilot: Scene-Aware Vision-and-Language Navigation by Dreaming Ahead with Latent Visual Reasoningcited by 0
- 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generationcited by 0
- 2026AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigationcited by 0
- 2026VCN-Bench: A Video-Contextualized Navigation Benchmark for Spatial Reasoning over Prior Visual Experiencecited by 0
- 2026GG-Nav: Goal-oriented Grounding Chain-of-Thought Elicits Reasoning in Navigation Foundation Modelscited by 0
- 2026GG-Nav: Goal-oriented Grounding Chain-of-Thought Elicits Reasoning in Navigation Foundation Models10 Oct 2026
- 2026VCN-Bench: A Video-Contextualized Navigation Benchmark for Spatial Reasoning over Prior Visual Experience28 Sep 2026
- 2026AnchorVLN: Geometry-Anchored Vision-Language Grounding Reasoning for Open-Vocabulary Navigation10 Sep 2026
- 2026Embodied-Navigator: Point, Think, Memorize, and Align for Efficient Navigation18 Aug 2026
- 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation12 Jul 2026
- 2026LatentPilot: Scene-Aware Vision-and-Language Navigation by Dreaming Ahead with Latent Visual Reasoning31 Mar 2026
- 2025Efficient-VLN: A Simple yet Strong Baseline for Efficient Vision-Language Navigationcited by 2
- 2026Goal2Pixel: Grounding Goals to Pixels for Vision-Language Navigationcited by 2
- 2026What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behaviorcited by 0
- 2026PanoVLN: Towards Effective Panoramic Vision-and-Language Navigationcited by 0
- 2026StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language Navigationcited by 0
- 2026StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language Navigation5 Oct 2026
- 2026PanoVLN: Towards Effective Panoramic Vision-and-Language Navigation28 Sep 2026
- 2026What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behavior21 Sep 2026
- 2026Goal2Pixel: Grounding Goals to Pixels for Vision-Language Navigation1 Jun 2026
- 2025Efficient-VLN: A Simple yet Strong Baseline for Efficient Vision-Language Navigation11 Dec 2025
- 2026TopoExplore: Homology as an Exploration Signalcited by 0
- 2026TopoExplore: Homology as an Exploration Signal10 Jul 2026
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigationcited by 25
- 2026Sparse Video Generation Propels Real-World Beyond-the-View Vision-Language Navigationcited by 10
- 2026Dual-Anchoring: Addressing State Drift in Vision-Language Navigationcited by 7
- 2025LoGoPlanner: Localization Grounded Navigation Policy with Metric-aware Visual Geometrycited by 6
- 2026ABot-N1: Toward a General Visual Language Navigation Foundation Modelcited by 6
- 2026Structured Observation Language for Efficient and Generalizable Vision-Language Navigationcited by 3
- 2026Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigationcited by 3
- 2026Ask When It Pays: Cost-Aware Open-Ended Interaction for Instance Goal Navigationcited by 3
- 2026Robostral Navigatecited by 3
- 2026POINav: Benchmarking and Enhancing Final-Meters Arrival in Real-World Vision-Language Navigationcited by 2
- 2026LIME: Learning Intent-aware Camera Motion from Egocentric Videocited by 2
- 2026OmniEcho: Audio-Visual Spatial Understanding for Omni-Modal Embodied Agentscited by 2
12 most cited of 30 All 30 (JSON)
- 2026Data-Centric Recursive Self-Improvement for Navigation via Policy-Synchronized Language-Action Dual Bootstrapping11 Oct 2026
- 2026FireNav: Decision-Oriented Reconstruction Evidence Routing for Vision-Language Navigation in Indoor Fire Environments11 Oct 2026
- 2026GeoScaffold: Learning Compact Geometric Latents via Reconstruction for Efficient Vision-Language Navigation2 Oct 2026
- 2026AVERT-VLN: Abstention-aware Visual Error Recovery and Training for Vision-and-Language Navigation30 Sep 2026
- 2026FINE: Future-Informed Navigation Encoding for Data-Efficient Vision-Language Navigation26 Sep 2026
- 2026RECAST: Recasting Vision-Language Semantics into an Actionable Cost Map for Robot Navigation26 Sep 2026
- 2026Affordance-Conditioned Decision Making: Bridging the Semantic-Spatial Gap in Zero-Shot Cross-Floor Vision-and-Language Navigation26 Sep 2026
- 2026OmniEcho: Audio-Visual Spatial Understanding for Omni-Modal Embodied Agents20 Sep 2026
- 2026Visual Cue Guided Video Planning for Generalizable Robot Navigation15 Sep 2026
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model8 Sep 2026
- 2026One MLLM, One Call: Efficient Zero-Shot Vision-and-Language Navigation via Spatial-Aware Waypoints6 Sep 2026
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation31 Aug 2026
12 newest of 30 All 30 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026SEDualVLN: A Spatially-Enhanced Dual-System for Vision-Language Navigation
- 2026GroundingVLN: Reasoning and Acting with Grounding for Vision-Language Navigation
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers
- 2026Green for Go, Red for No: Visual Grounding via Semantic Segmentation for VLA Navigation Policies
- 2020Language-guided Navigation via Cross-Modal Grounding and Alternate Adversarial Learning
- 2026FSD-VLN: Fast-Slow Dual-System Modeling for Aerial Long-Horizon Vision-Language Navigation
- 2025VENTURA: Adapting Image Diffusion Models for Unified Task Conditioned Navigation
- 2025CLASH: Collaborative Large-Small Hierarchical Framework for Continuous Vision-and-Language Navigation