Efficient-VLN: A Simple yet Strong Baseline for Efficient Vision-Language Navigation
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
While Multimodal Large Language Models (MLLMs) have demonstrated significant promise in Vision-Language Navigation (VLN), existing agents remain heavily constrained by systemic bottlenecks across inference, training, and data collection. Specifically, they suffer from prohibitive latency due to visual history reprocessing, action leakage during sequence-packed training, and suboptimal exploration in self-correction data collection. To overcome these intertwined challenges, we present Efficient-VLN, a highly efficient and robust baseline that systematically resolves these issues through three simple-yet-effective mechanisms. (1) Inference: We introduce KV-cache reuse with contiguous RoPE, enabling the model to process only the newly observed frame at each step for real-time inference. (2) Training: We propose packed training with an action-isolating mask to accelerate throughput while effectively bridging the training-inference gap by preventing action leakage. (3) Data Collection: We employ an Adaptive DAgger to dynamically balance autonomous exploration and oracle guidance, enhancing error-recovery capability without escalating computational costs. Extensive evaluations show that Efficient-VLN significantly advances the state-of-the-art across the R2R-CE (73.2% SR) and RxR-CE (75.6% SR) benchmarks. Meanwhile, it yields a 28% latency reduction compared to the previous state-of-the-art StreamVLN, establishing a new paradigm for streaming MLLM-based navigation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 41 of its 45 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
41 of 45 references.
Closest ancestors · 1
Same direction, newest first
Other references · 40
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 333
- 2018Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigationcited by 305
- 2020A Recurrent Vision-and-Language BERT for Navigationcited by 302
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
- 2019Vision-and-Dialog Navigationcited by 250
- 2019Learning to Navigate Unseen Environments: Back Translation with Environmental Dropoutcited by 244
28 more
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
- 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 225
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
- 2023Towards Learning a Generalist Model for Embodied Navigationcited by 138
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 132
- 2019Stay on the Path: Instruction Fidelity in Vision-and-Language Navigationcited by 130
- 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 129
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
- 2023Scaling Data Generation in Vision-and-Language Navigationcited by 117
- 2025Streaming Video Question-Answering with In-context Video KV-Cache Retrievalcited by 117
- 2020Topological Planning with Transformers for Vision-and-Language Navigationcited by 116
- 2025TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videoscited by 97
- 2025StreamingVLM: Real-Time Understanding for Infinite Video Streamscited by 95
- 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 94
- 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
- 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
- 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
- 2025Embodied Navigation Foundation Modelcited by 72
- 2025StreamingTOM: Streaming Token Compression for Efficient Video Understandingcited by 43
- 2024Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigationcited by 39
- 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 36
- 2025CorrectNav: Self-Correction Flywheel Empowers Vision-Language-Action Navigation Modelcited by 27
- 2025Dynam3D: Dynamic Layered 3D Tokens Empower VLM for Vision-and-Language Navigationcited by 23
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Harnessing Input-Adaptive Inference for Efficient VLN
- 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuning
- 2025VLNVerse: A Benchmark for Vision-Language Navigation with Versatile, Embodied, Realistic Simulation and Evaluation
- 2026Query, Align, and Distill: Navigation-Aware Cross-Modal Interaction for Efficient Vision-and-Language Navigation
- 2026MemoryVLN: From Ego-Aware Memory Representation to Cross-Context Memory Reuse in Vision-Language Navigation
- 2026VLN-Cache: Enabling Token Caching for VLN Models with Visual/Semantic Dynamics Awareness
- 2026PGN: Design and Implementation of a Vision-Language Navigation System Based on Pangu Multimodal Foundation Model
- 2026LookStep: Efficient Vision-Language Navigation with Linguistic Foresight and Event Driven Memory