VerNav: Verifier-First Low-Latency Vision-and-Language Navigation
Not on the map. Why?
Abstract (arXiv)
Vision-and-Language Navigation (VLN) requires an agent to navigate through unseen 3D environments according to natural-language instructions. Explicit reasoning can improve instruction understanding and semantic grounding, but autoregressive generation at every step accumulates large decision-stage latency over multi-step navigation. We propose VerNav, a verifier-first framework for low-latency LLM-based VLN. The verifier reduces decision-stage latency by replacing per-step autoregressive generation with batched action verification, while an entropy-based adaptive generator is invoked only for uncertain decisions to produce compact state evidence. To further improve navigation performance with the verifier, we introduce a two-stage alignment scheme: (i) VPO improves local action-preference alignment in static verifier training, and (ii) step-level reinforcement fine-tuning provides dense progress rewards over multi-step navigation rollouts during dynamic task execution. Experiments on the Room-to-Room (R2R) benchmark show that the verifier-only decision path of VerNav achieves competitive navigation performance among representative LLM-based VLN agents while reducing average decision-stage LLM latency per step by more than 10× compared with autoregressive methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 14 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
12 of 14 references.
References · 12
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 330
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 268
- 2018Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environmentscited by 238
- 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 108
- 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 61
- 2023LangNav: Language as a Perceptual Representation for Navigationcited by 47
- 2025Nav-R1: Reasoning and Navigation in Embodied Scenescited by 37
- 2025SeeNav-Agent: Enhancing Vision-Language Navigation with Visual Prompt and Step-Level Policy Optimizationcited by 3
- 2026SFCo-Nav: Efficient Zero-Shot Visual Language Navigation via Collaboration of Slow LLM and Fast Attributed Graph Alignmentcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.