mlsanityData to 7 Oct 2026

VerNav: Verifier-First Low-Latency Vision-and-Language Navigation

arXiv 2609.00920 ↗First posted 1 Sep 2026cs.RO cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Vision-and-Language Navigation (VLN) requires an agent to navigate through unseen 3D environments according to natural-language instructions. Explicit reasoning can improve instruction understanding and semantic grounding, but autoregressive generation at every step accumulates large decision-stage latency over multi-step navigation. We propose VerNav, a verifier-first framework for low-latency LLM-based VLN. The verifier reduces decision-stage latency by replacing per-step autoregressive generation with batched action verification, while an entropy-based adaptive generator is invoked only for uncertain decisions to produce compact state evidence. To further improve navigation performance with the verifier, we introduce a two-stage alignment scheme: (i) VPO improves local action-preference alignment in static verifier training, and (ii) step-level reinforcement fine-tuning provides dense progress rewards over multi-step navigation rollouts during dynamic task execution. Experiments on the Room-to-Room (R2R) benchmark show that the verifier-only decision path of VerNav achieves competitive navigation performance among representative LLM-based VLN agents while reducing average decision-stage LLM latency per step by more than 10× compared with autoregressive methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 14 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

12 of 14 references.

References · 12

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  2. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  3. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  4. 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 330
  5. 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 268
  6. 2018Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environmentscited by 238
  7. 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 108
  8. 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 61
  9. 2023LangNav: Language as a Perceptual Representation for Navigationcited by 47
  10. 2025Nav-R1: Reasoning and Navigation in Embodied Scenescited by 37
  11. 2025SeeNav-Agent: Enhancing Vision-Language Navigation with Visual Prompt and Step-Level Policy Optimizationcited by 3
  12. 2026SFCo-Nav: Efficient Zero-Shot Visual Language Navigation via Collaboration of Slow LLM and Fast Attributed Graph Alignmentcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.