mlsanityData to 14 Oct 2026

From Region Arrival to Instance-Level Grounding in Vision-and-Language Navigation

arXiv 2607.03792 ↗First posted 4 Jul 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision-and-Language Navigation (VLN) agents may satisfy conventional success criteria while still failing to establish reliable object-level grounding, because current evaluation protocols mainly reward stopping within a 3-meter radius and largely ignore the agent's final orientation and target visibility. We formalize this limitation as the Last-3-Meter Grounding Gap and introduce three instance-centric metrics to quantify proximity precision, target visibility, and final-view grounding. To mitigate this gap, we propose REALM (Region-to-Entity Alignment for Last-3-Meter Navigation), a plug-and-play, architecture-agnostic refinement module that decouples fine-grained target approaching from long-horizon navigation. REALM uses a visibility-aware stopping strategy to reduce premature termination and improve final viewpoint alignment. We further construct REVERIE-AIM, which provides object-instance-level goals and 180K short-horizon training samples for final-stage target approaching. Extensive evaluations across four diverse VLN backbones show that REALM consistently improves proximity precision and visual grounding success, demonstrating its broad applicability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 32 references that are in the map. First posted on arXiv 4 Jul 2026.

Builds on

30 of 32 references.

References · 30

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  4. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
  5. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
  6. 2023Scaling Open-Vocabulary Object Detectioncited by 343
  7. 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 333
  8. 2019Vision-and-Dialog Navigationcited by 250
  9. 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
  10. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
  11. 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
  12. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
18 more
  1. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
  2. 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 132
  3. 2022Habitat-Matterport 3D Semantics Datasetcited by 110
  4. 2024Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Modelscited by 79
  5. 2022HOP: History-and-Order Aware Pre-training for Vision-and-Language Navigationcited by 70
  6. 2024Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environmentscited by 50
  7. 2025SmartWay: Enhanced Waypoint Prediction and Backtracking for Zero-Shot Vision-and-Language Navigationcited by 29
  8. 2022Last-Mile Embodied Visual Navigationcited by 25
  9. 2025Dynam3D: Dynamic Layered 3D Tokens Empower VLM for Vision-and-Language Navigationcited by 23
  10. 2021Curriculum Learning for Vision-and-Language Navigationcited by 18
  11. 2023Object Goal Navigation with Recursive Implicit Mapscited by 16
  12. 2025COSMO: Combination of Selective Memorization for Low-cost Vision-and-Language Navigationcited by 15
  13. 2025MSGNav: Unleashing the Power of Multi-modal 3D Scene Graph for Zero-Shot Embodied Navigationcited by 13
  14. 2025Progress-Think: Semantic Progress Reasoning for Vision-Language Navigationcited by 12
  15. 2026CapNav: Benchmarking Vision Language Models on Capability-conditioned Indoor Navigationcited by 6
  16. 2025D3D-VLP: Dynamic 3D Vision-Language-Planning Model for Embodied Grounding and Navigationcited by 5
  17. 2026Does Peer Observation Help? Vision-Sharing Collaboration for Vision-Language Navigationcited by 2
  18. 2026AnyImageNav: Any-View Geometry for Precise Last-Meter Image-Goal Navigationcited by 2

Built on by

Not cited yet.