VLN-NF: Feasibility-Aware Vision-and-Language Navigation with False-Premise Instructions
Not on the map. Why?
Abstract (arXiv)
Conventional Vision-and-Language Navigation (VLN) benchmarks assume instructions are feasible and the referenced target exists, leaving agents ill-equipped to handle false-premise goals. We introduce VLN-NF, a benchmark with false-premise instructions where the target is absent from the specified room and agents must navigate, gather evidence through in-room exploration, and explicitly output NOT-FOUND. VLN-NF is constructed via a scalable pipeline that rewrites VLN instructions using an LLM and verifies target absence with a VLM, producing plausible yet factually incorrect goals. We further propose REV-SPL to jointly evaluate room reaching, exploration coverage, and decision correctness. To address this challenge, we present ROAM, a two-stage hybrid that combines supervised room-level navigation with LLM/VLM-driven in-room exploration guided by a free-space clearance prior. ROAM achieves the best REV-SPL among compared methods, while baselines often under-explore and terminate prematurely under unreliable instructions. VLN-NF project page can be found at https://vln-nf.github.io/.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 30 of its 69 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
30 of 69 references.
References · 30
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2018On Evaluation of Embodied Navigation Agentscited by 547
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
- 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 333
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
- 2019Vision-and-Dialog Navigationcited by 250
- 2021Episodic Transformer for Vision-and-Language Navigationcited by 156
- 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 110
18 more
- 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoningcited by 79
- 2022A Dataset for Interactive Vision-Language Navigation with Unknown Command Feasibilitycited by 61
- 2022A New Path: Scaling Vision-and-Language Navigation with Synthetic Instructions and Imitation Learningcited by 60
- 2023LangNav: Language as a Perceptual Representation for Navigationcited by 47
- 2023Lana: A Language-Capable Navigator for Instruction Following and Generationcited by 40
- 2024Diffusion Meets DAgger: Supercharging Eye-in-hand Imitation Learningcited by 35
- 2023VLN-Trans: Translator for the Vision and Language Navigation Agentcited by 25
- 2024Controllable Navigation Instruction Generation with Chain of Thought Promptingcited by 21
- 2020Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigationcited by 20
- 2024NavHint: Vision and Language Navigation Agent with a Hint Generatorcited by 12
- 2024Mind the Error! Detection and Localization of Instruction Errors in Vision-and-Language Navigationcited by 11
- 2024Navigating Beyond Instructions: Vision-and-Language Navigation in Obstructed Environmentscited by 10
- 2024NoisyEQA: Benchmarking Embodied Question Answering Against Noisy Queriescited by 10
- 2025When Robots Should Say "I Don't Know": Benchmarking Abstention in Embodied Question Answeringcited by 10
- 2025Do What? Teaching Vision-Language-Action Models to Reject the Impossiblecited by 7
- 2025HEAL: An Empirical Study on Hallucinations in Embodied Agents Driven by Large Language Modelscited by 6
- 2023Which way is `right'?: Uncovering limitations of Vision-and-Language Navigation modelcited by 3
- 2024Context-Aware Replanning with Pre-explored Semantic Map for Object Navigationcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026The Yes-Man Syndrome: Benchmarking Abstention in Embodied Robotic Agentscited by 4
- 2026ADAPT: Benchmarking Commonsense Planning under Unspecified Affordance Constraintscited by 0
- 2026A Persian Vision-Language-Action Dataset and Benchmark for Ambiguity- and Infeasibility-Aware Instruction-to-Plan Groundingcited by 0
- 2026A Persian Vision-Language-Action Dataset and Benchmark for Ambiguity- and Infeasibility-Aware Instruction-to-Plan Grounding11 Oct 2026
- 2026The Yes-Man Syndrome: Benchmarking Abstention in Embodied Robotic Agents19 May 2026
- 2026ADAPT: Benchmarking Commonsense Planning under Unspecified Affordance Constraints16 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025VLNVerse: A Benchmark for Vision-Language Navigation with Versatile, Embodied, Realistic Simulation and Evaluation
- 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation
- 2026AgentVLN: Towards Agentic Vision-and-Language Navigation
- 2026Query, Align, and Distill: Navigation-Aware Cross-Modal Interaction for Efficient Vision-and-Language Navigation
- 2025A Navigation Framework Utilizing Vision-Language Models
- 2026StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language Navigation
- 2025VLN-MME: Diagnosing MLLMs as Language-guided Visual Navigation agents
- 2025ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigation