Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigation
Not on the map. Why?
Abstract (arXiv)
Vision-and-Language Navigation (VLN) is a natural language grounding task where an agent learns to follow language instructions and navigate to specified destinations in real-world environments. A key challenge is to recognize and stop at the correct location, especially for complicated outdoor environments. Existing methods treat the STOP action equally as other actions, which results in undesirable behaviors that the agent often fails to stop at the destination even though it might be on the right path. Therefore, we propose Learning to Stop (L2Stop), a simple yet effective policy module that differentiates STOP and other actions. Our approach achieves the new state of the art on a challenging urban VLN dataset Touchdown, outperforming the baseline by 6.89% (absolute improvement) on Success weighted by Edit Distance (SED).
Key facts. Cited by 20 papers in the map (data through 13 Oct 2026). First posted on arXiv 28 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 2; 2024: 3; 2025: 2; 2026: 3.
20 papers.
Sort:
By area:
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Modelscited by 124
- 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 116
- 2023VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street Viewcited by 67
- 2021Diagnosing Vision-and-Language Navigation: What Really Matterscited by 36
- 2021Vision-Language Navigation: A Survey and Taxonomycited by 33
- 2021Improving Cross-Modal Alignment in Vision Language Navigation via Syntactic Informationcited by 31
- 2022One Step at a Time: Long-Horizon Vision-and-Language Navigation with Milestonescited by 26
- 2022Analyzing Generalization of Vision and Language Navigation to Unseen Outdoor Areascited by 24
- 2022Ground then Navigate: Language-guided Navigation in Dynamic Scenescited by 20
- 2024VLN-Video: Utilizing Driving Videos for Outdoor Vision-and-Language Navigationcited by 14
- 2021SILG: The Multi-environment Symbolic Interactive Language Grounding Benchmarkcited by 11
- 2024Vision-Language Navigation with Embodied Intelligence: A Surveycited by 9
8 more
- 2022FedVLN: Privacy-preserving Federated Vision-and-Language Navigationcited by 8
- 2022A Priority Map for Vision-and-Language Navigation with Trajectory Plans and Feature-Location Cuescited by 5
- 2025City-VLM: Towards Multidomain Perception Scene Understanding via Multimodal Incomplete Learningcited by 2
- 2026VLN-NF: Feasibility-Aware Vision-and-Language Navigation with False-Premise Instructionscited by 2
- 2025GENNAV: Polygon Mask Generation for Generalized Referring Navigable Regionscited by 1
- 2026DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigationcited by 1
- 2024Temporal-Spatial Object Relations Modeling for Vision-and-Language Navigationcited by 0
- 2026Rule-VLN: Bridging Perception and Compliance via Semantic Reasoning and Geometric Rectificationcited by 0
- 2026DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigation12 Aug 2026
- 2026Rule-VLN: Bridging Perception and Compliance via Semantic Reasoning and Geometric Rectification18 Apr 2026
- 2026VLN-NF: Feasibility-Aware Vision-and-Language Navigation with False-Premise Instructions12 Apr 2026
- 2025GENNAV: Polygon Mask Generation for Generalized Referring Navigable Regions28 Aug 2025
- 2025City-VLM: Towards Multidomain Perception Scene Understanding via Multimodal Incomplete Learning17 Jul 2025
- 2024Temporal-Spatial Object Relations Modeling for Vision-and-Language Navigation23 Mar 2024
- 2024Vision-Language Navigation with Embodied Intelligence: A Survey22 Feb 2024
- 2024VLN-Video: Utilizing Driving Videos for Outdoor Vision-and-Language Navigation5 Feb 2024
- 2023VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street View12 Jul 2023
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Models18 May 2023
- 2022Ground then Navigate: Language-guided Navigation in Dynamic Scenes24 Sep 2022
- 2022A Priority Map for Vision-and-Language Navigation with Trajectory Plans and Feature-Location Cues24 Jul 2022
8 more
- 2022FedVLN: Privacy-preserving Federated Vision-and-Language Navigation28 Mar 2022
- 2022Analyzing Generalization of Vision and Language Navigation to Unseen Outdoor Areas25 Mar 2022
- 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions22 Mar 2022
- 2022One Step at a Time: Long-Horizon Vision-and-Language Navigation with Milestones14 Feb 2022
- 2021SILG: The Multi-environment Symbolic Interactive Language Grounding Benchmark20 Oct 2021
- 2021Vision-Language Navigation: A Survey and Taxonomy26 Aug 2021
- 2021Improving Cross-Modal Alignment in Vision Language Navigation via Syntactic Information19 Apr 2021
- 2021Diagnosing Vision-and-Language Navigation: What Really Matters30 Mar 2021
- 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 116
- 2021Diagnosing Vision-and-Language Navigation: What Really Matterscited by 36
- 2021Vision-Language Navigation: A Survey and Taxonomycited by 33
- 2021Improving Cross-Modal Alignment in Vision Language Navigation via Syntactic Informationcited by 31
- 2022One Step at a Time: Long-Horizon Vision-and-Language Navigation with Milestonescited by 26
- 2022Analyzing Generalization of Vision and Language Navigation to Unseen Outdoor Areascited by 24
- 2022Ground then Navigate: Language-guided Navigation in Dynamic Scenescited by 20
- 2021SILG: The Multi-environment Symbolic Interactive Language Grounding Benchmarkcited by 11
- 2024Vision-Language Navigation with Embodied Intelligence: A Surveycited by 9
- 2022FedVLN: Privacy-preserving Federated Vision-and-Language Navigationcited by 8
- 2022A Priority Map for Vision-and-Language Navigation with Trajectory Plans and Feature-Location Cuescited by 5
- 2025City-VLM: Towards Multidomain Perception Scene Understanding via Multimodal Incomplete Learningcited by 2
12 most cited of 17 All 17 (JSON)
- 2026DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigation12 Aug 2026
- 2026Rule-VLN: Bridging Perception and Compliance via Semantic Reasoning and Geometric Rectification18 Apr 2026
- 2026VLN-NF: Feasibility-Aware Vision-and-Language Navigation with False-Premise Instructions12 Apr 2026
- 2025GENNAV: Polygon Mask Generation for Generalized Referring Navigable Regions28 Aug 2025
- 2025City-VLM: Towards Multidomain Perception Scene Understanding via Multimodal Incomplete Learning17 Jul 2025
- 2024Temporal-Spatial Object Relations Modeling for Vision-and-Language Navigation23 Mar 2024
- 2024Vision-Language Navigation with Embodied Intelligence: A Survey22 Feb 2024
- 2022Ground then Navigate: Language-guided Navigation in Dynamic Scenes24 Sep 2022
- 2022A Priority Map for Vision-and-Language Navigation with Trajectory Plans and Feature-Location Cues24 Jul 2022
- 2022FedVLN: Privacy-preserving Federated Vision-and-Language Navigation28 Mar 2022
- 2022Analyzing Generalization of Vision and Language Navigation to Unseen Outdoor Areas25 Mar 2022
- 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions22 Mar 2022
12 newest of 17 All 17 (JSON)