Beyond Waypoints: A Trajectory-Centric Waypointing Paradigm for Vision-Language Navigation
Not on the map. Why?
Abstract (arXiv)
Vision-Language Navigation in Continuous Environments (VLN-CE) requires agents to follow natural-language instructions while navigating in real-world-like environments. Most VLN-CE approach-es adopt a three-stage framework: a waypoint predictor proposes navigable waypoints, and a navigator selects the best waypoint, with a low-level controller executing the movement to it. However, this decoupled paradigm often leads to unreachable waypoints or inconsistencies between planning and control. In this work, instead of predicting isolated waypoints, we introduce a novel paradigm called Trajectory Waypoint, which grounds each candidate waypoint in an executable trajectory. To realize this, we design a Trajectory Waypoint Predictor formulated as a TSDF-guided diffusion policy, which steers trajectory generation away from obstacles, inherently ensuring the reachability of the predicted waypoints. We further propose a trajectory-enhanced navigator that injects the associated trajectory as additional information for planning, enabling strict consistency between high-level semantic decisions and low-level execution. Extensive experiments on the VLN-CE benchmark show that our Trajectory Waypoint paradigm achieves superior performance over the baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 42 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
28 of 42 references.
References · 28
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 248
- 2020Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-trainingcited by 231
- 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 193
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
- 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 129
16 more
- 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 122
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
- 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
- 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
- 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 65
- 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
- 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 63
- 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigationcited by 60
- 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 45
- 2025SmartWay: Enhanced Waypoint Prediction and Backtracking for Zero-Shot Vision-and-Language Navigationcited by 29
- 2025NaviDiffusor: Cost-Guided Diffusion Model for Visual Navigationcited by 25
- 2025NavRAG: Generating User Demand Instructions for Embodied Navigation through Retrieval-Augmented LLMcited by 19
- 2024Correctable Landmark Discovery via Large Models for Vision-Language Navigationcited by 17
- 2025AstraNav-World: World Model for Foresight Control and Consistencycited by 17
- 2024SAME: Learning Generic Language-Guided Visual Navigation with State-Adaptive Mixture of Expertscited by 16
- 2025MonoDream: Monocular Vision-Language Navigation with Panoramic Dreamingcited by 16
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025DAgger Diffusion Navigation: DAgger Boosted Diffusion Policy for Vision-Language Navigation
- 2025Boosting Zero-Shot VLN via Abstract Obstacle Map-Based Waypoint Prediction with TopoGraph-and-VisitInfo-Aware Prompting
- 2024Narrowing the Gap between Vision and Action in Navigation
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigation
- 2026One MLLM, One Call: Efficient Zero-Shot Vision-and-Language Navigation via Spatial-Aware Waypoints
- 2026WayFinder: Hierarchical Visual-Language-Action for Zero-Shot Waypoint Generation and Low-Level Kinematic Control ↗
- 2026StageVLN: Spatial and Trajectory Auxiliary Guidance for Efficient Vision-Language Navigation
- 2026From Routes to Steps: Separating Semantic Progress from Local Execution in Vision-and-Language Navigation