SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigation
Not on the map. Why?
Abstract (arXiv)
Vision-and-Language Navigation (VLN) aims to enable an embodied agent to follow natural-language instructions and navigate to a target location in unseen 3D environments. We argue that adapting VLMs to VLN requires endowing them with two complementary capabilities for acquiring such awareness, namely backward action reasoning (why) and forward transition prediction~(how). Based on this insight, we propose SpaAct, a simple yet effective training framework that activates the dynamic spatial awareness in VLMs. Specifically, SpaAct introduces two spatial activation tasks: Action Retrospection, which asks the model to infer the executed action sequence from visual transitions, and Future Frame Selection, which forces the model to predict the visual transitions conditioned on history and action. These two objectives provide lightweight supervision on both backward action reasoning and forward transition prediction, encouraging the model to build dynamic spatial awareness in a VLM-friendly way. To further stabilize adaptation, we design TriPA, a Tri-factor Progressive Adaptive curriculum learning method that organizes training samples from easy to hard, allowing the model to gradually acquire navigation skills from basic locomotion to long-horizon reasoning. Experiments on standard VLN-CE benchmarks show that SpaAct consistently improves VLM-based navigation and achieves state-of-the-art performance. We will release the code and models to support future research.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 48 of its 63 references that are in the map. First posted on arXiv 30 Apr 2026.
Builds on
48 of 63 references.
References · 48
- 2023Qwen Technical Reportcited by 3,344
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2023VILA: On Pre-training for Visual Language Modelscited by 692
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
- 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
- 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 340
- 2026Causal World Modeling for Robot Controlcited by 321
- 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
- 2023Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Textcited by 208
- 2019Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Taskscited by 179
36 more
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
- 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 129
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
- 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 117
- 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 94
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
- 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
- 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
- 2024Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Modelscited by 79
- 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
- 2020Sub-Instruction Aware Vision-and-Language Navigationcited by 66
- 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 65
- 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 63
- 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigationcited by 60
- 2024Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environmentscited by 50
- 2021SASRA: Semantically-aware Spatio-temporal Reasoning Agent for Vision-and-Language Navigation in Continuous Environmentscited by 48
- 2023Learning Vision-and-Language Navigation from YouTube Videoscited by 47
- 2023Improving Vision-and-Language Navigation by Generating Future-View Image Semanticscited by 46
- 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 45
- 2022Reinforced Structured State-Evolution for Vision-Language Navigationcited by 37
- 2023FGPrompt: Fine-grained Goal Prompting for Image-goal Navigationcited by 22
- 2024g3D-LF: Generalizable 3D-Language Feature Fields for Embodied Taskscited by 22
- 2020Embodied Visual Navigation with Automatic Curriculum Learning in Real Environmentscited by 21
- 2025NavForesee: A Unified Vision-Language World Model for Hierarchical Planning and Dual-Horizon Navigation Predictioncited by 16
- 2025MobileVLA-R1: Reinforcing Vision-Language-Action for Mobile Robotscited by 15
- 2025Do Visual Imaginations Improve Vision-and-Language Navigation Agents?cited by 14
- 2025REGNav: Room Expert Guided Image-Goal Navigationcited by 12
- 2025Progress-Think: Semantic Progress Reasoning for Vision-Language Navigationcited by 12
- 2025Ground-level Viewpoint Vision-and-Language Navigation in Continuous Environmentscited by 10
- 2026HiMemVLN: Enhancing Reliability of Open-Source Zero-Shot Vision-and-Language Navigation with Hierarchical Memory Systemcited by 8
- 2026Dual-Anchoring: Addressing State Drift in Vision-Language Navigationcited by 7
- 2026Spatial-VLN: Zero-Shot Vision-and-Language Navigation With Explicit Spatial Perception and Explorationcited by 5
- 2022Good Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigationcited by 3
- 2026Think before Go: Hierarchical Reasoning for Image-goal Navigationcited by 2
- 2023Robustness of Utilizing Feedback in Embodied Visual Navigationcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation
- 2025Igniting VLMs toward the Embodied Space
- 2026SPAN-Nav: Generalized Spatial Awareness for Versatile Vision-Language Navigation
- 2026Embodied-Navigator: Point, Think, Memorize, and Align for Efficient Navigation
- 2025Breaking Down and Building Up: Mixture of Skill-Based Vision-and-Language Navigation Agents
- 2025A Navigation Framework Utilizing Vision-Language Models
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation
- 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation