mlsanityData to 14 Oct 2026

SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigation

arXiv 2604.27620 ↗First posted 30 Apr 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Vision-and-Language Navigation (VLN) aims to enable an embodied agent to follow natural-language instructions and navigate to a target location in unseen 3D environments. We argue that adapting VLMs to VLN requires endowing them with two complementary capabilities for acquiring such awareness, namely backward action reasoning (why) and forward transition prediction~(how). Based on this insight, we propose SpaAct, a simple yet effective training framework that activates the dynamic spatial awareness in VLMs. Specifically, SpaAct introduces two spatial activation tasks: Action Retrospection, which asks the model to infer the executed action sequence from visual transitions, and Future Frame Selection, which forces the model to predict the visual transitions conditioned on history and action. These two objectives provide lightweight supervision on both backward action reasoning and forward transition prediction, encouraging the model to build dynamic spatial awareness in a VLM-friendly way. To further stabilize adaptation, we design TriPA, a Tri-factor Progressive Adaptive curriculum learning method that organizes training samples from easy to hard, allowing the model to gradually acquire navigation skills from basic locomotion to long-horizon reasoning. Experiments on standard VLN-CE benchmarks show that SpaAct consistently improves VLM-based navigation and achieves state-of-the-art performance. We will release the code and models to support future research.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 48 of its 63 references that are in the map. First posted on arXiv 30 Apr 2026.

Builds on

48 of 63 references.

References · 48

  1. 2023Qwen Technical Reportcited by 3,344
  2. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  3. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  4. 2023VILA: On Pre-training for Visual Language Modelscited by 692
  5. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
  6. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
  7. 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
  8. 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 340
  9. 2026Causal World Modeling for Robot Controlcited by 321
  10. 2021History Aware Multimodal Transformer for Vision-and-Language Navigationcited by 271
  11. 2023Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Textcited by 208
  12. 2019Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Taskscited by 179
36 more
  1. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
  2. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
  3. 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 129
  4. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
  5. 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 117
  6. 2021Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environmentscited by 94
  7. 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
  8. 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
  9. 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
  10. 2024Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Modelscited by 79
  11. 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
  12. 2020Sub-Instruction Aware Vision-and-Language Navigationcited by 66
  13. 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 65
  14. 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 63
  15. 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigationcited by 60
  16. 2024Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environmentscited by 50
  17. 2021SASRA: Semantically-aware Spatio-temporal Reasoning Agent for Vision-and-Language Navigation in Continuous Environmentscited by 48
  18. 2023Learning Vision-and-Language Navigation from YouTube Videoscited by 47
  19. 2023Improving Vision-and-Language Navigation by Generating Future-View Image Semanticscited by 46
  20. 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environmentscited by 45
  21. 2022Reinforced Structured State-Evolution for Vision-Language Navigationcited by 37
  22. 2023FGPrompt: Fine-grained Goal Prompting for Image-goal Navigationcited by 22
  23. 2024g3D-LF: Generalizable 3D-Language Feature Fields for Embodied Taskscited by 22
  24. 2020Embodied Visual Navigation with Automatic Curriculum Learning in Real Environmentscited by 21
  25. 2025NavForesee: A Unified Vision-Language World Model for Hierarchical Planning and Dual-Horizon Navigation Predictioncited by 16
  26. 2025MobileVLA-R1: Reinforcing Vision-Language-Action for Mobile Robotscited by 15
  27. 2025Do Visual Imaginations Improve Vision-and-Language Navigation Agents?cited by 14
  28. 2025REGNav: Room Expert Guided Image-Goal Navigationcited by 12
  29. 2025Progress-Think: Semantic Progress Reasoning for Vision-Language Navigationcited by 12
  30. 2025Ground-level Viewpoint Vision-and-Language Navigation in Continuous Environmentscited by 10
  31. 2026HiMemVLN: Enhancing Reliability of Open-Source Zero-Shot Vision-and-Language Navigation with Hierarchical Memory Systemcited by 8
  32. 2026Dual-Anchoring: Addressing State Drift in Vision-Language Navigationcited by 7
  33. 2026Spatial-VLN: Zero-Shot Vision-and-Language Navigation With Explicit Spatial Perception and Explorationcited by 5
  34. 2022Good Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigationcited by 3
  35. 2026Think before Go: Hierarchical Reasoning for Image-goal Navigationcited by 2
  36. 2023Robustness of Utilizing Feedback in Embodied Visual Navigationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation
  2. 2025Igniting VLMs toward the Embodied Space
  3. 2026SPAN-Nav: Generalized Spatial Awareness for Versatile Vision-Language Navigation
  4. 2026Embodied-Navigator: Point, Think, Memorize, and Align for Efficient Navigation
  5. 2025Breaking Down and Building Up: Mixture of Skill-Based Vision-and-Language Navigation Agents
  6. 2025A Navigation Framework Utilizing Vision-Language Models
  7. 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation
  8. 2026Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation