mlsanityData to 7 Oct 2026

SC2-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environments

arXiv 2608.07548 ↗First posted 1 Aug 2026cs.RO cs.CVcited by 1

On the map: World models → World models for navigation

Abstract (arXiv)

Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires agents to make fine-grained navigation decisions under partial observability. However, most existing methods rely on open-loop execution, lacking mechanisms to detect and correct internal state drift during inference. We propose SC2-WM, a self-correcting world model framework that introduces internal feedback for closed-loop decision making in VLN-CE. Our method derives feedback from world-model foresight to perform state-level plan refinement before action execution. To handle challenging scenarios, we further introduce conditional world-aware adaptation, which enables model-level correction by selectively updating the world model at test time when feedback indicates model capacity insufficiency. Experiments on standard VLN-CE benchmarks demonstrate improved navigation robustness and generalization. Our code is available at https://github.com/sunrise-ikun/SC2WM.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 28 of its 70 references that are in the map. First posted on arXiv 1 Aug 2026.

Builds on

28 of 70 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025UNeMo: Collaborative Visual-Language Reasoning and Navigation via a Multimodal World Model24 Nov

Other references · 27

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
  4. 2018World Modelscited by 1,444
  5. 2018On Evaluation of Embodied Navigation Agentscited by 526
  6. 2024Diffusion Models Are Real-Time Game Enginescited by 282
  7. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
  8. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 178
  9. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 150
  10. 2024RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model Feedbackcited by 147
  11. 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 117
  12. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
15 more
  1. 2019General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warpingcited by 102
  2. 2025Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Modelscited by 80
  3. 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 66
  4. 2023A2Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Modelscited by 61
  5. 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 60
  6. 2020Tent: Fully Test-time Adaptation by Entropy Minimizationcited by 59
  7. 2025Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigationcited by 56
  8. 2025Leave No Observation Behind: Real-time Correction for VLA Action Chunkscited by 45
  9. 20221st Place Solutions for RxR-Habitat Vision-and-Language Navigation Competition (CVPR 2022)cited by 30
  10. 2025SmartWay: Enhanced Waypoint Prediction and Backtracking for Zero-Shot Vision-and-Language Navigationcited by 29
  11. 2024EVA: An Embodied World Model for Future Video Anticipationcited by 28
  12. 2024A Self-Correcting Vision-Language-Action Model for Fast and Slow System Manipulationcited by 20
  13. 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigationcited by 19
  14. 2025ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigationcited by 11
  15. 2024UnitedVLN: Generalizable Gaussian Splatting for Continuous Vision-Language Navigationcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environments
  2. 2025WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigation
  3. 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation
  4. 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation
  5. 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation
  6. 2025NavForesee: A Unified Vision-Language World Model for Hierarchical Planning and Dual-Horizon Navigation Prediction
  7. 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning
  8. 2026MWM: Mobile World Models for Action-Conditioned Consistent Prediction