SC2-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environments
On the map: World models → World models for navigation
Abstract (arXiv)
Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires agents to make fine-grained navigation decisions under partial observability. However, most existing methods rely on open-loop execution, lacking mechanisms to detect and correct internal state drift during inference. We propose SC2-WM, a self-correcting world model framework that introduces internal feedback for closed-loop decision making in VLN-CE. Our method derives feedback from world-model foresight to perform state-level plan refinement before action execution. To handle challenging scenarios, we further introduce conditional world-aware adaptation, which enables model-level correction by selectively updating the world model at test time when feedback indicates model capacity insufficiency. Experiments on standard VLN-CE benchmarks demonstrate improved navigation robustness and generalization. Our code is available at https://github.com/sunrise-ikun/SC2WM.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 28 of its 70 references that are in the map. First posted on arXiv 1 Aug 2026.
Builds on
28 of 70 references.
Closest ancestors · 1
Same direction, newest first
- 2025UNeMo: Collaborative Visual-Language Reasoning and Navigation via a Multimodal World Model24 Nov
Other references · 27
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
- 2018World Modelscited by 1,444
- 2018On Evaluation of Embodied Navigation Agentscited by 526
- 2024Diffusion Models Are Real-Time Game Enginescited by 282
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 178
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 150
- 2024RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model Feedbackcited by 147
- 2022BEVBert: Multimodal Map Pre-training for Language-guided Navigationcited by 117
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
15 more
- 2019General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warpingcited by 102
- 2025Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Modelscited by 80
- 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 66
- 2023A2Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Modelscited by 61
- 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 60
- 2020Tent: Fully Test-time Adaptation by Entropy Minimizationcited by 59
- 2025Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigationcited by 56
- 2025Leave No Observation Behind: Real-time Correction for VLA Action Chunkscited by 45
- 20221st Place Solutions for RxR-Habitat Vision-and-Language Navigation Competition (CVPR 2022)cited by 30
- 2025SmartWay: Enhanced Waypoint Prediction and Backtracking for Zero-Shot Vision-and-Language Navigationcited by 29
- 2024EVA: An Embodied World Model for Future Video Anticipationcited by 28
- 2024A Self-Correcting Vision-Language-Action Model for Fast and Slow System Manipulationcited by 20
- 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigationcited by 19
- 2025ActiveVLN: Towards Active Exploration via Multi-Turn RL in Vision-and-Language Navigationcited by 11
- 2024UnitedVLN: Generalizable Gaussian Splatting for Continuous Vision-Language Navigationcited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environments
- 2025WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigation
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation
- 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation
- 2026AwareVLN: Reasoning with Self-awareness for Vision-Language Navigation
- 2025NavForesee: A Unified Vision-Language World Model for Hierarchical Planning and Dual-Horizon Navigation Prediction
- 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning
- 2026MWM: Mobile World Models for Action-Conditioned Consistent Prediction