An Efficient and Multi-Modal Navigation System with One-Step World Model
On the map: World models → World models for navigation
Abstract (arXiv)
Navigation is a fundamental capability for mobile robots. While the current trend is to use learning-based approaches to replace traditional geometry-based methods, existing end-to-end learning-based policies often struggle with 3D spatial reasoning and lack a comprehensive understanding of physical world dynamics. Integrating world models-which predict future observations conditioned on given actions-with iterative optimization planning offers a promising solution due to their capacity for imagination and flexibility. However, current navigation world models, typically built on pure transformer architectures, often rely on multi-step diffusion processes and autoregressive frame-by-frame generation. These mechanisms result in prohibitive computational latency, rendering real-time deployment impossible. To address this bottleneck, we propose a lightweight navigation world model that adopts a one-step generation paradigm and a 3D U-Net backbone equipped with efficient spatial-temporal attention. This design drastically reduces inference latency, enabling high-frequency control while achieving superior predictive performance. We also integrate this model into an optimization-based planning framework utilizing anchor-based initialization to handle multi-modal goal navigation tasks. Extensive closed-loop experiments in both simulation and real-world environments demonstrate our system's superior efficiency and robustness compared to state-of-the-art baselines.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 19 of its 43 references that are in the map. First posted on arXiv 18 Jan 2026.
Builds on
19 of 43 references.
Closest ancestors · 1
Same direction, newest first
Other references · 18
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2018World Modelscited by 1,444
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2024Genie: Generative Interactive Environmentscited by 706
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2024One Step Diffusion via Shortcut Modelscited by 373
6 more
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
- 2023Seer: Language Instructed Video Prediction with Latent Diffusion Modelscited by 51
- 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoningcited by 49
- 2025OmniVLA: An Omni-Modal Vision-Language-Action Model for Robot Navigationcited by 34
- 2025Learning 3D Persistent Embodied World Modelscited by 29
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Studycited by 35
- 2026RAE-NWM: Navigation World Model in Dense Visual Representation Spacecited by 9
- 2026WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigationcited by 7
- 2026Policy-Guided World Model Planning for Language-Conditioned Visual Navigationcited by 3
- 2026World Models as Group Actionscited by 3
- 2026Uncertainty-Aware World Model for Aerial Image-Goal Navigationcited by 2
- 2026Drift-Resistant Navigation World Model with Anchored Epipolar Guidancecited by 1
- 2026Feeling Terrain Before Crossing: World Models for Off-Road Navigationcited by 0
- 2026Social-WM: Safety-Aware Latent World Models for Robot Social Navigationcited by 0
- 2026Social-WM: Safety-Aware Latent World Models for Robot Social Navigation30 Sep 2026
- 2026Feeling Terrain Before Crossing: World Models for Off-Road Navigation17 Sep 2026
- 2026Uncertainty-Aware World Model for Aerial Image-Goal Navigation6 Aug 2026
- 2026WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigation3 Jun 2026
- 2026Drift-Resistant Navigation World Model with Anchored Epipolar Guidance23 May 2026
- 2026World Models as Group Actions23 May 2026
- 2026Policy-Guided World Model Planning for Language-Conditioned Visual Navigation26 Mar 2026
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Study23 Mar 2026
- 2026RAE-NWM: Navigation World Model in Dense Visual Representation Space10 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2024X-MOBILITY: End-To-End Generalizable Navigation via World Modeling
- 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planning
- 2024Navigation World Models
- 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation
- 2022Tracking and Planning with Spatial World Models
- 2026MWM: Mobile World Models for Action-Conditioned Consistent Prediction
- 2026World Model for Robot Learning: A Comprehensive Survey
- 2026Unifying Object-Centric World Models and Diffusion Policy: A Hierarchical Framework for Multi-Stage Robotic Tasks