Pondering the Way: Spatial-perceiving World Action Model for Embodied Navigation
On the map: World models → World models for navigation
Abstract (arXiv)
Existing world model-based planners for visual navigation typically follow a verification-centric paradigm, decoupling goal intent from trajectory synthesis. This approach suffers from candidate dependence, heavy computational overhead, and inconsistencies between sampled actions and predicted visuals. To address these issues, we propose SWAM (Spatial-perceiving World Action Model), a task-centric joint observation-action generation framework. Given start and goal RGB observations, SWAM performs single-pass inference to simultaneously generate intermediate RGB-D sequences and corresponding action trajectories, promoting goal-consistent trajectory generation and improved spatial feasibility. While SWAM leverages depth pseudo-labels during training to internalize spatial priors, it requires only monocular RGB input at inference time. We further introduce a visual-guided action refinement module and a trajectory-scale regularization loss to enforce fine-grained alignment between motion and visual cues while stabilizing predictions across varying distances. Extensive experiments show that SWAM significantly outperforms state-of-the-art two-stage planners in success rate, trajectory accuracy, and inference efficiency, while demonstrating robust zero-shot generalization to unseen environments.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 53 of its 57 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
53 of 57 references.
Closest ancestors · 2
Same direction, newest first
Other references · 51
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2018World Modelscited by 1,444
38 more
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023Reasoning with Language Model is Planning with World Modelcited by 846
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2026World Action Models are Zero-shot Policiescited by 411
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2016Deep Visual Foresight for Planning Robot Motioncited by 276
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
- 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 220
- 2023ViNT: A Foundation Model for Visual Navigationcited by 210
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
- 2018Semi-parametric Topological Memory for Navigationcited by 203
- 2016Learning to Navigate in Complex Environmentscited by 192
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
- 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 122
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 117
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 115
- 2025Aether: Geometric-Aware Unified World Modelingcited by 94
- 2017Neural Map: Structured Memory for Deep Reinforcement Learningcited by 88
- 2023Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planningcited by 88
- 2020ViNG: Learning Open-World Navigation with Visual Goalscited by 77
- 2024Prediction with Action: Visual Policy Learning via Joint Denoising Processcited by 64
- 2025VideoVLA: Video Generators Can Be Generalizable Robot Manipulatorscited by 61
- 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
- 2019Deep Visual MPC-Policy Learning for Navigationcited by 54
- 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoningcited by 49
- 2022TartanDrive: A Large-Scale Dataset for Learning Off-Road Dynamics Modelscited by 48
- 2025World-in-World: World Models in a Closed-Loop Worldcited by 44
- 2025ReSim: Reliable World Simulation for Autonomous Drivingcited by 42
- 2025Learning 3D Persistent Embodied World Modelscited by 29
- 2025UniPhys: Unified Planner and Controller with Diffusion for Flexible Physics-Based Character Controlcited by 24
- 2026UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous Drivingcited by 20
- 2025MiLA: Multi-view Intensive-fidelity Long-term Video Generation World Model for Autonomous Drivingcited by 18
- 2025CoVAR: Co-generation of Video and Action for Robotic Manipulation via Multi-Modal Diffusioncited by 9
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025AstraNav-World: World Model for Foresight Control and Consistency
- 2026UniNav: A Unified World-Action Diffusion Model for Visual Navigation
- 2025Towards Unified World Models for Visual Navigation via Memory-Augmented Planning and Foresight
- 2026WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigation
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation
- 2026RAE-NWM: Navigation World Model in Dense Visual Representation Space
- 2026MWM: Mobile World Models for Action-Conditioned Consistent Prediction
- 2026WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Models