mlsanityData to 7 Oct 2026

Pondering the Way: Spatial-perceiving World Action Model for Embodied Navigation

arXiv 2606.29908 ↗First posted 29 Jun 2026cs.RO cs.AIcited by 2

On the map: World models → World models for navigation

Abstract (arXiv)

Existing world model-based planners for visual navigation typically follow a verification-centric paradigm, decoupling goal intent from trajectory synthesis. This approach suffers from candidate dependence, heavy computational overhead, and inconsistencies between sampled actions and predicted visuals. To address these issues, we propose SWAM (Spatial-perceiving World Action Model), a task-centric joint observation-action generation framework. Given start and goal RGB observations, SWAM performs single-pass inference to simultaneously generate intermediate RGB-D sequences and corresponding action trajectories, promoting goal-consistent trajectory generation and improved spatial feasibility. While SWAM leverages depth pseudo-labels during training to internalize spatial priors, it requires only monocular RGB input at inference time. We further introduce a visual-guided action refinement module and a trajectory-scale regularization loss to enforce fine-grained alignment between motion and visual cues while stabilizing predictions across varying distances. Extensive experiments show that SWAM significantly outperforms state-of-the-art two-stage planners in success rate, trajectory accuracy, and inference efficiency, while demonstrating robust zero-shot generalization to unseen environments.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 53 of its 57 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

53 of 57 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025A Comprehensive Survey on World Models for Embodied AI19 Oct
  2. 2024Navigation World Models4 Dec

Other references · 51

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2022Flow Matching for Generative Modelingcited by 5,426
  6. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  7. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  9. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  11. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  12. 2018World Modelscited by 1,444
38 more
  1. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  2. 2023Reasoning with Language Model is Planning with World Modelcited by 846
  3. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  4. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  5. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  6. 2026World Action Models are Zero-shot Policiescited by 411
  7. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
  8. 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
  9. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  10. 2016Deep Visual Foresight for Planning Robot Motioncited by 276
  11. 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
  12. 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 220
  13. 2023ViNT: A Foundation Model for Visual Navigationcited by 210
  14. 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
  15. 2018Semi-parametric Topological Memory for Navigationcited by 203
  16. 2016Learning to Navigate in Complex Environmentscited by 192
  17. 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
  18. 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 122
  19. 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
  20. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 117
  21. 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 115
  22. 2025Aether: Geometric-Aware Unified World Modelingcited by 94
  23. 2017Neural Map: Structured Memory for Deep Reinforcement Learningcited by 88
  24. 2023Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planningcited by 88
  25. 2020ViNG: Learning Open-World Navigation with Visual Goalscited by 77
  26. 2024Prediction with Action: Visual Policy Learning via Joint Denoising Processcited by 64
  27. 2025VideoVLA: Video Generators Can Be Generalizable Robot Manipulatorscited by 61
  28. 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
  29. 2019Deep Visual MPC-Policy Learning for Navigationcited by 54
  30. 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoningcited by 49
  31. 2022TartanDrive: A Large-Scale Dataset for Learning Off-Road Dynamics Modelscited by 48
  32. 2025World-in-World: World Models in a Closed-Loop Worldcited by 44
  33. 2025ReSim: Reliable World Simulation for Autonomous Drivingcited by 42
  34. 2025Learning 3D Persistent Embodied World Modelscited by 29
  35. 2025UniPhys: Unified Planner and Controller with Diffusion for Flexible Physics-Based Character Controlcited by 24
  36. 2026UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous Drivingcited by 20
  37. 2025MiLA: Multi-view Intensive-fidelity Long-term Video Generation World Model for Autonomous Drivingcited by 18
  38. 2025CoVAR: Co-generation of Video and Action for Robotic Manipulation via Multi-Modal Diffusioncited by 9

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AstraNav-World: World Model for Foresight Control and Consistency
  2. 2026UniNav: A Unified World-Action Diffusion Model for Visual Navigation
  3. 2025Towards Unified World Models for Visual Navigation via Memory-Augmented Planning and Foresight
  4. 2026WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigation
  5. 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation
  6. 2026RAE-NWM: Navigation World Model in Dense Visual Representation Space
  7. 2026MWM: Mobile World Models for Action-Conditioned Consistent Prediction
  8. 2026WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Models