mlsanityData to 14 Oct 2026

WAM4D: Fast 4D World Action Model via Spatial Register Tokens

arXiv 2606.14048 ↗First posted 12 Jun 2026cs.CV cs.ROcited by 15

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World action models (WAMs) have recently shown promise in jointly modeling future observations and executable robot actions. However, most existing WAMs still operate in 2D video or latent spaces, where visually plausible rollouts miss the 3D spatial constraints and occluded contact geometry required for precise manipulation. While geometric foundation models offer strong priors for recovering dense 3D structure and motion from visual observations, forcing WAMs to predict the dense 4D representation introduces costly geometric decoding and slows down causal action generation. To address the trade-off, we present WAM4D, a fast 4D world action model that uses lightweight spatial register tokens as training-time future-depth readouts to transfer pretrained geometric priors into a causal video-action transformer, then removes the register branch for lightweight action inference. To prevent non-causal shortcuts, we further design causal mixture attention for the Mixture-of-Transformers (MoT) WAM backbone, defining modality-specific visibility among video, action, and geometry tokens. Comprehensive experiments on RoboTwin 2.0 and challenging real-world manipulation tasks show that WAM4D improves spatial consistency and achieves competitive action prediction while maintaining efficient inference.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 45 of its 70 references that are in the map. First posted on arXiv 12 Jun 2026.

Builds on

45 of 70 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026World Action Models: The Next Frontier in Embodied AI12 May
  2. 2026Embody4D: A Generalist Data Engine for Embodied 4D World Modeling3 May
  3. 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
  4. 2026STARRY: Spatial-Temporal Action-Centric World Modeling for Robotic Manipulation29 Apr
  5. 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
  6. 2026ABot-PhysWorld: Interactive World Foundation Model for Robotic Manipulation with Physics Alignment24 Mar
  7. 2026Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation17 Mar
  8. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  9. 2026MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulation10 Feb
  10. 2026Causal World Modeling for Robot Control29 Jan
  11. 2025Motus: A Unified Latent Action World Model15 Dec
  12. 2025TesserAct: Learning 4D Embodied World Models29 Apr
1 more
  1. 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr

Other references · 32

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  4. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  5. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  7. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  8. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  9. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  10. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  11. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
  12. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
20 more
  1. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 138
  2. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 134
  3. 2024ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulationcited by 108
  4. 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
  5. 2024Manipulate-Anything: Automating Real-World Robots using Vision-Language Modelscited by 83
  6. 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Modelscited by 70
  7. 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 67
  8. 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 46
  9. 2026Lyra 2.0: Explorable Generative 3D Worldscited by 44
  10. 2026VLM4VLA: Revisiting Vision-Language-Models in Vision-Language-Action Modelscited by 39
  11. 2024Splat-MOVER: Multi-Stage, Open-Vocabulary Robotic Manipulation via Editable Gaussian Splattingcited by 38
  12. 2026LaST0: Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Modelcited by 31
  13. 2026VGGT-Omegacited by 26
  14. 2026Genie Sim 3.0 : A High-Fidelity Comprehensive Simulation Platform for Humanoid Robotcited by 14
  15. 2026Wow, wo, val! A Comprehensive Embodied World Model Evaluation Turing Testcited by 13
  16. 2026Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Actioncited by 8
  17. 2026ParkGaussian: Surround-view 3D Gaussian Splatting for Autonomous Parkingcited by 7
  18. 2026PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimizationcited by 2
  19. 2026VEGA: Visual Encoder Grounding Alignment for Spatially-Aware Vision-Language-Action Modelscited by 2
  20. 2026Feed-Forward Gaussian Splatting from Sparse Aerial Viewscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 15.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Faster-WAM: Do World Action Models Need Deep Action Modules?
  2. 2026Spatially Aware World Action Model via Geometric Latent Diffusion
  3. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  4. 2026Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination
  5. 2026UNITAS: A 3D-Native World Action Model for Embodied Manipulation
  6. 2026Box-WAM: Box Trajectories as Compact State Representations for World Action Models
  7. 2026Sparse-WAM: Accelerating World Action Models via Action-Guided Sparse Imagination
  8. 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing