Magic-W0: A Structured World-Action Foundation Model for Physical Intelligence
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World-action models (WAMs) augment robot policies with action-conditioned environment dynamics, yet existing approaches largely rely on future observation reconstruction or generic latent prediction and lack structured, control-oriented world representations tightly coupled with action generation. We introduce Magic-W0, a world-action foundation model that jointly models structured physical state evolution and continuous actions. Magic-W0 represents interaction as a Structured World Transition consisting of Current State, Transition, and Future State. Current State combines vision-language context with Current 3D Geometry; Transition is represented by 3D Motion capturing action-induced three-dimensional changes; and Future State is represented by Future Semantics describing task-relevant outcomes. To couple prediction and control, we propose a layer-aligned world-action interaction architecture in which evolving action hypotheses condition world-transition prediction, while predicted world representations continuously inform action generation. Magic-W0 is pre-trained on large-scale egocentric human manipulation, UMI, real-robot, and simulation data, with latent supervision for geometry, 3D motion, and future semantics from pre-trained visual models. Inference-time interventions show that structured world representations respond systematically to changes in candidate actions and that action-related information propagates through shared 3D representations into future semantic predictions. On RoboDojo-Sim, Magic-W0 achieves an average Score of 27.10, the highest among the compared WAMs. Across multiple real-robot tasks, it also demonstrates strong downstream performance after fine-tuning with limited downstream data, supporting generalization and rapid adaptation.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 47 of its 65 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
47 of 65 references.
Closest ancestors · 15
Same direction, newest first
- 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining7 Sep
- 2026JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modeling10 Aug
- 2026RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation7 Jul
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing8 Jun
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos30 Apr
- 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
3 more
Other references · 32
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,823
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,344
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,028
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,699
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,450
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,368
- 2025DINOv3cited by 1,355
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,197
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 862
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 658
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 656
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 512
20 more
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 369
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 357
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 293
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 292
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 289
- 2025Unified Video Action Modelcited by 200
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 143
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 130
- 2025Galaxea Open-World Dataset and G0 Dual-System VLA Modelcited by 90
- 2024Dreamitate: Real-World Visuomotor Policy Learning via Video Generationcited by 84
- 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 80
- 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Controlcited by 73
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 64
- 2026RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policiescited by 37
- 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectoriescited by 26
- 2026Hy-Embodied-0.5-VLA: From Vision-Language-Action Models to a Real-World Robot Learning Stackcited by 22
- 2026G0.5: One Autoregressive Stream for Robot Reasoning and Actioncited by 17
- 2026SpatialVAM:Spatial-Aware Multi-View Video Diffusion as a Data-Efficient Robot Policycited by 8
- 2026Route by Kinematics, Act by Observation: Kinematics-Supervised Expert Routing in MoE-Augmented VLAcited by 3
- 2026MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligencecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
- 2026From World Models to World Action Models: Rethinking Next-State Prediction
- 2026World Action Models: The Next Frontier in Embodied AI
- 2026Beyond Instance Slots: Semantically Rich World Models for Physical Interaction Planning
- 2026Decoupling Intention from Trajectory: A Representational Deduction Framework for World Action Models
- 2026World Models for Robotic Manipulation: A Survey
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulation