From World Models to World Action Models: Rethinking Next-State Prediction
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Predicting the next state is a core paradigm of World Models for modeling physical dynamics, emphasizing prediction fidelity. As World Models evolve into World-Action Models (WAMs), existing methods still fix the next state before training as RGB, a single latent feature, or a static combination of predefined targets, thereby constraining action learning to the inductive biases preserved by a particular representation. To address this limitation, we propose CF-WAM, a dynamic next-state prediction framework that samples visual, semantic, geometric, and interaction projections of the same future, standardizes them into a common video form, and supervises a unified WAM across these projections. The action-relevant constraints exposed by these projections accumulate across training steps, forcing WAM to capture the underlying state-transition structure that supports multiple projections of the same action-conditioned future. This dynamic mechanism also provides a natural cross-embodiment dynamics reference frame for Human and Robot learning. By jointly learning across different next-state parameterizations, heterogeneous Human and Robot experience can bypass appearance differences and directly contribute to shared state-transition learning, improving cross-embodiment generalization. Experiments show that CF-WAM improves both training efficiency and final control performance, while translating Human experience effectively into policy gains. CF-WAM achieves state-of-the-art performance on RoboCasa-GR1 with an average success rate of 82.50%, while reaching 82.65% on LIBERO-Plus and up to 84.00% in real-world evaluations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 34 of its 49 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
34 of 49 references.
Closest ancestors · 10
Same direction, newest first
- 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulation3 Sep
- 2026Spatially Aware World Action Model via Geometric Latent Diffusion2 Sep
- 2026GaussianWAM: Distilling Geometry and Semantics from 3D Gaussian Fields into World-Action Models25 Aug
- 2026GWM-VLA: Geometry-Aware Latent World Modeling for Vision-Language-Action Learning7 Aug
- 2026DIAL: Decoupling Intent and Action via Latent World Modeling for End-to-End VLA31 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation7 Jan
- 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
Other references · 24
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018World Modelscited by 1,513
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 694
- 2023Learning Interactive Real-World Simulatorscited by 458
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
- 2024Flow as the Cross-Domain Manipulation Interfacecited by 132
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
- 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Datacited by 94
- 2024General Flow as Foundation Affordance for Scalable Robot Learningcited by 85
12 more
- 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Controlcited by 76
- 2026EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the Worldcited by 57
- 2026LDA-1B: Scaling Latent Dynamics Action Model via Universal Embodied Data Ingestioncited by 52
- 2026JoyAI-RA 0.1: A Foundation Model for Robotic Autonomycited by 23
- 2026HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videoscited by 16
- 2026Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Datacited by 11
- 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibilitycited by 11
- 2026ACE-Ego-0: Unifying Egocentric Human and Robotic Data for VLA Pretrainingcited by 10
- 2026EgoEngine: From Egocentric Human Videos to High-Fidelity Dexterous Robot Demonstrationscited by 8
- 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Expertscited by 4
- 2026FoMoVLA: Bridging Visual Foresight and Motion Guidance for Vision-Language-Action Modelscited by 3
- 2026WALA Learning Executable Latent Actions from Action-Labeled Demonstrations and Action-Free Videoscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Foresight Without Seeing: Latent Futures for World Action Models
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026World Action Models: The Next Frontier in Embodied AI
- 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
- 2026DeltaWAM: Distilling Action Tangent Fields into World Action Models
- 2026Magic-W0: A Structured World-Action Foundation Model for Physical Intelligence
- 2026Learning Transferable Dynamics Priors from Action to World Modeling
- 2026LD4WAM: Learning Latent Dynamics from Human Videos for World Action Models