World Action Models: A Survey
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World Action Models (WAMs) are embodied predictive-action models that make a forecast of the future available to action. Recent WAMs repurpose large video generation models, and a parallel line relies on language or vision-language backbones without a video-generation core. This rapid expansion has blurred the boundary among broad world models, video generation models, action-grounded video world models, Vision-Language-Action policies, and WAMs. This survey gives the field a common account. It first clarifies these boundaries, then organizes existing works through two complementary views. The first view asks what each method is required to generate, spanning rendered futures, latent futures, and video-generation-free action reasoning. The second view decomposes each method by predictive substrate, backbone, action coupling, and deployment regime. This anatomy supports a unified discussion of interactability, causality, persistence, physical plausibility, and generalization, followed by data, evaluation, and open challenges. Across these axes, a consistent design pattern emerges: WAMs are not simply video generators with action heads, but predictive-action methods whose design choices trade representational richness against compute, memory, latency, and action-label cost. The field is moving toward methods that generate less of the future while preserving what control requires. The survey homepage is available at https://world-action-models.github.io/.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 196 of its 215 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
196 of 215 references.
Closest ancestors · 65
Same direction, newest first
- 2026WALL-WM: Carving World Action Modeling at the Event Joints1 Jun
- 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation31 May
- 2026SANTS: A State-Adaptive Scheduler for World Action Models27 May
- 2026Point Tracking Improves World Action Models22 May
- 2026SWEET: Sparse World Modeling with Image Editing for Embodied Task Execution19 May
- 2026RoboFlow4D: A Lightweight Flow World Model Toward Real-Time Flow-Guided Robotic Manipulation17 May
- 2026Feedback World Model Enables Precise Guidance of Diffusion Policy15 May
- 2026EgoExo-WM: Unlocking Exo Video for Ego World Models14 May
- 2026The DAWN of World-Action Interactive Models12 May
- 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models11 May
- 2026NoiseGate: Learning Per-Latent Timestep Schedules as Information Gating in World Action Models8 May
- 2026CKT-WAM: Parameter-Efficient Context Knowledge Transfer Between World Action Models7 May
38 more
- 2026When to Trust Imagination: Adaptive Action Execution for World Action Models7 May
- 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
- 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
- 2026dWorldEval: Scalable Robotic Policy Evaluation via Discrete Diffusion World Model24 Apr
- 2026Mask World Model: Predicting What Matters for Robust Robot Policy Learning21 Apr
- 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems16 Apr
- 2026DexWorldModel: Causal Latent World Modeling towards Automated Learning of Embodied Tasks13 Apr
- 20263D-Anchored Lookahead Planning for Persistent Robotic Scene Memory via World-Model-Based MCTS13 Apr
- 2026AIM: Intent-Aware Unified world action Modeling with Spatial Value Maps13 Apr
- 2026VAG: Dual-Stream Video-Action Generation for Embodied Data Synthesis10 Apr
- 2026Action Images: End-to-End Policy Learning via Multiview Video Generation7 Apr
- 2026DriveDreamer-Policy: A Geometry-Grounded World-Action Model for Unified Generation and Planning2 Apr
- 2026VTAM: Video-Tactile-Action Models for Complex Physical Interaction Beyond VLAs24 Mar
- 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation19 Mar
- 2026EVA: Aligning Video World Models with Executable Robot Actions via Inverse Dynamics Rewards18 Mar
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026Interactive World Simulator for Robot Policy Training and Evaluation9 Mar
- 2026AdaWorldPolicy: World-Model-Driven Diffusion Policy with Online Adaptive Learning for Robotic Manipulation23 Feb
- 2026FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignment19 Feb
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026GigaBrain-0.5M*: a VLA That Learns From World Model-Based Reinforcement Learning12 Feb
- 2026Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation11 Feb
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
- 2026MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulation10 Feb
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2026TC-IDM: Grounding Video Generation for Executable Zero-shot Robot Motion26 Jan
- 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation7 Jan
- 2025Act2Goal: From World Model To General Goal-conditioned Policy29 Dec
- 2025World Models for Learning Dexterous Hand-Object Interactions from Human Videos15 Dec
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025Evaluating Gemini Robotics Policies in a Veo World Simulator11 Dec
- 2025Learning Robot Manipulation from Audio World Models9 Dec
- 2025TraceGen: World Modeling in 3D Trace Space Enables Learning from Cross-Embodiment Videos26 Nov
- 2025RynnVLA-002: A Unified Vision-Language-Action and World Model21 Nov
- 2025Robot Learning from a Physical World Model10 Nov
- 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Model31 Oct
50 newest of 65 All 65 (JSON)
Other references · 131
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023Segment Anythingcited by 8,234
- 2017Neural Discrete Representation Learningcited by 4,712
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
38 more
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 270
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 211
- 2025Unified Video Action Modelcited by 205
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 201
- 2024Autoregressive Video Generation without Vector Quantizationcited by 186
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 179
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 175
- 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 175
50 most cited of 131 All 131 (JSON)
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026BadWAM: When World-Action Models Dream Right but Act Wrongcited by 4
- 2026RISE: Adaptive Imagination for World Action Modelscited by 4
- 2026Robust-WAM: Bridging Generative Pretraining and Semantic Foresight in World-Action Modelscited by 3
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAMcited by 0
- 2026Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modelingcited by 0
- 2026DroneWAM: Efficient World Action Model for Drone Visual Navigationcited by 0
- 2026Completion Aware Guidance for World Action Modelscited by 0
- 2026Future Anchored Verification and Online Recovery for World Action Modelscited by 0
- 2026Rewiring Semantics, Dynamics, and Control: A Simple yet Effective Action-Centric Tri-Stream Transformercited by 0
- 2026Humanoid World Action Model With Joint State--Action Generationcited by 0
- 2026UniW(A)M: A Unified Mixture-of-Experts Framework for World and World-Action Modelscited by 0
- 2026UniW(A)M: A Unified Mixture-of-Experts Framework for World and World-Action Models13 Oct 2026
- 2026Humanoid World Action Model With Joint State--Action Generation8 Oct 2026
- 2026Rewiring Semantics, Dynamics, and Control: A Simple yet Effective Action-Centric Tri-Stream Transformer8 Oct 2026
- 2026Future Anchored Verification and Online Recovery for World Action Models5 Oct 2026
- 2026Completion Aware Guidance for World Action Models1 Oct 2026
- 2026DroneWAM: Efficient World Action Model for Drone Visual Navigation27 Sep 2026
- 2026Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modeling26 Sep 2026
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM22 Sep 2026
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026RISE: Adaptive Imagination for World Action Models20 Aug 2026
- 2026Robust-WAM: Bridging Generative Pretraining and Semantic Foresight in World-Action Models6 Aug 2026
- 2026BadWAM: When World-Action Models Dream Right but Act Wrong16 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026World Action Models: The Next Frontier in Embodied AI
- 2026Foresight Without Seeing: Latent Futures for World Action Models
- 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap
- 2026What Makes World Action Models Generalize? An Empirical Study of Test-Time Future Modeling
- 2026Latent evolving World Action Model
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models
- 2026FLEX-WAM: Flexible Block-Causal World-Action Models for Long-Horizon Imagination and Planning