mlsanityData to 14 Oct 2026

World Action Models: A Survey

arXiv 2606.20781 ↗First posted 18 Jun 2026cs.RO cs.CVcited by 12

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World Action Models (WAMs) are embodied predictive-action models that make a forecast of the future available to action. Recent WAMs repurpose large video generation models, and a parallel line relies on language or vision-language backbones without a video-generation core. This rapid expansion has blurred the boundary among broad world models, video generation models, action-grounded video world models, Vision-Language-Action policies, and WAMs. This survey gives the field a common account. It first clarifies these boundaries, then organizes existing works through two complementary views. The first view asks what each method is required to generate, spanning rendered futures, latent futures, and video-generation-free action reasoning. The second view decomposes each method by predictive substrate, backbone, action coupling, and deployment regime. This anatomy supports a unified discussion of interactability, causality, persistence, physical plausibility, and generalization, followed by data, evaluation, and open challenges. Across these axes, a consistent design pattern emerges: WAMs are not simply video generators with action heads, but predictive-action methods whose design choices trade representational richness against compute, memory, latency, and action-label cost. The field is moving toward methods that generate less of the future while preserving what control requires. The survey homepage is available at https://world-action-models.github.io/.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 196 of its 215 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

196 of 215 references.

Closest ancestors · 65

Same direction, newest first

  1. 2026WALL-WM: Carving World Action Modeling at the Event Joints1 Jun
  2. 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation31 May
  3. 2026SANTS: A State-Adaptive Scheduler for World Action Models27 May
  4. 2026Point Tracking Improves World Action Models22 May
  5. 2026SWEET: Sparse World Modeling with Image Editing for Embodied Task Execution19 May
  6. 2026RoboFlow4D: A Lightweight Flow World Model Toward Real-Time Flow-Guided Robotic Manipulation17 May
  7. 2026Feedback World Model Enables Precise Guidance of Diffusion Policy15 May
  8. 2026EgoExo-WM: Unlocking Exo Video for Ego World Models14 May
  9. 2026The DAWN of World-Action Interactive Models12 May
  10. 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models11 May
  11. 2026NoiseGate: Learning Per-Latent Timestep Schedules as Information Gating in World Action Models8 May
  12. 2026CKT-WAM: Parameter-Efficient Context Knowledge Transfer Between World Action Models7 May
38 more
  1. 2026When to Trust Imagination: Adaptive Action Execution for World Action Models7 May
  2. 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
  3. 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
  4. 2026dWorldEval: Scalable Robotic Policy Evaluation via Discrete Diffusion World Model24 Apr
  5. 2026Mask World Model: Predicting What Matters for Robust Robot Policy Learning21 Apr
  6. 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems16 Apr
  7. 2026DexWorldModel: Causal Latent World Modeling towards Automated Learning of Embodied Tasks13 Apr
  8. 20263D-Anchored Lookahead Planning for Persistent Robotic Scene Memory via World-Model-Based MCTS13 Apr
  9. 2026AIM: Intent-Aware Unified world action Modeling with Spatial Value Maps13 Apr
  10. 2026VAG: Dual-Stream Video-Action Generation for Embodied Data Synthesis10 Apr
  11. 2026Action Images: End-to-End Policy Learning via Multiview Video Generation7 Apr
  12. 2026DriveDreamer-Policy: A Geometry-Grounded World-Action Model for Unified Generation and Planning2 Apr
  13. 2026VTAM: Video-Tactile-Action Models for Complex Physical Interaction Beyond VLAs24 Mar
  14. 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation19 Mar
  15. 2026EVA: Aligning Video World Models with Executable Robot Actions via Inverse Dynamics Rewards18 Mar
  16. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
  17. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  18. 2026Interactive World Simulator for Robot Policy Training and Evaluation9 Mar
  19. 2026AdaWorldPolicy: World-Model-Driven Diffusion Policy with Online Adaptive Learning for Robotic Manipulation23 Feb
  20. 2026FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignment19 Feb
  21. 2026World Action Models are Zero-shot Policies17 Feb
  22. 2026GigaBrain-0.5M*: a VLA That Learns From World Model-Based Reinforcement Learning12 Feb
  23. 2026Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation11 Feb
  24. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
  25. 2026MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulation10 Feb
  26. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
  27. 2026Causal World Modeling for Robot Control29 Jan
  28. 2026TC-IDM: Grounding Video Generation for Executable Zero-shot Robot Motion26 Jan
  29. 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation7 Jan
  30. 2025Act2Goal: From World Model To General Goal-conditioned Policy29 Dec
  31. 2025World Models for Learning Dexterous Hand-Object Interactions from Human Videos15 Dec
  32. 2025Motus: A Unified Latent Action World Model15 Dec
  33. 2025Evaluating Gemini Robotics Policies in a Veo World Simulator11 Dec
  34. 2025Learning Robot Manipulation from Audio World Models9 Dec
  35. 2025TraceGen: World Modeling in 3D Trace Space Enables Learning from Cross-Embodiment Videos26 Nov
  36. 2025RynnVLA-002: A Unified Vision-Language-Action and World Model21 Nov
  37. 2025Robot Learning from a Physical World Model10 Nov
  38. 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Model31 Oct

50 newest of 65 All 65 (JSON)

Other references · 131

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2023Segment Anythingcited by 8,234
  3. 2017Neural Discrete Representation Learningcited by 4,712
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  9. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  10. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  12. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
38 more
  1. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  2. 2023Mastering Diverse Domains through World Modelscited by 1,253
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  4. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  5. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  6. 2020Mastering Atari with Discrete World Modelscited by 1,007
  7. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  8. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  9. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  10. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
  11. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
  12. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
  13. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
  14. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  15. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
  16. 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
  17. 2023CoTracker: It is Better to Track Togethercited by 522
  18. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  19. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
  20. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
  21. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  22. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
  23. 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
  24. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
  25. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
  26. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
  27. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  28. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
  29. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  30. 2019RoboNet: Large-Scale Multi-Robot Learningcited by 270
  31. 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
  32. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 211
  33. 2025Unified Video Action Modelcited by 205
  34. 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 201
  35. 2024Autoregressive Video Generation without Vector Quantizationcited by 186
  36. 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 179
  37. 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 175
  38. 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 175

50 most cited of 131 All 131 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026World Action Models: The Next Frontier in Embodied AI
  2. 2026Foresight Without Seeing: Latent Futures for World Action Models
  3. 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining
  4. 2025Simulating the Visual World with Artificial Intelligence: A Roadmap
  5. 2026What Makes World Action Models Generalize? An Empirical Study of Test-Time Future Modeling
  6. 2026Latent evolving World Action Model
  7. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models
  8. 2026FLEX-WAM: Flexible Block-Causal World-Action Models for Long-Horizon Imagination and Planning