mlsanityData to 14 Oct 2026

World Action Models: The Next Frontier in Embodied AI

arXiv 2605.12090 ↗First posted 12 May 2026cs.RO cs.CL cs.CVcited by 50

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models have achieved strong semantic generalization for embodied policy learning, yet they learn reactive observation-to-action mappings without explicitly modeling how the physical world evolves under intervention. A growing body of work addresses this limitation by integrating world models, predictive models of environment dynamics, into the action generation pipeline. We term this emerging paradigm World Action Models (WAMs): embodied foundation models that unify predictive state modeling with action generation, targeting a joint distribution over future states and actions rather than actions alone. However, the literature remains fragmented across architectures, learning objectives, and application scenarios, lacking a unified conceptual framework. We formally define WAMs and disambiguate them from related concepts, and trace the foundations and early integration of VLA and world model research that gave rise to this paradigm. We organize existing methods into a structured taxonomy of Cascaded and Joint WAMs, with further subdivision by generation modality, conditioning mechanism, and action decoding strategy. We systematically analyze the data ecosystem fueling WAMs development, spanning robot teleoperation, portable human demonstrations, simulation, and internet-scale egocentric video, and synthesize emerging evaluation protocols organized around visual fidelity, physical commonsense, and action plausibility. Overall, this survey provides the first systematic account of the WAMs landscape, clarifies key architectural paradigms and their trade-offs, and identifies open challenges and future opportunities for this rapidly evolving field.

Key facts. Cited by 50 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 337 of its 366 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

337 of 366 references.

Closest ancestors · 67

Same direction, newest first

  1. 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos30 Apr
  2. 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
  3. 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
  4. 2026dWorldEval: Scalable Robotic Policy Evaluation via Discrete Diffusion World Model24 Apr
  5. 2026Mask World Model: Predicting What Matters for Robust Robot Policy Learning21 Apr
  6. 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems16 Apr
  7. 2026DexWorldModel: Causal Latent World Modeling towards Automated Learning of Embodied Tasks13 Apr
  8. 2026AIM: Intent-Aware Unified world action Modeling with Spatial Value Maps13 Apr
  9. 2026VAG: Dual-Stream Video-Action Generation for Embodied Data Synthesis10 Apr
  10. 2026ManipArena: Comprehensive Real-world Evaluation of Reasoning-Oriented Generalist Robot Manipulation30 Mar
  11. 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation19 Mar
  12. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
38 more
  1. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  2. 2026Interactive World Simulator for Robot Policy Training and Evaluation9 Mar
  3. 2026AdaWorldPolicy: World-Model-Driven Diffusion Policy with Online Adaptive Learning for Robotic Manipulation23 Feb
  4. 2026FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignment19 Feb
  5. 2026World Action Models are Zero-shot Policies17 Feb
  6. 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL15 Feb
  7. 2026RISE: Self-Improving Robot Policy with Compositional World Model11 Feb
  8. 2026Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation11 Feb
  9. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
  10. 2026MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulation10 Feb
  11. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
  12. 2026World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policy6 Feb
  13. 2026Visuo-Tactile World Models5 Feb
  14. 2026World-Gymnast: Training Robots with Reinforcement Learning in a World Model2 Feb
  15. 2026Causal World Modeling for Robot Control29 Jan
  16. 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation7 Jan
  17. 2025Act2Goal: From World Model To General Goal-conditioned Policy29 Dec
  18. 2025World Models for Learning Dexterous Hand-Object Interactions from Human Videos15 Dec
  19. 2025Motus: A Unified Latent Action World Model15 Dec
  20. 2025Evaluating Gemini Robotics Policies in a Veo World Simulator11 Dec
  21. 2025RynnVLA-002: A Unified Vision-Language-Action and World Model21 Nov
  22. 2025Scalable Policy Evaluation with Video World Models14 Nov
  23. 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Models12 Nov
  24. 2025Robot Learning from a Physical World Model10 Nov
  25. 2025A Step Toward World Models: A Survey on Robotic Manipulation31 Oct
  26. 2025Dual-Stream Diffusion for World-Model Augmented Vision-Language-Action Model31 Oct
  27. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
  28. 2025VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulators1 Oct
  29. 2025World-Env: Leveraging World Model as a Virtual Environment for VLA Post-Training29 Sep
  30. 2025World4RL: Diffusion World Models for Policy Refinement with Reinforcement Learning for Robotic Manipulation23 Sep
  31. 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Models31 Jul
  32. 2025Geometry-aware 4D Video Generation for Robot Manipulation1 Jul
  33. 2025RoboScape: Physics-informed Embodied World Model29 Jun
  34. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  35. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
  36. 20253DFlowAction: Learning Cross-Embodiment Manipulation from 3D Flow World Model6 Jun
  37. 2025WorldGym: World Model as An Environment for Policy Evaluation31 May
  38. 2025WorldEval: World Model as Real-World Robot Policies Evaluator25 May

50 newest of 67 All 67 (JSON)

Other references · 270

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2023Segment Anythingcited by 8,234
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2017Neural Discrete Representation Learningcited by 4,712
  8. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  9. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  12. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
38 more
  1. 2022Video Diffusion Modelscited by 2,305
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  3. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  5. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  6. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  7. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  8. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  10. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  11. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  12. 2023Mastering Diverse Domains through World Modelscited by 1,253
  13. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  14. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  15. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
  16. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  17. 2020Mastering Atari with Discrete World Modelscited by 1,007
  18. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
  19. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  20. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
  21. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  22. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  23. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  24. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  25. 2022A Generalist Agentcited by 808
  26. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
  27. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  28. 2024Genie: Generative Interactive Environmentscited by 747
  29. 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 743
  30. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
  31. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  32. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  33. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  34. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  35. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
  36. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  37. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  38. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622

50 most cited of 270 All 270 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 50.

50 papers.

Sort:

By area:

  1. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  2. 2026Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imaginationcited by 18
  3. 2026WAM4D: Fast 4D World Action Model via Spatial Register Tokenscited by 15
  4. 2026Learning 4D Geometric Priors for Inference-Efficient World Action Modelscited by 15
  5. 2026RepWAM: World Action Modeling with Representation Visual-Action Tokenizerscited by 13
  6. 2026VT-WAM: Visual-Tactile World Action Model for Contact-Rich Manipulationcited by 11
  7. 2026LiLa-WAM: Lightweight Latent Reasoning World-Action Model for Robotic Manipulationcited by 9
  8. 2026SANTS: A State-Adaptive Scheduler for World Action Modelscited by 7
  9. 2026ETA: A New Agentic Paradigm for Embodied Taskscited by 7
  10. 2026ImagineUAV: Aerial Vision-Language Navigation via World-Action Modeling and Kinodynamic Planningcited by 6
  11. 2026Retrieve, Don't Retrain: Extending Vision Language Action Models to New Tasks at Test Timecited by 5
  12. 2026A Definition and Roadmap for World Modelscited by 5
38 more
  1. 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulationcited by 5
  2. 2026ContactWorld: What Representations Matter for Vision-Tactile Latent World Models in Contact-Rich Manipulationcited by 4
  3. 2026Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translationcited by 4
  4. 2026RISE: Adaptive Imagination for World Action Modelscited by 4
  5. 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulationcited by 4
  6. 2026ω-EVA: Envision, Verify, and Act with Latent Interactive World Modelscited by 3
  7. 2026In-Context World Modeling for Robotic Controlcited by 3
  8. 2026Steering Robustness into World Action Models via Mechanistic Interpretability and Optimal Controlcited by 3
  9. 2026Bridge-WA: Predicting Where and How the World Changes for Robotic Actioncited by 2
  10. 2026Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robotscited by 2
  11. 2026Selective Cross-View Consistency for World Action Models: Held-Out Viewpoint Robustness Without Test-Time Camera Informationcited by 2
  12. 20264DGS-WAM: Bridging Past and Future with an Object-Centric World Action Model based on 4D Gaussian Splattingcited by 2
  13. 2026Dreaming when Necessary: Advancing World Action Models with Adaptive Multi-Modal Reasoningcited by 1
  14. 2026Advancing Omnimodal Embodied Agents from Isolated Skills to Everyday Physical Autonomycited by 1
  15. 2026HALO-WA: Hybrid-Attention Latent-Guided Online Reinforcement Learning for World-Action Modelscited by 1
  16. 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligencecited by 1
  17. 2026PAVXploreRL: Physical-Action-Visual World Model Reinforcement Learning with Action Explorationcited by 1
  18. 2026PhyAI: Real-Time Physical AI at the Edge, Scalable Rollouts in the Cloudcited by 1
  19. 2026Think Only When Needed: Prompt-Authority Control for Selective Slow-Path Intervention in Vision-Language-Action Manipulationcited by 1
  20. 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modelingcited by 1
  21. 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
  22. 2026In-Context Learning for Robots: Methods and Applicationscited by 1
  23. 2026Emergent Semantic Representations in World Models through Physical Interaction without Linguistic Supervisioncited by 0
  24. 2026Breaking Structural Isolation: Scalable Graph Clustering via Community-Aware Sampling and Structural Entropycited by 0
  25. 2026LeapBot-WA: World-Anchor Action Models via Predictive Latent Alignmentscited by 0
  26. 2026PredVLA: Predictive Sensorimotor Modeling for Sub-Million-Parameter Robot Manipulationcited by 0
  27. 2026Editable Visual Designcited by 0
  28. 2026Valerant: An Automatic Navigable Game Map Generator via Action-Conditioned World Model Explorationcited by 0
  29. 2026What Matters in Designing World Action Models: An Empirical Studycited by 0
  30. 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinementcited by 0
  31. 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAMcited by 0
  32. 2026InternW0: A Foundational Physical World Model for Efficient Real-World Interactionscited by 0
  33. 2026NeuronDiscover: Agent-in-Twin for Mechanistic Discovery in Neuronal Microenvironments with World Action Modelscited by 0
  34. 2026World Action Modeling with Progressive Visual Planningcited by 0
  35. 2026OpenWAM: An Open Framework for Composable World-Action Modelscited by 0
  36. 2026WAM-Cache: Staleness-Bounded KV Reuse for Efficient World Action Modelscited by 0
  37. 2026Rewiring Semantics, Dynamics, and Control: A Simple yet Effective Action-Centric Tri-Stream Transformercited by 0
  38. 2026UniW(A)M: A Unified Mixture-of-Experts Framework for World and World-Action Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026World-Action Models for Robot Learning and Control: A Survey
  2. 2026World Action Models: A Survey
  3. 2026World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis
  4. 2026HarnessWAM: Bridging Prediction and Deliberation in World Action Models
  5. 2026World Model for Robot Learning: A Comprehensive Survey
  6. 2026World Tokens: Enhancing Embodied Policies with Training-Time World Modeling
  7. 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence
  8. 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining