mlsanityData to 14 Oct 2026

World-Action Models for Robot Learning and Control: A Survey

arXiv 2609.16074 ↗First posted 13 Sep 2026cs.RO cs.CVcited by 6

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

Robots operating in open environments act under partial observability, physical constraints, and dynamic task contexts. Beyond mapping observations and language instructions to actions, they must anticipate how candidate actions may affect future states and task-relevant outcomes. Recent advances in world models, video generation, and Vision-Language-Action (VLA) policies have motivated the development of World-Action Models (WAMs), which couple future world prediction with executable action generation. This survey provides a robotics-oriented review of WAMs. We clarify their scope relative to conventional world models, model-based reinforcement learning, action-conditioned video generation, and reactive VLA policies, and organize existing methods through a unified taxonomy covering representations, transition modeling, action interfaces, architectures, training pipelines, data modalities, and scaling strategies. We further review applications of WAMs in manipulation, navigation, and autonomous driving, and we summarize the datasets, benchmarks, metrics, and protocols used to evaluate WAM systems. Finally, we discuss key challenges in action alignment, world-action factorization, spatial and multi-view consistency, long-horizon memory, neural simulation for closed-loop policy learning, and efficient inference. Taken together, this survey aims to provide a concise technical foundation for integrating predictive world modeling with action generation, toward more reliable embodied robot intelligence. Project page: https://rcl-robotics.github.io/Awesome-World-Action-Models.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 237 of its 259 references that are in the map. First posted on arXiv 13 Sep 2026.

Builds on

237 of 259 references.

Closest ancestors · 57

Same direction, newest first

  1. 2026Motus2: A Self-Evolving General World Model for Dexterous Manipulation31 Aug
  2. 20264DGS-WAM: Bridging Past and Future with an Object-Centric World Action Model based on 4D Gaussian Splatting26 Aug
  3. 2026WAM-OPD: On-Policy Distillation for World Action Models23 Aug
  4. 2026HiTac-WAM: A Hierarchical Tactile World Action Model for Contact-Rich Robot Manipulation20 Aug
  5. 2026JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modeling10 Aug
  6. 20264D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fields8 Aug
  7. 2026Selective Cross-View Consistency for World Action Models: Held-Out Viewpoint Robustness Without Test-Time Camera Information7 Aug
  8. 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution31 Jul
  9. 2026MV-WAM: Manifold-Aware World Action Model with Value Augmentation19 Jun
  10. 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun
  11. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies14 Jun
  12. 2026MemoryVAM: Integrating Memory into Video Action Model for Robot Manipulation13 Jun
38 more
  1. 2026FAWAM: Force-Aware World Action Models for Closed-Loop Contact-Rich Manipulation7 Jun
  2. 2026SANTS: A State-Adaptive Scheduler for World Action Models27 May
  3. 2026Action Images: End-to-End Policy Learning via Multiview Video Generation7 Apr
  4. 2026Persistent Robot World Models: Stabilizing Multi-Step Rollouts via Reinforcement Learning26 Mar
  5. 2026Do World Action Models Generalize Better than VLAs? A Robustness Study23 Mar
  6. 2026Towards Practical World Model-based Reinforcement Learning for Vision-Language-Action Models21 Mar
  7. 2026EVA: Aligning Video World Models with Executable Robot Actions via Inverse Dynamics Rewards18 Mar
  8. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
  9. 2026DreamPlan: Efficient Reinforcement Fine-Tuning of Vision-Language Planners via Video World Models17 Mar
  10. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  11. 2026World2Act: Latent Action Post-Training from World Model Dynamics11 Mar
  12. 2026Interactive World Simulator for Robot Policy Training and Evaluation9 Mar
  13. 2026Hierarchical Latent Action Model6 Mar
  14. 2026Learning to unfold cloth: Scaling up world models to deformable object manipulation18 Feb
  15. 2026World Action Models are Zero-shot Policies17 Feb
  16. 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL15 Feb
  17. 2026RISE: Self-Improving Robot Policy with Compositional World Model11 Feb
  18. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
  19. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
  20. 2026World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policy6 Feb
  21. 2026Causal World Modeling for Robot Control29 Jan
  22. 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation7 Jan
  23. 2025Act2Goal: From World Model To General Goal-conditioned Policy29 Dec
  24. 2025Motus: A Unified Latent Action World Model15 Dec
  25. 2025Learning Robot Manipulation from Audio World Models9 Dec
  26. 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignment7 Dec
  27. 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AI25 Nov
  28. 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Models12 Nov
  29. 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Model22 Oct
  30. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
  31. 2025World4RL: Diffusion World Models for Policy Refinement with Reinforcement Learning for Robotic Manipulation23 Sep
  32. 2025Latent Action Pretraining Through World Modeling22 Sep
  33. 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulation25 Aug
  34. 2025ParticleFormer: A 3D Point Cloud World Model for Multi-Object, Multi-Material Robotic Manipulation29 Jun
  35. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  36. 2025ManiGaussian++: General Robotic Bimanual Manipulation with Hierarchical Gaussian World Model24 Jun
  37. 2025WorldGym: World Model as An Environment for Policy Evaluation31 May
  38. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May

50 newest of 57 All 57 (JSON)

Other references · 180

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  9. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  10. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  11. 2017Neural Discrete Representation Learningcited by 4,712
  12. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
38 more
  1. 2017Deep reinforcement learning from human preferencescited by 3,912
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  3. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2020Learning to summarize from human feedbackcited by 2,588
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  9. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  10. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  11. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  13. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  14. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  15. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  16. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  17. 2017The Kinetics Human Action Video Datasetcited by 1,909
  18. 2025Gemma 3 Technical Reportcited by 1,824
  19. 2023Consistency Modelscited by 1,822
  20. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  21. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  22. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  23. 2018World Modelscited by 1,513
  24. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  25. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  26. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  27. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  28. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  29. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  30. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  31. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  32. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  33. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  34. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
  35. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  36. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  37. 2020Mastering Atari with Discrete World Modelscited by 1,007
  38. 2018DeepMind Control Suitecited by 956

50 most cited of 180 All 180 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026World Action Models: The Next Frontier in Embodied AI
  2. 2026World Model for Robot Learning: A Comprehensive Survey
  3. 2026World Models for Robotic Manipulation: A Survey
  4. 2026Beyond Task Success: Behavioral and Representational Diagnostics for WAM and VLA
  5. 2026What Matters in Designing World Action Models: An Empirical Study
  6. 2026Motubrain: An Advanced World Action Model for Robot Control
  7. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
  8. 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models