World-Action Models for Robot Learning and Control: A Survey
On the map: World models → Embodied and robot world models
also in 1 more
Abstract (arXiv)
Robots operating in open environments act under partial observability, physical constraints, and dynamic task contexts. Beyond mapping observations and language instructions to actions, they must anticipate how candidate actions may affect future states and task-relevant outcomes. Recent advances in world models, video generation, and Vision-Language-Action (VLA) policies have motivated the development of World-Action Models (WAMs), which couple future world prediction with executable action generation. This survey provides a robotics-oriented review of WAMs. We clarify their scope relative to conventional world models, model-based reinforcement learning, action-conditioned video generation, and reactive VLA policies, and organize existing methods through a unified taxonomy covering representations, transition modeling, action interfaces, architectures, training pipelines, data modalities, and scaling strategies. We further review applications of WAMs in manipulation, navigation, and autonomous driving, and we summarize the datasets, benchmarks, metrics, and protocols used to evaluate WAM systems. Finally, we discuss key challenges in action alignment, world-action factorization, spatial and multi-view consistency, long-horizon memory, neural simulation for closed-loop policy learning, and efficient inference. Taken together, this survey aims to provide a concise technical foundation for integrating predictive world modeling with action generation, toward more reliable embodied robot intelligence. Project page: https://rcl-robotics.github.io/Awesome-World-Action-Models.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 237 of its 259 references that are in the map. First posted on arXiv 13 Sep 2026.
Builds on
237 of 259 references.
Closest ancestors · 57
Same direction, newest first
- 2026Motus2: A Self-Evolving General World Model for Dexterous Manipulation31 Aug
- 20264DGS-WAM: Bridging Past and Future with an Object-Centric World Action Model based on 4D Gaussian Splatting26 Aug
- 2026WAM-OPD: On-Policy Distillation for World Action Models23 Aug
- 2026HiTac-WAM: A Hierarchical Tactile World Action Model for Contact-Rich Robot Manipulation20 Aug
- 2026JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modeling10 Aug
- 20264D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fields8 Aug
- 2026Selective Cross-View Consistency for World Action Models: Held-Out Viewpoint Robustness Without Test-Time Camera Information7 Aug
- 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution31 Jul
- 2026MV-WAM: Manifold-Aware World Action Model with Value Augmentation19 Jun
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun
- 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies14 Jun
- 2026MemoryVAM: Integrating Memory into Video Action Model for Robot Manipulation13 Jun
38 more
- 2026FAWAM: Force-Aware World Action Models for Closed-Loop Contact-Rich Manipulation7 Jun
- 2026SANTS: A State-Adaptive Scheduler for World Action Models27 May
- 2026Action Images: End-to-End Policy Learning via Multiview Video Generation7 Apr
- 2026Persistent Robot World Models: Stabilizing Multi-Step Rollouts via Reinforcement Learning26 Mar
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Study23 Mar
- 2026Towards Practical World Model-based Reinforcement Learning for Vision-Language-Action Models21 Mar
- 2026EVA: Aligning Video World Models with Executable Robot Actions via Inverse Dynamics Rewards18 Mar
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
- 2026DreamPlan: Efficient Reinforcement Fine-Tuning of Vision-Language Planners via Video World Models17 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World2Act: Latent Action Post-Training from World Model Dynamics11 Mar
- 2026Interactive World Simulator for Robot Policy Training and Evaluation9 Mar
- 2026Hierarchical Latent Action Model6 Mar
- 2026Learning to unfold cloth: Scaling up world models to deformable object manipulation18 Feb
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL15 Feb
- 2026RISE: Self-Improving Robot Policy with Compositional World Model11 Feb
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
- 2026World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policy6 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation7 Jan
- 2025Act2Goal: From World Model To General Goal-conditioned Policy29 Dec
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025Learning Robot Manipulation from Audio World Models9 Dec
- 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignment7 Dec
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AI25 Nov
- 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Models12 Nov
- 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Model22 Oct
- 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
- 2025World4RL: Diffusion World Models for Policy Refinement with Reinforcement Learning for Robotic Manipulation23 Sep
- 2025Latent Action Pretraining Through World Modeling22 Sep
- 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulation25 Aug
- 2025ParticleFormer: A 3D Point Cloud World Model for Multi-Object, Multi-Material Robotic Manipulation29 Jun
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
- 2025ManiGaussian++: General Robotic Bimanual Manipulation with Hierarchical Gaussian World Model24 Jun
- 2025WorldGym: World Model as An Environment for Policy Evaluation31 May
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
50 newest of 57 All 57 (JSON)
Other references · 180
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017Neural Discrete Representation Learningcited by 4,712
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
38 more
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2020Learning to summarize from human feedbackcited by 2,588
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2025Gemma 3 Technical Reportcited by 1,824
- 2023Consistency Modelscited by 1,822
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2018World Modelscited by 1,513
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2018DeepMind Control Suitecited by 956
50 most cited of 180 All 180 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026In-Context Learning for Robots: Methods and Applicationscited by 1
- 2026HappyWorld-Benchcited by 0
- 2026OpenWAM: An Open Framework for Composable World-Action Modelscited by 0
- 2026SmolWAM: A Latent World-Action Model for Robotic Manipulation on Edge Devicescited by 0
- 2026D-World: An Explicit World-Language-Action Model with Recursive Self-Improvement under Dual Controlcited by 0
- 2026UniW(A)M: A Unified Mixture-of-Experts Framework for World and World-Action Modelscited by 0
- 2026UniW(A)M: A Unified Mixture-of-Experts Framework for World and World-Action Models13 Oct 2026
- 2026D-World: An Explicit World-Language-Action Model with Recursive Self-Improvement under Dual Control12 Oct 2026
- 2026SmolWAM: A Latent World-Action Model for Robotic Manipulation on Edge Devices9 Oct 2026
- 2026OpenWAM: An Open Framework for Composable World-Action Models6 Oct 2026
- 2026In-Context Learning for Robots: Methods and Applications28 Sep 2026
- 2026HappyWorld-Bench21 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026World Action Models: The Next Frontier in Embodied AI
- 2026World Model for Robot Learning: A Comprehensive Survey
- 2026World Models for Robotic Manipulation: A Survey
- 2026Beyond Task Success: Behavioral and Representational Diagnostics for WAM and VLA
- 2026What Matters in Designing World Action Models: An Empirical Study
- 2026Motubrain: An Advanced World Action Model for Robot Control
- 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models