World Models for Robotic Manipulation: A Survey
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Robotic manipulation depends on the ability to anticipate how actions reshape objects, contacts, and scene geometry before execution. Learned world models provide this capability by predicting task-relevant future evolution under robot intervention, yet the term now spans latent dynamics models, action-conditioned video generators, three- and four-dimensional scene predictors, physics-informed simulators, and predictive modules inside vision-language-action systems. This breadth has fragmented the literature and obscured the design choices that matter for manipulation. We survey world models for robotic manipulation through three questions: what future representation is predicted, how prediction is connected to action, and when prediction is used in the robot-learning pipeline. We operationally define a world model as an action-conditioned predictive system and distinguish it from perception modules, inverse models, policies, rewards, and value functions. We then organize existing work into five representation families, develop a functional taxonomy that separates integrated prediction-action models from explicit predictive planners, and characterize infrastructure roles including synthetic experience generation, candidate filtering, search-based evaluation, learned environments, and outcome verification. We further map these roles across pretraining, post-training, and inference adaptation, review 34 manipulation datasets, and synthesize evaluation protocols for predictive fidelity, task performance, and simulator reliability. This survey shows that world models are evolving from task-specific dynamics predictors into predictive infrastructure for robot learning, while exposing open challenges in contact modeling, hallucination control, action alignment, and benchmarking under closed-loop use.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 5 of its 14 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
5 of 14 references.
Closest ancestors · 3
Same direction, newest first
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
- 2025Inference-Time Enhancement of Generative Robot Policies via Predictive World Modeling2 Feb
- 2024FLIP: Flow-Centric Generative Planning as General-Purpose Manipulation World Model11 Dec
Other references · 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Don't Drop the BATON: Long-Horizon Robot Manipulation via Agentic Subtask Exploration and Transition-aware Memorycited by 4
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026Don't Drop the BATON: Long-Horizon Robot Manipulation via Agentic Subtask Exploration and Transition-aware Memory17 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025A Step Toward World Models: A Survey on Robotic Manipulation
- 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
- 2026Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation
- 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
- 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation
- 2026World-Action Models for Robot Learning and Control: A Survey
- 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation
- 2026Direct Experience World-Model Optimization: Learning the World Beyond Action Imitation