A Step Toward World Models: A Survey on Robotic Manipulation
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Autonomous agents are increasingly expected to operate in complex, dynamic, and uncertain environments, performing tasks such as manipulation, navigation, and decision-making. Achieving these capabilities requires agents to understand the underlying mechanisms and dynamics of the world, moving beyond reactive control or simple replication of observed states. This motivates the development of world models as internal representations that encode environmental states, capture dynamics, and support prediction, planning, and reasoning. Despite growing interest, the definition, scope, architectures, and essential capabilities of world models remain ambiguous. In this survey, we go beyond prescribing a fixed definition and limiting our scope to methods explicitly labeled as world models. Instead, we examine approaches that exhibit the core capabilities of world models through a review of methods in robotic manipulation. We analyze their roles across perception, prediction, and control, identify key challenges and solutions, and distill the core components, capabilities, and functions that a fully realized world model should possess. Building on this analysis, we aim to motivate further development toward generalizable and practical world models for robotics.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 176 of its 209 references that are in the map. First posted on arXiv 31 Oct 2025.
Builds on
176 of 209 references.
Closest ancestors · 26
Same direction, newest first
- 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Model22 Oct
- 2025World-Env: Leveraging World Model as a Virtual Environment for VLA Post-Training29 Sep
- 2025Planning with Reasoning using Vision Language World Model2 Sep
- 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulation25 Aug
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
- 20253DFlowAction: Learning Cross-Embodiment Manipulation from 3D Flow World Model6 Jun
- 2025WorldEval: World Model as Real-World Robot Policies Evaluator25 May
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
- 2025FlowDreamer: A RGB-D World Model with Flow-based Motion Representations for Robot Manipulation15 May
- 2025TesserAct: Learning 4D Embodied World Models29 Apr
- 2025ManipDreamer: Boosting Robotic Manipulation World Model with Action Tree and Visual Guidance23 Apr
14 more
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
- 2025Aether: Geometric-Aware Unified World Modeling24 Mar
- 2025AdaWorld: Learning Adaptable World Models with Latent Actions24 Mar
- 2025EgoAgent: A Joint Predictive Agent Model in Egocentric Worlds9 Feb
- 2025RoboHorizon: An LLM-Assisted Multi-View World Model for Long-Horizon Robotic Manipulation11 Jan
- 2025EnerVerse: Envisioning Embodied Future Space for Robotics Manipulation3 Jan
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
- 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imagination19 Dec
- 2024FLIP: Flow-Centric Generative Planning as General-Purpose Manipulation World Model11 Dec
- 2024GenRL: Multimodal-foundation world models for generalization in embodied agents26 Jun
- 2024iVideoGPT: Interactive VideoGPTs are Scalable World Models24 May
- 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr
- 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models16 Oct
Other references · 150
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2013Intriguing properties of neural networkscited by 5,155
- 2024GPT-4o System Cardcited by 4,588
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
38 more
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022Video Diffusion Modelscited by 2,305
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2018World Modelscited by 1,513
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 815
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
- 2024Genie: Generative Interactive Environmentscited by 747
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 743
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
50 most cited of 150 All 150 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 14.
15 papers.
Sort:
By area:
- 2026World Action Models: The Next Frontier in Embodied AIcited by 50
- 2026World Model for Robot Learning: A Comprehensive Surveycited by 46
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
- 2026RoboAlign-R1: Distilled Multimodal Reward Alignment for Robot Video World Modelscited by 8
- 2026Point Tracking Improves World Action Modelscited by 7
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applicationscited by 3
- 2026MagicAgent: Towards Generalized Agent Planningcited by 2
- 2026DVG-WM: Disentangled Video Generation Enables Efficient Embodied World Model for Robotic Manipulationcited by 2
- 2026PVI: Plug-in Visual Injection for Vision-Language-Action Modelscited by 1
- 2026MANGO: Automated Multi-Agent Test Oracle Generation for Vision-Language-Action Modelscited by 1
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstructioncited by 1
- 2026Self-Evolving AI for Humanoids: Mechanisms, Safety, and Evaluation of Post-Deployment Self-Improvementcited by 1
3 more
- 2025BiTAgent: A Task-Aware Modular Framework for Bidirectional Coupling between Multimodal Large Language Models and World Modelscited by 0
- 2026Hierarchical Refinement of Universal Multimodal Attacks on Vision-Language Modelscited by 0
- 2026WMLLM: Self-Evolving Optimization Agents via Predict-Then-Act World Modelingcited by 0
- 2026Self-Evolving AI for Humanoids: Mechanisms, Safety, and Evaluation of Post-Deployment Self-Improvement2 Sep 2026
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstruction28 Aug 2026
- 2026DVG-WM: Disentangled Video Generation Enables Efficient Embodied World Model for Robotic Manipulation30 Jun 2026
- 2026MANGO: Automated Multi-Agent Test Oracle Generation for Vision-Language-Action Models23 Jun 2026
- 2026WMLLM: Self-Evolving Optimization Agents via Predict-Then-Act World Modeling2 Jun 2026
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications28 May 2026
- 2026Point Tracking Improves World Action Models22 May 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026RoboAlign-R1: Distilled Multimodal Reward Alignment for Robot Video World Models5 May 2026
- 2026World Model for Robot Learning: A Comprehensive Survey30 Apr 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2026PVI: Plug-in Visual Injection for Vision-Language-Action Models13 Mar 2026
3 more
- 2026World Action Models: The Next Frontier in Embodied AIcited by 50
- 2026World Model for Robot Learning: A Comprehensive Surveycited by 46
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
- 2026RoboAlign-R1: Distilled Multimodal Reward Alignment for Robot Video World Modelscited by 8
- 2026Point Tracking Improves World Action Modelscited by 7
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applicationscited by 3
- 2026DVG-WM: Disentangled Video Generation Enables Efficient Embodied World Model for Robotic Manipulationcited by 2
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstructioncited by 1
- 2026Self-Evolving AI for Humanoids: Mechanisms, Safety, and Evaluation of Post-Deployment Self-Improvementcited by 1
- 2025BiTAgent: A Task-Aware Modular Framework for Bidirectional Coupling between Multimodal Large Language Models and World Modelscited by 0
- 2026WMLLM: Self-Evolving Optimization Agents via Predict-Then-Act World Modelingcited by 0
- 2026Self-Evolving AI for Humanoids: Mechanisms, Safety, and Evaluation of Post-Deployment Self-Improvement2 Sep 2026
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstruction28 Aug 2026
- 2026DVG-WM: Disentangled Video Generation Enables Efficient Embodied World Model for Robotic Manipulation30 Jun 2026
- 2026WMLLM: Self-Evolving Optimization Agents via Predict-Then-Act World Modeling2 Jun 2026
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications28 May 2026
- 2026Point Tracking Improves World Action Models22 May 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026RoboAlign-R1: Distilled Multimodal Reward Alignment for Robot Video World Models5 May 2026
- 2026World Model for Robot Learning: A Comprehensive Survey30 Apr 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2025BiTAgent: A Task-Aware Modular Framework for Bidirectional Coupling between Multimodal Large Language Models and World Models4 Dec 2025
- 2026MagicAgent: Towards Generalized Agent Planningcited by 2
- 2026MagicAgent: Towards Generalized Agent Planning22 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026World Models for Robotic Manipulation: A Survey
- 2026From World Models to World Action Models: A Concise Tutorial for Robotics
- 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
- 2026World-Action Models for Robot Learning and Control: A Survey
- 2026Unifying Object-Centric World Models and Diffusion Policy: A Hierarchical Framework for Multi-Stage Robotic Tasks
- 2026Motus2: A Self-Evolving General World Model for Dexterous Manipulation
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence
- 2026What Matters in Designing World Action Models: An Empirical Study