mlsanityData to 14 Oct 2026

A Step Toward World Models: A Survey on Robotic Manipulation

arXiv 2511.02097 ↗First posted 31 Oct 2025cs.RO cs.CVcited by 15

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Autonomous agents are increasingly expected to operate in complex, dynamic, and uncertain environments, performing tasks such as manipulation, navigation, and decision-making. Achieving these capabilities requires agents to understand the underlying mechanisms and dynamics of the world, moving beyond reactive control or simple replication of observed states. This motivates the development of world models as internal representations that encode environmental states, capture dynamics, and support prediction, planning, and reasoning. Despite growing interest, the definition, scope, architectures, and essential capabilities of world models remain ambiguous. In this survey, we go beyond prescribing a fixed definition and limiting our scope to methods explicitly labeled as world models. Instead, we examine approaches that exhibit the core capabilities of world models through a review of methods in robotic manipulation. We analyze their roles across perception, prediction, and control, identify key challenges and solutions, and distill the core components, capabilities, and functions that a fully realized world model should possess. Building on this analysis, we aim to motivate further development toward generalizable and practical world models for robotics.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 176 of its 209 references that are in the map. First posted on arXiv 31 Oct 2025.

Builds on

176 of 209 references.

Closest ancestors · 26

Same direction, newest first

  1. 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Model22 Oct
  2. 2025World-Env: Leveraging World Model as a Virtual Environment for VLA Post-Training29 Sep
  3. 2025Planning with Reasoning using Vision Language World Model2 Sep
  4. 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulation25 Aug
  5. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  6. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
  7. 20253DFlowAction: Learning Cross-Embodiment Manipulation from 3D Flow World Model6 Jun
  8. 2025WorldEval: World Model as Real-World Robot Policies Evaluator25 May
  9. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
  10. 2025FlowDreamer: A RGB-D World Model with Flow-based Motion Representations for Robot Manipulation15 May
  11. 2025TesserAct: Learning 4D Embodied World Models29 Apr
  12. 2025ManipDreamer: Boosting Robotic Manipulation World Model with Action Tree and Visual Guidance23 Apr
14 more
  1. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
  2. 2025Aether: Geometric-Aware Unified World Modeling24 Mar
  3. 2025AdaWorld: Learning Adaptable World Models with Latent Actions24 Mar
  4. 2025EgoAgent: A Joint Predictive Agent Model in Egocentric Worlds9 Feb
  5. 2025RoboHorizon: An LLM-Assisted Multi-View World Model for Long-Horizon Robotic Manipulation11 Jan
  6. 2025EnerVerse: Envisioning Embodied Future Space for Robotics Manipulation3 Jan
  7. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
  8. 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imagination19 Dec
  9. 2024FLIP: Flow-Centric Generative Planning as General-Purpose Manipulation World Model11 Dec
  10. 2024GenRL: Multimodal-foundation world models for generalization in embodied agents26 Jun
  11. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Models24 May
  12. 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr
  13. 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar
  14. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models16 Oct

Other references · 150

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2023Segment Anythingcited by 8,234
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  8. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  9. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  10. 2013Intriguing properties of neural networkscited by 5,155
  11. 2024GPT-4o System Cardcited by 4,588
  12. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
38 more
  1. 2013Auto-Encoding Variational Bayescited by 4,053
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  7. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  8. 2022Video Diffusion Modelscited by 2,305
  9. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  10. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  11. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  12. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  13. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  14. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  15. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  16. 2018World Modelscited by 1,513
  17. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  18. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  19. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  20. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
  21. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  22. 2023Mastering Diverse Domains through World Modelscited by 1,253
  23. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  24. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
  25. 2020Mastering Atari with Discrete World Modelscited by 1,007
  26. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
  27. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  28. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  29. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  30. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  31. 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 815
  32. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
  33. 2024Genie: Generative Interactive Environmentscited by 747
  34. 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 743
  35. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  36. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  37. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  38. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652

50 most cited of 150 All 150 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 14.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026World Models for Robotic Manipulation: A Survey
  2. 2026From World Models to World Action Models: A Concise Tutorial for Robotics
  3. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
  4. 2026World-Action Models for Robot Learning and Control: A Survey
  5. 2026Unifying Object-Centric World Models and Diffusion Policy: A Hierarchical Framework for Multi-Stage Robotic Tasks
  6. 2026Motus2: A Self-Evolving General World Model for Dexterous Manipulation
  7. 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence
  8. 2026What Matters in Designing World Action Models: An Empirical Study