mlsanityData to 7 Oct 2026

World Model for Robot Learning: A Comprehensive Survey

arXiv 2605.00080 ↗First posted 30 Apr 2026cs.RO cs.CVcited by 42

On the map: World models → World models for navigation

Abstract (arXiv)

World models, which are predictive representations of how environments evolve under actions, have become a central component of robot learning. They support policy learning, planning, simulation, evaluation, data generation, and have advanced rapidly with the rise of foundation models and large-scale video generation. However, the literature remains fragmented across architectures, functional roles, and embodied application domains. To address this gap, we present a comprehensive review of world models from a robot-learning perspective. We examine how world models are coupled with robot policies, how they serve as learned simulators for reinforcement learning and evaluation, and how robotic video world models have progressed from imagination-based generation to controllable, structured, and foundation-scale formulations. We further connect these ideas to navigation and autonomous driving, and summarize representative datasets, benchmarks, and evaluation protocols. Overall, this survey systematically reviews the rapidly growing literature on world models for robot learning, clarifies key paradigms and applications, and highlights major challenges and future directions for predictive modeling in embodied agents. To facilitate continued access to newly emerging works, benchmarks, and resources, we will maintain and regularly update the accompanying GitHub repository alongside this survey.

Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 184 of its 210 references that are in the map. First posted on arXiv 30 Apr 2026.

Builds on

184 of 210 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Models9 Feb
  2. 2025WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigation4 Mar
  3. 2024Navigation World Models4 Dec
  4. 2021Pathdreamer: A World Model for Indoor Navigation18 May

Other references · 180

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  6. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  7. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  9. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  11. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  12. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
38 more
  1. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  2. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  3. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  4. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  5. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  6. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  7. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
  8. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  9. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  10. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  11. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  12. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  13. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  14. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  15. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
  16. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  17. 2018An Algorithmic Perspective on Imitation Learningcited by 455
  18. 2023Learning Interactive Real-World Simulatorscited by 440
  19. 2026World Action Models are Zero-shot Policiescited by 411
  20. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  21. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  22. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  23. 2022Temporal Difference Learning for Model Predictive Controlcited by 375
  24. 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
  25. 2022DayDreamer: World Models for Physical Robot Learningcited by 372
  26. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  27. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
  28. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
  29. 2026Causal World Modeling for Robot Controlcited by 289
  30. 2025π*0.6: a VLA That Learns From Experiencecited by 280
  31. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
  32. 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 277
  33. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  34. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
  35. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 237
  36. 2025Motus: A Unified Latent Action World Modelcited by 231
  37. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
  38. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 218

50 most cited of 180 All 180 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 42.

42 papers.

Sort:

By area:

  1. 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
  2. 2026Flash-WAM: Modality-Aware Distillation for World Action Modelscited by 16
  3. 2026Fast LeWorldModelcited by 12
  4. 2026World Action Models: A Surveycited by 10
  5. 2026Feedback World Model Enables Precise Guidance of Diffusion Policycited by 9
  6. 2026FAWAM: Force-Aware World Action Models for Closed-Loop Contact-Rich Manipulationcited by 7
  7. 2026StatePlay: State-Aware Game World Models for Mechanics-Consistent Generationcited by 5
  8. 2026Is Forward Prediction Enough? Physical State Grounding for JEPA World Modelscited by 5
  9. 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
  10. 2026FlowDAgger: Human-in-the-Loop Adaptation of Generative Robot Policies in Latent Spacecited by 3
  11. 2026Steering Robustness into World Action Models via Mechanistic Interpretability and Optimal Controlcited by 3
  12. 2026Unifying Object-Centric World Models and Diffusion Policy: A Hierarchical Framework for Multi-Stage Robotic Taskscited by 2
30 more
  1. 2026ω-EVA: Envision, Verify, and Act with Latent Interactive World Modelscited by 2
  2. 2026DREAM-Chunk: Reactive Action Chunking with Latent World Modelcited by 2
  3. 2026MemoryVAM: Integrating Memory into Video Action Model for Robot Manipulationcited by 2
  4. 2026Robot Self-Improvement via Human-Video Dynamics Modelscited by 2
  5. 2026InSight: Self-Guided Skill Acquisition via Steerable VLAscited by 2
  6. 2026Bridge-WA: Predicting Where and How the World Changes for Robotic Actioncited by 2
  7. 2026Mask2Real-WM: Segmentation Masks as a Sim-to-Real Bridge for Controllable Dexterous World Modelscited by 2
  8. 2026DriftWorld: Fast World Modeling through Driftingcited by 2
  9. 2026BWM: A Low-Cost High-Fidelity World Simulator for Robot Learningcited by 2
  10. 2026CLAW: Learning Continuous Latent Action World Models via Adversarial Latent Regularizationcited by 1
  11. 2026GIVE: Grounding Human Gestures in Vision-Language-Action Modelscited by 1
  12. 2026HALO-WA: Hybrid-Attention Latent-Guided Online Reinforcement Learning for World-Action Modelscited by 1
  13. 2026Learning to Act While Waiting: RL Finetuning of Generalist Robot Policies Under Inference Latencycited by 1
  14. 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
  15. 2026Twincher: Bijective Representation Learning for Robust Inversion of Continuous Systemscited by 0
  16. 2026World-Task Factorization for Robot Learningcited by 0
  17. 2026Towards a Data Flywheel for Embodied Intelligence in Logisticscited by 0
  18. 2026Beyond One-Size-Fits-All: Diagnosis-Driven Online Reinforcement Learning with Offline Priorscited by 0
  19. 2026FuncBridge: Towards Functional Tool-Use Generalization via Keypoint Trajectory Reasoningcited by 0
  20. 2026SUV: Future Scene Understanding as Video Generation for End-to-End Drivingcited by 0
  21. 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
  22. 2026WISE: World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Modelscited by 0
  23. 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Modelscited by 0
  24. 2026DUET-DINO: Simultaneous Cross-View World Modeling for Latent Planning in Robot Manipulationcited by 0
  25. 2026Finishing the Task Is Not Enough: Evaluating Agent Resilience and Considerate Participation under Accumulating Challengecited by 0
  26. 2026Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimizationcited by 0
  27. 2026What Matters in Designing World Action Models: An Empirical Studycited by 0
  28. 2026Skytopia: Monocular Drone Navigation with Action-Conditioned Latent World Modelscited by 0
  29. 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligencecited by 0
  30. 2026Direct Experience World-Model Optimization: Learning the World Beyond Action Imitationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026World-Action Models for Robot Learning and Control: A Survey
  2. 2026World Action Models: The Next Frontier in Embodied AI
  3. 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications
  4. 2026World Models for Robotic Manipulation: A Survey
  5. 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
  6. 2025A Comprehensive Survey on World Models for Embodied AI
  7. 2026Robotic Video World Models: A Survey of Applications, Research Challenges, Future Directions
  8. 2025Robot Learning: A Tutorial