World Model for Robot Learning: A Comprehensive Survey
On the map: World models → World models for navigation
Abstract (arXiv)
World models, which are predictive representations of how environments evolve under actions, have become a central component of robot learning. They support policy learning, planning, simulation, evaluation, data generation, and have advanced rapidly with the rise of foundation models and large-scale video generation. However, the literature remains fragmented across architectures, functional roles, and embodied application domains. To address this gap, we present a comprehensive review of world models from a robot-learning perspective. We examine how world models are coupled with robot policies, how they serve as learned simulators for reinforcement learning and evaluation, and how robotic video world models have progressed from imagination-based generation to controllable, structured, and foundation-scale formulations. We further connect these ideas to navigation and autonomous driving, and summarize representative datasets, benchmarks, and evaluation protocols. Overall, this survey systematically reviews the rapidly growing literature on world models for robot learning, clarifies key paradigms and applications, and highlights major challenges and future directions for predictive modeling in embodied agents. To facilitate continued access to newly emerging works, benchmarks, and resources, we will maintain and regularly update the accompanying GitHub repository alongside this survey.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 184 of its 210 references that are in the map. First posted on arXiv 30 Apr 2026.
Builds on
184 of 210 references.
Closest ancestors · 4
Same direction, newest first
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Models9 Feb
- 2025WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigation4 Mar
- 2024Navigation World Models4 Dec
- 2021Pathdreamer: A World Model for Indoor Navigation18 May
Other references · 180
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
38 more
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2018An Algorithmic Perspective on Imitation Learningcited by 455
- 2023Learning Interactive Real-World Simulatorscited by 440
- 2026World Action Models are Zero-shot Policiescited by 411
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2022Temporal Difference Learning for Model Predictive Controlcited by 375
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
- 2022DayDreamer: World Models for Physical Robot Learningcited by 372
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
- 2026Causal World Modeling for Robot Controlcited by 289
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 277
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 237
- 2025Motus: A Unified Latent Action World Modelcited by 231
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 218
50 most cited of 180 All 180 (JSON)
Built on by
Citing papers per year: 2026: 42.
42 papers.
Sort:
By area:
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026Flash-WAM: Modality-Aware Distillation for World Action Modelscited by 16
- 2026Fast LeWorldModelcited by 12
- 2026World Action Models: A Surveycited by 10
- 2026Feedback World Model Enables Precise Guidance of Diffusion Policycited by 9
- 2026FAWAM: Force-Aware World Action Models for Closed-Loop Contact-Rich Manipulationcited by 7
- 2026StatePlay: State-Aware Game World Models for Mechanics-Consistent Generationcited by 5
- 2026Is Forward Prediction Enough? Physical State Grounding for JEPA World Modelscited by 5
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026FlowDAgger: Human-in-the-Loop Adaptation of Generative Robot Policies in Latent Spacecited by 3
- 2026Steering Robustness into World Action Models via Mechanistic Interpretability and Optimal Controlcited by 3
- 2026Unifying Object-Centric World Models and Diffusion Policy: A Hierarchical Framework for Multi-Stage Robotic Taskscited by 2
30 more
- 2026ω-EVA: Envision, Verify, and Act with Latent Interactive World Modelscited by 2
- 2026DREAM-Chunk: Reactive Action Chunking with Latent World Modelcited by 2
- 2026MemoryVAM: Integrating Memory into Video Action Model for Robot Manipulationcited by 2
- 2026Robot Self-Improvement via Human-Video Dynamics Modelscited by 2
- 2026InSight: Self-Guided Skill Acquisition via Steerable VLAscited by 2
- 2026Bridge-WA: Predicting Where and How the World Changes for Robotic Actioncited by 2
- 2026Mask2Real-WM: Segmentation Masks as a Sim-to-Real Bridge for Controllable Dexterous World Modelscited by 2
- 2026DriftWorld: Fast World Modeling through Driftingcited by 2
- 2026BWM: A Low-Cost High-Fidelity World Simulator for Robot Learningcited by 2
- 2026CLAW: Learning Continuous Latent Action World Models via Adversarial Latent Regularizationcited by 1
- 2026GIVE: Grounding Human Gestures in Vision-Language-Action Modelscited by 1
- 2026HALO-WA: Hybrid-Attention Latent-Guided Online Reinforcement Learning for World-Action Modelscited by 1
- 2026Learning to Act While Waiting: RL Finetuning of Generalist Robot Policies Under Inference Latencycited by 1
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
- 2026Twincher: Bijective Representation Learning for Robust Inversion of Continuous Systemscited by 0
- 2026World-Task Factorization for Robot Learningcited by 0
- 2026Towards a Data Flywheel for Embodied Intelligence in Logisticscited by 0
- 2026Beyond One-Size-Fits-All: Diagnosis-Driven Online Reinforcement Learning with Offline Priorscited by 0
- 2026FuncBridge: Towards Functional Tool-Use Generalization via Keypoint Trajectory Reasoningcited by 0
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Drivingcited by 0
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
- 2026WISE: World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Modelscited by 0
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Modelscited by 0
- 2026DUET-DINO: Simultaneous Cross-View World Modeling for Latent Planning in Robot Manipulationcited by 0
- 2026Finishing the Task Is Not Enough: Evaluating Agent Resilience and Considerate Participation under Accumulating Challengecited by 0
- 2026Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimizationcited by 0
- 2026What Matters in Designing World Action Models: An Empirical Studycited by 0
- 2026Skytopia: Monocular Drone Navigation with Action-Conditioned Latent World Modelscited by 0
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligencecited by 0
- 2026Direct Experience World-Model Optimization: Learning the World Beyond Action Imitationcited by 0
- 2026Direct Experience World-Model Optimization: Learning the World Beyond Action Imitation29 Sep 2026
- 2026Skytopia: Monocular Drone Navigation with Action-Conditioned Latent World Models22 Sep 2026
- 2026What Matters in Designing World Action Models: An Empirical Study21 Sep 2026
- 2026Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimization19 Sep 2026
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026Finishing the Task Is Not Enough: Evaluating Agent Resilience and Considerate Participation under Accumulating Challenge9 Sep 2026
- 2026DUET-DINO: Simultaneous Cross-View World Modeling for Latent Planning in Robot Manipulation9 Sep 2026
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models3 Sep 2026
- 2026WISE: World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Models3 Sep 2026
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence30 Aug 2026
- 2026Learning to Act While Waiting: RL Finetuning of Generalist Robot Policies Under Inference Latency24 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
30 more
- 2026Is Forward Prediction Enough? Physical State Grounding for JEPA World Models7 Aug 2026
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Driving4 Aug 2026
- 2026BWM: A Low-Cost High-Fidelity World Simulator for Robot Learning31 Jul 2026
- 2026StatePlay: State-Aware Game World Models for Mechanics-Consistent Generation29 Jul 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026DriftWorld: Fast World Modeling through Drifting16 Jul 2026
- 2026Steering Robustness into World Action Models via Mechanistic Interpretability and Optimal Control16 Jul 2026
- 2026FlowDAgger: Human-in-the-Loop Adaptation of Generative Robot Policies in Latent Space9 Jul 2026
- 2026FuncBridge: Towards Functional Tool-Use Generalization via Keypoint Trajectory Reasoning7 Jul 2026
- 2026Mask2Real-WM: Segmentation Masks as a Sim-to-Real Bridge for Controllable Dexterous World Models5 Jul 2026
- 2026HALO-WA: Hybrid-Attention Latent-Guided Online Reinforcement Learning for World-Action Models5 Jul 2026
- 2026Bridge-WA: Predicting Where and How the World Changes for Robotic Action2 Jul 2026
- 2026Fast LeWorldModel24 Jun 2026
- 2026Beyond One-Size-Fits-All: Diagnosis-Driven Online Reinforcement Learning with Offline Priors24 Jun 2026
- 2026InSight: Self-Guided Skill Acquisition via Steerable VLAs23 Jun 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026Robot Self-Improvement via Human-Video Dynamics Models19 Jun 2026
- 2026World Action Models: A Survey18 Jun 2026
- 2026DREAM-Chunk: Reactive Action Chunking with Latent World Model17 Jun 2026
- 2026MemoryVAM: Integrating Memory into Video Action Model for Robot Manipulation13 Jun 2026
- 2026GIVE: Grounding Human Gestures in Vision-Language-Action Models11 Jun 2026
- 2026ω-EVA: Envision, Verify, and Act with Latent Interactive World Models8 Jun 2026
- 2026Unifying Object-Centric World Models and Diffusion Policy: A Hierarchical Framework for Multi-Stage Robotic Tasks7 Jun 2026
- 2026FAWAM: Force-Aware World Action Models for Closed-Loop Contact-Rich Manipulation7 Jun 2026
- 2026Towards a Data Flywheel for Embodied Intelligence in Logistics4 Jun 2026
- 2026Flash-WAM: Modality-Aware Distillation for World Action Models3 Jun 2026
- 2026CLAW: Learning Continuous Latent Action World Models via Adversarial Latent Regularization2 Jun 2026
- 2026World-Task Factorization for Robot Learning1 Jun 2026
- 2026Feedback World Model Enables Precise Guidance of Diffusion Policy15 May 2026
- 2026Twincher: Bijective Representation Learning for Robust Inversion of Continuous Systems13 May 2026
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026Flash-WAM: Modality-Aware Distillation for World Action Modelscited by 16
- 2026Fast LeWorldModelcited by 12
- 2026World Action Models: A Surveycited by 10
- 2026Feedback World Model Enables Precise Guidance of Diffusion Policycited by 9
- 2026FAWAM: Force-Aware World Action Models for Closed-Loop Contact-Rich Manipulationcited by 7
- 2026StatePlay: State-Aware Game World Models for Mechanics-Consistent Generationcited by 5
- 2026Is Forward Prediction Enough? Physical State Grounding for JEPA World Modelscited by 5
- 2026Steering Robustness into World Action Models via Mechanistic Interpretability and Optimal Controlcited by 3
- 2026Unifying Object-Centric World Models and Diffusion Policy: A Hierarchical Framework for Multi-Stage Robotic Taskscited by 2
- 2026ω-EVA: Envision, Verify, and Act with Latent Interactive World Modelscited by 2
- 2026DREAM-Chunk: Reactive Action Chunking with Latent World Modelcited by 2
12 most cited of 30 All 30 (JSON)
- 2026Direct Experience World-Model Optimization: Learning the World Beyond Action Imitation29 Sep 2026
- 2026Skytopia: Monocular Drone Navigation with Action-Conditioned Latent World Models22 Sep 2026
- 2026What Matters in Designing World Action Models: An Empirical Study21 Sep 2026
- 2026Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimization19 Sep 2026
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026DUET-DINO: Simultaneous Cross-View World Modeling for Latent Planning in Robot Manipulation9 Sep 2026
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models3 Sep 2026
- 2026WISE: World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Models3 Sep 2026
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence30 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026Is Forward Prediction Enough? Physical State Grounding for JEPA World Models7 Aug 2026
- 2026BWM: A Low-Cost High-Fidelity World Simulator for Robot Learning31 Jul 2026
12 newest of 30 All 30 (JSON)
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026Robot Self-Improvement via Human-Video Dynamics Modelscited by 2
- 2026Twincher: Bijective Representation Learning for Robust Inversion of Continuous Systemscited by 0
- 2026World-Task Factorization for Robot Learningcited by 0
- 2026Beyond One-Size-Fits-All: Diagnosis-Driven Online Reinforcement Learning with Offline Priorscited by 0
- 2026FuncBridge: Towards Functional Tool-Use Generalization via Keypoint Trajectory Reasoningcited by 0
- 2026Finishing the Task Is Not Enough: Evaluating Agent Resilience and Considerate Participation under Accumulating Challengecited by 0
- 2026Finishing the Task Is Not Enough: Evaluating Agent Resilience and Considerate Participation under Accumulating Challenge9 Sep 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026FuncBridge: Towards Functional Tool-Use Generalization via Keypoint Trajectory Reasoning7 Jul 2026
- 2026Beyond One-Size-Fits-All: Diagnosis-Driven Online Reinforcement Learning with Offline Priors24 Jun 2026
- 2026Robot Self-Improvement via Human-Video Dynamics Models19 Jun 2026
- 2026World-Task Factorization for Robot Learning1 Jun 2026
- 2026Twincher: Bijective Representation Learning for Robust Inversion of Continuous Systems13 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026World-Action Models for Robot Learning and Control: A Survey
- 2026World Action Models: The Next Frontier in Embodied AI
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications
- 2026World Models for Robotic Manipulation: A Survey
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
- 2025A Comprehensive Survey on World Models for Embodied AI
- 2026Robotic Video World Models: A Survey of Applications, Research Challenges, Future Directions
- 2025Robot Learning: A Tutorial