mlsanityData to 14 Oct 2026

A Survey: Learning Embodied Intelligence from Physical Simulators and World Models

arXiv 2507.00917 ↗First posted 1 Jul 2025cs.ROcited by 51

On the map: World models → World models for navigation

Abstract (arXiv)

The pursuit of artificial general intelligence (AGI) has placed embodied intelligence at the forefront of robotics research. Embodied intelligence focuses on agents capable of perceiving, reasoning, and acting within the physical world. Achieving robust embodied intelligence requires not only advanced perception and control, but also the ability to ground abstract cognition in real-world interactions. Two foundational technologies, physical simulators and world models, have emerged as critical enablers in this quest. Physical simulators provide controlled, high-fidelity environments for training and evaluating robotic agents, allowing safe and efficient development of complex behaviors. In contrast, world models empower robots with internal representations of their surroundings, enabling predictive planning and adaptive decision-making beyond direct sensory input. This survey systematically reviews recent advances in learning embodied AI through the integration of physical simulators and world models. We analyze their complementary roles in enhancing autonomy, adaptability, and generalization in intelligent robots, and discuss the interplay between external simulation and internal modeling in bridging the gap between simulated training and real-world deployment. By synthesizing current progress and identifying open challenges, this survey aims to provide a comprehensive perspective on the path toward more capable and generalizable embodied AI systems. We also maintain an active repository that contains up-to-date literature and open-source projects at https://github.com/NJU3DV-LoongGroup/Embodied-World-Models-Survey.

Key facts. Cited by 51 papers in the map (data through 14 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 125 of its 392 references that are in the map. First posted on arXiv 1 Jul 2025.

Builds on

125 of 392 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Neural Motion Simulator: Pushing the Limit of World Models in Reinforcement Learning9 Apr
  2. 2024Navigation World Models4 Dec
  3. 2024WHALE: Towards Generalizable and Scalable World Models for Embodied Decision-making8 Nov

Other references · 122

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  3. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  4. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  5. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  7. 2022Video Diffusion Modelscited by 2,305
  8. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  9. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  10. 2018World Modelscited by 1,513
  11. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  12. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
38 more
  1. 2023Mastering Diverse Domains through World Modelscited by 1,253
  2. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  3. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  4. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  5. 2020Mastering Atari with Discrete World Modelscited by 1,007
  6. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  7. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  8. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  9. 2024Genie: Generative Interactive Environmentscited by 747
  10. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  11. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  12. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  13. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  14. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  15. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  16. 2022DayDreamer: World Models for Physical Robot Learningcited by 400
  17. 2020Planning to Explore via Self-Supervised World Modelscited by 368
  18. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
  19. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
  20. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
  21. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
  22. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 328
  23. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
  24. 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 240
  25. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 233
  26. 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
  27. 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 195
  28. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 191
  29. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
  30. 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 166
  31. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
  32. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
  33. 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 151
  34. 2024GenAD: Generalized Predictive Model for Autonomous Drivingcited by 150
  35. 2023Structured World Models from Human Videoscited by 147
  36. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 146
  37. 2022TransDreamer: Reinforcement Learning with Transformer World Modelscited by 143
  38. 2023Transformer-based World Models Are Happy With 100k Interactionscited by 139

50 most cited of 122 All 122 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 15; 2026: 36.

51 papers.

Sort:

By area:

  1. 2026Advancing Open-source World Modelscited by 154
  2. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
  3. 20253D and 4D World Modeling: A Surveycited by 67
  4. 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 50
  5. 2025World-in-World: World Models in a Closed-Loop Worldcited by 47
  6. 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Modelscited by 18
  7. 2025SafeMind: Benchmarking and Mitigating Safety Risks in Embodied LLM Agentscited by 17
  8. 2025A Step Toward World Models: A Survey on Robotic Manipulationcited by 15
  9. 2026Wow, wo, val! A Comprehensive Embodied World Model Evaluation Turing Testcited by 13
  10. 2025StreamEQA: Towards Streaming Video Understanding for Embodied Scenarioscited by 12
  11. 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platformcited by 10
  12. 2025ToG-Bench: Task-Oriented Spatio-Temporal Grounding in Egocentric Videoscited by 8
38 more
  1. 2026CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoningcited by 7
  2. 2026Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuningcited by 7
  3. 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Modelcited by 7
  4. 2026PhyWorld: Physics-Faithful World Model for Video Generationcited by 6
  5. 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 6
  6. 2025RoboScape-R: Unified Reward-Observation World Models for Generalizable Robotics Training via RLcited by 5
  7. 2026Aligning Agentic World Models via Knowledgeable Experience Learningcited by 5
  8. 2026Human Cognition in Machines: A Unified Perspective of World Modelscited by 5
  9. 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challengescited by 4
  10. 2026StreamingClaw Technical Reportcited by 4
  11. 2026Xiaomi-Robotics-U0: Unified Embodied Synthesis with World Foundation Modelcited by 4
  12. 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
  13. 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
  14. 2025Target-Bench: Can Video World Models Achieve Mapless Path Planning with Semantic Targets?cited by 2
  15. 2025AOMGen: Photoreal, Physics-Consistent Demonstration Generation for Articulated Object Manipulationcited by 2
  16. 2026How Foundational Skills Influence VLM-based Embodied Agents:A Native Perspectivecited by 2
  17. 2026PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimizationcited by 2
  18. 2026MoWorld: A Flash World Modelcited by 2
  19. 2025Human Centric General Physical Intelligence for Agile Manufacturing Automationcited by 1
  20. 2025HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Drivingcited by 1
  21. 2025PhysFire-WM: A Physics-Informed World Model for Emulating Fire Spread Dynamicscited by 1
  22. 2026RU4D-SLAM: Reweighting Uncertainty in Gaussian Splatting SLAM for 4D Scene Reconstructioncited by 1
  23. 2026WestWorld: A Knowledge-Encoded Scalable Trajectory World Model for Diverse Robotic Systemscited by 1
  24. 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
  25. 2026GEM: Generating LiDAR World Model via Deformable Mambacited by 1
  26. 2026AndroidReality: How Far Are Mobile Agents from the Real World?cited by 1
  27. 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstructioncited by 1
  28. 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
  29. 2026Entropy-Guided k-Guard Sampling for Long-Horizon Autoregressive Video Generationcited by 0
  30. 2026TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generationcited by 0
  31. 2026From Digital Twins to World Models:Opportunities, Challenges, and Applications for Mobile Edge General Intelligencecited by 0
  32. 2026Evaluation as Evolution: Transforming Adversarial Diffusion into Closed-Loop Curricula for Autonomous Vehiclescited by 0
  33. 2026WorldString: Actionable World Representationcited by 0
  34. 2026Towards Trustworthy Physical Intelligence: From Theory to Practice Across Life Cyclecited by 0
  35. 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
  36. 2026Analytic Dynamics: Learning Physics-Grounded Representation for Fast Intrinsic Dynamics Inference from Monocular Videoscited by 0
  37. 2026World Model-Guided Reinforcement Learning via Counterfactual User Engagement Simulationcited by 0
  38. 2026A Comprehensive Review of Generative Physical Artificial Intelligencecited by 0

50 most cited of 51 All 51 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI
  2. 2025Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learning
  3. 2025Embodied AI Agents: Modeling the World
  4. 2025A Comprehensive Survey on World Models for Embodied AI
  5. 2026World Model for Robot Learning: A Comprehensive Survey
  6. 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
  7. 2026ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI
  8. 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence