A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
On the map: World models → World models for navigation
Abstract (arXiv)
The pursuit of artificial general intelligence (AGI) has placed embodied intelligence at the forefront of robotics research. Embodied intelligence focuses on agents capable of perceiving, reasoning, and acting within the physical world. Achieving robust embodied intelligence requires not only advanced perception and control, but also the ability to ground abstract cognition in real-world interactions. Two foundational technologies, physical simulators and world models, have emerged as critical enablers in this quest. Physical simulators provide controlled, high-fidelity environments for training and evaluating robotic agents, allowing safe and efficient development of complex behaviors. In contrast, world models empower robots with internal representations of their surroundings, enabling predictive planning and adaptive decision-making beyond direct sensory input. This survey systematically reviews recent advances in learning embodied AI through the integration of physical simulators and world models. We analyze their complementary roles in enhancing autonomy, adaptability, and generalization in intelligent robots, and discuss the interplay between external simulation and internal modeling in bridging the gap between simulated training and real-world deployment. By synthesizing current progress and identifying open challenges, this survey aims to provide a comprehensive perspective on the path toward more capable and generalizable embodied AI systems. We also maintain an active repository that contains up-to-date literature and open-source projects at https://github.com/NJU3DV-LoongGroup/Embodied-World-Models-Survey.
Key facts. Cited by 51 papers in the map (data through 14 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 125 of its 392 references that are in the map. First posted on arXiv 1 Jul 2025.
Builds on
125 of 392 references.
Closest ancestors · 3
Same direction, newest first
- 2025Neural Motion Simulator: Pushing the Limit of World Models in Reinforcement Learning9 Apr
- 2024Navigation World Models4 Dec
- 2024WHALE: Towards Generalizable and Scalable World Models for Embodied Decision-making8 Nov
Other references · 122
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Video Diffusion Modelscited by 2,305
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018World Modelscited by 1,513
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
38 more
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2024Genie: Generative Interactive Environmentscited by 747
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2022DayDreamer: World Models for Physical Robot Learningcited by 400
- 2020Planning to Explore via Self-Supervised World Modelscited by 368
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 328
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
- 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 240
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 233
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
- 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 195
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 191
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
- 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 166
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 151
- 2024GenAD: Generalized Predictive Model for Autonomous Drivingcited by 150
- 2023Structured World Models from Human Videoscited by 147
- 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 146
- 2022TransDreamer: Reinforcement Learning with Transformer World Modelscited by 143
- 2023Transformer-based World Models Are Happy With 100k Interactionscited by 139
50 most cited of 122 All 122 (JSON)
Built on by
Citing papers per year: 2025: 15; 2026: 36.
51 papers.
Sort:
By area:
- 2026Advancing Open-source World Modelscited by 154
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
- 20253D and 4D World Modeling: A Surveycited by 67
- 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 50
- 2025World-in-World: World Models in a Closed-Loop Worldcited by 47
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Modelscited by 18
- 2025SafeMind: Benchmarking and Mitigating Safety Risks in Embodied LLM Agentscited by 17
- 2025A Step Toward World Models: A Survey on Robotic Manipulationcited by 15
- 2026Wow, wo, val! A Comprehensive Embodied World Model Evaluation Turing Testcited by 13
- 2025StreamEQA: Towards Streaming Video Understanding for Embodied Scenarioscited by 12
- 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platformcited by 10
- 2025ToG-Bench: Task-Oriented Spatio-Temporal Grounding in Egocentric Videoscited by 8
38 more
- 2026CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoningcited by 7
- 2026Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuningcited by 7
- 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Modelcited by 7
- 2026PhyWorld: Physics-Faithful World Model for Video Generationcited by 6
- 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 6
- 2025RoboScape-R: Unified Reward-Observation World Models for Generalizable Robotics Training via RLcited by 5
- 2026Aligning Agentic World Models via Knowledgeable Experience Learningcited by 5
- 2026Human Cognition in Machines: A Unified Perspective of World Modelscited by 5
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challengescited by 4
- 2026StreamingClaw Technical Reportcited by 4
- 2026Xiaomi-Robotics-U0: Unified Embodied Synthesis with World Foundation Modelcited by 4
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2025Target-Bench: Can Video World Models Achieve Mapless Path Planning with Semantic Targets?cited by 2
- 2025AOMGen: Photoreal, Physics-Consistent Demonstration Generation for Articulated Object Manipulationcited by 2
- 2026How Foundational Skills Influence VLM-based Embodied Agents:A Native Perspectivecited by 2
- 2026PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimizationcited by 2
- 2026MoWorld: A Flash World Modelcited by 2
- 2025Human Centric General Physical Intelligence for Agile Manufacturing Automationcited by 1
- 2025HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Drivingcited by 1
- 2025PhysFire-WM: A Physics-Informed World Model for Emulating Fire Spread Dynamicscited by 1
- 2026RU4D-SLAM: Reweighting Uncertainty in Gaussian Splatting SLAM for 4D Scene Reconstructioncited by 1
- 2026WestWorld: A Knowledge-Encoded Scalable Trajectory World Model for Diverse Robotic Systemscited by 1
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
- 2026GEM: Generating LiDAR World Model via Deformable Mambacited by 1
- 2026AndroidReality: How Far Are Mobile Agents from the Real World?cited by 1
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstructioncited by 1
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
- 2026Entropy-Guided k-Guard Sampling for Long-Horizon Autoregressive Video Generationcited by 0
- 2026TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generationcited by 0
- 2026From Digital Twins to World Models:Opportunities, Challenges, and Applications for Mobile Edge General Intelligencecited by 0
- 2026Evaluation as Evolution: Transforming Adversarial Diffusion into Closed-Loop Curricula for Autonomous Vehiclescited by 0
- 2026WorldString: Actionable World Representationcited by 0
- 2026Towards Trustworthy Physical Intelligence: From Theory to Practice Across Life Cyclecited by 0
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
- 2026Analytic Dynamics: Learning Physics-Grounded Representation for Fast Intrinsic Dynamics Inference from Monocular Videoscited by 0
- 2026World Model-Guided Reinforcement Learning via Counterfactual User Engagement Simulationcited by 0
- 2026A Comprehensive Review of Generative Physical Artificial Intelligencecited by 0
50 most cited of 51 All 51 (JSON)
- 2026A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform1 Oct 2026
- 2026A Comprehensive Review of Generative Physical Artificial Intelligence16 Sep 2026
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026World Model-Guided Reinforcement Learning via Counterfactual User Engagement Simulation1 Sep 2026
- 2026Analytic Dynamics: Learning Physics-Grounded Representation for Fast Intrinsic Dynamics Inference from Monocular Videos31 Aug 2026
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstruction28 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026AndroidReality: How Far Are Mobile Agents from the Real World?7 Aug 2026
- 2026Towards Trustworthy Physical Intelligence: From Theory to Practice Across Life Cycle24 Jul 2026
- 2026Xiaomi-Robotics-U0: Unified Embodied Synthesis with World Foundation Model13 Jul 2026
- 2026MoWorld: A Flash World Model7 Jul 2026
- 2026Echo-Memory: A Controlled Study of Memory in Action World Models8 Jun 2026
38 more
- 2026PhyWorld: Physics-Faithful World Model for Video Generation19 May 2026
- 2026WorldString: Actionable World Representation18 May 2026
- 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platform18 May 2026
- 2026GEM: Generating LiDAR World Model via Deformable Mamba8 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026Human Cognition in Machines: A Unified Perspective of World Models17 Apr 2026
- 2026PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimization11 Apr 2026
- 2026Evaluation as Evolution: Transforming Adversarial Diffusion into Closed-Loop Curricula for Autonomous Vehicles8 Apr 2026
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models23 Mar 2026
- 2026StreamingClaw Technical Report23 Mar 2026
- 2026From Digital Twins to World Models:Opportunities, Challenges, and Applications for Mobile Edge General Intelligence18 Mar 2026
- 2026WestWorld: A Knowledge-Encoded Scalable Trajectory World Model for Diverse Robotic Systems15 Mar 2026
- 2026RU4D-SLAM: Reweighting Uncertainty in Gaussian Splatting SLAM for 4D Scene Reconstruction24 Feb 2026
- 2026How Foundational Skills Influence VLM-based Embodied Agents:A Native Perspective24 Feb 2026
- 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model11 Feb 2026
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Models9 Feb 2026
- 2026TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generation9 Feb 2026
- 2026Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuning31 Jan 2026
- 2026Advancing Open-source World Models28 Jan 2026
- 2026Entropy-Guided k-Guard Sampling for Long-Horizon Autoregressive Video Generation27 Jan 2026
- 2026CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoning19 Jan 2026
- 2026Aligning Agentic World Models via Knowledgeable Experience Learning19 Jan 2026
- 2026Wow, wo, val! A Comprehensive Embodied World Model Evaluation Turing Test7 Jan 2026
- 2025AOMGen: Photoreal, Physics-Consistent Demonstration Generation for Articulated Object Manipulation20 Dec 2025
- 2025PhysFire-WM: A Physics-Informed World Model for Emulating Fire Spread Dynamics19 Dec 2025
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challenges4 Dec 2025
- 2025StreamEQA: Towards Streaming Video Understanding for Embodied Scenarios4 Dec 2025
- 2025ToG-Bench: Task-Oriented Spatio-Temporal Grounding in Egocentric Videos3 Dec 2025
- 2025RoboScape-R: Unified Reward-Observation World Models for Generalizable Robotics Training via RL3 Dec 2025
- 2025HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Driving27 Nov 2025
- 2025Target-Bench: Can Video World Models Achieve Mapless Path Planning with Semantic Targets?21 Nov 2025
- 2025A Step Toward World Models: A Survey on Robotic Manipulation31 Oct 2025
- 2025World-in-World: World Models in a Closed-Loop World20 Oct 2025
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI6 Oct 2025
- 2025SafeMind: Benchmarking and Mitigating Safety Risks in Embodied LLM Agents30 Sep 2025
- 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directions23 Sep 2025
- 20253D and 4D World Modeling: A Survey4 Sep 2025
50 newest of 51 All 51 (JSON)
- 2026Advancing Open-source World Modelscited by 154
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
- 20253D and 4D World Modeling: A Surveycited by 67
- 2025World-in-World: World Models in a Closed-Loop Worldcited by 47
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Modelscited by 18
- 2025A Step Toward World Models: A Survey on Robotic Manipulationcited by 15
- 2026Wow, wo, val! A Comprehensive Embodied World Model Evaluation Turing Testcited by 13
- 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platformcited by 10
- 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Modelcited by 7
- 2026PhyWorld: Physics-Faithful World Model for Video Generationcited by 6
- 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 6
- 2025RoboScape-R: Unified Reward-Observation World Models for Generalizable Robotics Training via RLcited by 5
12 most cited of 29 All 29 (JSON)
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026World Model-Guided Reinforcement Learning via Counterfactual User Engagement Simulation1 Sep 2026
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstruction28 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026Xiaomi-Robotics-U0: Unified Embodied Synthesis with World Foundation Model13 Jul 2026
- 2026MoWorld: A Flash World Model7 Jul 2026
- 2026Echo-Memory: A Controlled Study of Memory in Action World Models8 Jun 2026
- 2026PhyWorld: Physics-Faithful World Model for Video Generation19 May 2026
- 2026WorldString: Actionable World Representation18 May 2026
- 2026WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platform18 May 2026
- 2026GEM: Generating LiDAR World Model via Deformable Mamba8 May 2026
- 2026Human Cognition in Machines: A Unified Perspective of World Models17 Apr 2026
12 newest of 29 All 29 (JSON)
- 2025HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Drivingcited by 1
- 2026Evaluation as Evolution: Transforming Adversarial Diffusion into Closed-Loop Curricula for Autonomous Vehiclescited by 0
- 2026A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platformcited by 0
- 2026A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform1 Oct 2026
- 2026Evaluation as Evolution: Transforming Adversarial Diffusion into Closed-Loop Curricula for Autonomous Vehicles8 Apr 2026
- 2025HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Driving27 Nov 2025
- 2025StreamEQA: Towards Streaming Video Understanding for Embodied Scenarioscited by 12
- 2025ToG-Bench: Task-Oriented Spatio-Temporal Grounding in Egocentric Videoscited by 8
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challengescited by 4
- 2026StreamingClaw Technical Reportcited by 4
- 2026PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimizationcited by 2
- 2026RU4D-SLAM: Reweighting Uncertainty in Gaussian Splatting SLAM for 4D Scene Reconstructioncited by 1
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
- 2026Entropy-Guided k-Guard Sampling for Long-Horizon Autoregressive Video Generationcited by 0
- 2026TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generationcited by 0
- 2026Towards Trustworthy Physical Intelligence: From Theory to Practice Across Life Cyclecited by 0
- 2026Analytic Dynamics: Learning Physics-Grounded Representation for Fast Intrinsic Dynamics Inference from Monocular Videoscited by 0
- 2026Analytic Dynamics: Learning Physics-Grounded Representation for Fast Intrinsic Dynamics Inference from Monocular Videos31 Aug 2026
- 2026Towards Trustworthy Physical Intelligence: From Theory to Practice Across Life Cycle24 Jul 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimization11 Apr 2026
- 2026StreamingClaw Technical Report23 Mar 2026
- 2026RU4D-SLAM: Reweighting Uncertainty in Gaussian Splatting SLAM for 4D Scene Reconstruction24 Feb 2026
- 2026TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generation9 Feb 2026
- 2026Entropy-Guided k-Guard Sampling for Long-Horizon Autoregressive Video Generation27 Jan 2026
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challenges4 Dec 2025
- 2025StreamEQA: Towards Streaming Video Understanding for Embodied Scenarios4 Dec 2025
- 2025ToG-Bench: Task-Oriented Spatio-Temporal Grounding in Egocentric Videos3 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI
- 2025Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learning
- 2025Embodied AI Agents: Modeling the World
- 2025A Comprehensive Survey on World Models for Embodied AI
- 2026World Model for Robot Learning: A Comprehensive Survey
- 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
- 2026ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence