From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
On the map: World models → World models for language agents
Abstract (arXiv)
A world model is an AI system that simulates how an environment evolves under actions, enabling planning through imagined futures rather than reactive perception. Current world models, however, suffer from visual conflation: the mistaken assumption that high-fidelity video generation implies an understanding of physical and causal dynamics. We show that while modern models excel at predicting pixels, they frequently violate invariant constraints, fail under intervention, and break down in safety-critical decision-making. This survey argues that visual realism is an unreliable proxy for world understanding. Instead, effective world models must encode causal structure, respect domain-specific constraints, and remain stable over long horizons. We propose a reframing of world models as actionable simulators rather than visual engines, emphasizing structured 4D interfaces, constraint-aware dynamics, and closed-loop evaluation. Using medical decision-making as an epistemic stress test, where trial-and-error is impossible and errors are irreversible, we demonstrate that a world model's value is determined not by how realistic its rollouts appear, but by its ability to support counterfactual reasoning, intervention planning, and robust long-horizon foresight.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 38 of its 49 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
38 of 49 references.
Closest ancestors · 3
Same direction, newest first
- 2025World-in-World: World Models in a Closed-Loop World20 Oct
- 2025Assessing Adaptive World Models in Machines with Novel Games17 Jul
- 2025PoE-World: Compositional World Modeling with Products of Programmatic Experts16 May
Other references · 35
- 2018World Modelscited by 1,444
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
- 2024Navigation World Modelscited by 262
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
- 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 116
- 2025TesserAct: Learning 4D Embodied World Modelscited by 90
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
- 2024DrEureka: Language Model Guided Sim-To-Real Transfercited by 78
- 2025Intuitive physics understanding emerges from self-supervised pretraining on natural videoscited by 66
- 2025WorldEval: World Model as Real-World Robot Policies Evaluatorcited by 64
23 more
- 2024LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoningcited by 63
- 2025Long-Context State-Space Video World Modelscited by 59
- 2025HERMES: A Unified Self-Driving World Model for Simultaneous 3D Scene Understanding and Generationcited by 56
- 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Modelcited by 43
- 2025WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigationcited by 42
- 2025RoboScape: Physics-informed Embodied World Modelcited by 38
- 20253DFlowAction: Learning Cross-Embodiment Manipulation from 3D Flow World Modelcited by 36
- 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalizationcited by 34
- 2023MUVO: A Multimodal Generative World Model for Autonomous Driving with Geometric Representationscited by 33
- 2025Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planningcited by 31
- 2024GenRL: Multimodal-foundation world models for generalization in embodied agentscited by 29
- 2024A Large Language Model-Driven Reward Design Framework via Dynamic Feedback for Reinforcement Learningcited by 29
- 2025Learning 3D Persistent Embodied World Modelscited by 29
- 2025EmbodieDreamer: Advancing Real2Sim2Real Transfer for Policy Training via Embodied World Modelingcited by 29
- 2024RoboNurse-VLA: Robotic Scrub Nurse System based on Vision-Language-Action Modelcited by 28
- 2025DiWA: Diffusion Policy Adaptation with World Modelscited by 28
- 2025PIN-WM: Learning Physics-INformed World Models for Non-Prehensile Manipulationcited by 22
- 2025DyWA: Dynamics-adaptive World Action Model for Generalizable Non-prehensile Manipulationcited by 21
- 2024SPARTAN: A Sparse Transformer World Model Attending to What Matterscited by 10
- 2024WHALE: Towards Generalizable and Scalable World Models for Embodied Decision-makingcited by 9
- 2025Latent Policy Steering with Embodiment-Agnostic Pretrained World Modelscited by 8
- 2025PhyVLLM: Physics-Guided Video Language Model with Motion-Appearance Disentanglementcited by 4
- 2025Bounding Distributional Shifts in World Modeling through Novelty Detectioncited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Marionette: Predicting World States, Rendering Geometry, Painting Appearancecited by 5
- 2026ECG-WM: A Physiology-Informed ECG World Model for Clinical Intervention Simulationcited by 2
- 2026Validate the Dream Before You Trust Its Verdict: Admissibility for World-Model Simulatorscited by 2
- 2026NICE FACT: Diagnosing and Calibrating VLMs in Quantitative Reasoning for Kinematic Physicscited by 0
- 2026Marionette: Predicting World States, Rendering Geometry, Painting Appearance14 Aug 2026
- 2026Validate the Dream Before You Trust Its Verdict: Admissibility for World-Model Simulators8 Jul 2026
- 2026ECG-WM: A Physiology-Informed ECG World Model for Clinical Intervention Simulation17 May 2026
- 2026NICE FACT: Diagnosing and Calibrating VLMs in Quantitative Reasoning for Kinematic Physics8 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Physically Native World Models: A Hamiltonian Perspective on Generative World Modeling
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap
- 2026How Should World Models Be Evaluated for Embodied Decision-Making? A Decision-Making-Centric Position
- 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks
- 2026Rethinking World Models for Safety-Critical Embodied Systems
- 2025WoW: Towards a World omniscient World model Through Embodied Interaction
- 2026World Action Models: A Survey
- 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications