mlsanityData to 7 Oct 2026

From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models

arXiv 2601.15533 ↗First posted 21 Jan 2026cs.AIcited by 4

On the map: World models → World models for language agents

Abstract (arXiv)

A world model is an AI system that simulates how an environment evolves under actions, enabling planning through imagined futures rather than reactive perception. Current world models, however, suffer from visual conflation: the mistaken assumption that high-fidelity video generation implies an understanding of physical and causal dynamics. We show that while modern models excel at predicting pixels, they frequently violate invariant constraints, fail under intervention, and break down in safety-critical decision-making. This survey argues that visual realism is an unreliable proxy for world understanding. Instead, effective world models must encode causal structure, respect domain-specific constraints, and remain stable over long horizons. We propose a reframing of world models as actionable simulators rather than visual engines, emphasizing structured 4D interfaces, constraint-aware dynamics, and closed-loop evaluation. Using medical decision-making as an epistemic stress test, where trial-and-error is impossible and errors are irreversible, we demonstrate that a world model's value is determined not by how realistic its rollouts appear, but by its ability to support counterfactual reasoning, intervention planning, and robust long-horizon foresight.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 38 of its 49 references that are in the map. First posted on arXiv 21 Jan 2026.

Builds on

38 of 49 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025World-in-World: World Models in a Closed-Loop World20 Oct
  2. 2025Assessing Adaptive World Models in Machines with Novel Games17 Jul
  3. 2025PoE-World: Compositional World Modeling with Products of Programmatic Experts16 May

Other references · 35

  1. 2018World Modelscited by 1,444
  2. 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
  3. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
  4. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
  5. 2024Navigation World Modelscited by 262
  6. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
  7. 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 116
  8. 2025TesserAct: Learning 4D Embodied World Modelscited by 90
  9. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
  10. 2024DrEureka: Language Model Guided Sim-To-Real Transfercited by 78
  11. 2025Intuitive physics understanding emerges from self-supervised pretraining on natural videoscited by 66
  12. 2025WorldEval: World Model as Real-World Robot Policies Evaluatorcited by 64
23 more
  1. 2024LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoningcited by 63
  2. 2025Long-Context State-Space Video World Modelscited by 59
  3. 2025HERMES: A Unified Self-Driving World Model for Simultaneous 3D Scene Understanding and Generationcited by 56
  4. 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Modelcited by 43
  5. 2025WMNav: Integrating Vision-Language Models into World Models for Object Goal Navigationcited by 42
  6. 2025RoboScape: Physics-informed Embodied World Modelcited by 38
  7. 20253DFlowAction: Learning Cross-Embodiment Manipulation from 3D Flow World Modelcited by 36
  8. 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalizationcited by 34
  9. 2023MUVO: A Multimodal Generative World Model for Autonomous Driving with Geometric Representationscited by 33
  10. 2025Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planningcited by 31
  11. 2024GenRL: Multimodal-foundation world models for generalization in embodied agentscited by 29
  12. 2024A Large Language Model-Driven Reward Design Framework via Dynamic Feedback for Reinforcement Learningcited by 29
  13. 2025Learning 3D Persistent Embodied World Modelscited by 29
  14. 2025EmbodieDreamer: Advancing Real2Sim2Real Transfer for Policy Training via Embodied World Modelingcited by 29
  15. 2024RoboNurse-VLA: Robotic Scrub Nurse System based on Vision-Language-Action Modelcited by 28
  16. 2025DiWA: Diffusion Policy Adaptation with World Modelscited by 28
  17. 2025PIN-WM: Learning Physics-INformed World Models for Non-Prehensile Manipulationcited by 22
  18. 2025DyWA: Dynamics-adaptive World Action Model for Generalizable Non-prehensile Manipulationcited by 21
  19. 2024SPARTAN: A Sparse Transformer World Model Attending to What Matterscited by 10
  20. 2024WHALE: Towards Generalizable and Scalable World Models for Embodied Decision-makingcited by 9
  21. 2025Latent Policy Steering with Embodiment-Agnostic Pretrained World Modelscited by 8
  22. 2025PhyVLLM: Physics-Guided Video Language Model with Motion-Appearance Disentanglementcited by 4
  23. 2025Bounding Distributional Shifts in World Modeling through Novelty Detectioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Physically Native World Models: A Hamiltonian Perspective on Generative World Modeling
  2. 2025Simulating the Visual World with Artificial Intelligence: A Roadmap
  3. 2026How Should World Models Be Evaluated for Embodied Decision-Making? A Decision-Making-Centric Position
  4. 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks
  5. 2026Rethinking World Models for Safety-Critical Embodied Systems
  6. 2025WoW: Towards a World omniscient World model Through Embodied Interaction
  7. 2026World Action Models: A Survey
  8. 2026World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications