mlsanityData to 14 Oct 2026

Physically Viable World Models: A Case for Query-Conditioned Embodied AI

arXiv 2605.30542 ↗First posted 28 May 2026cs.AIcited by 2

On the map: World models → World models for navigation

Abstract (arXiv)

World models for embodied AI must be physically viable: constructed to answer intervention queries by representing the physical structure governing action outcomes, rather than merely predicting future observations. Existing observation-predictive world models can produce visually plausible but physically wrong rollouts. This failure is structural; distinct physical systems can look identical yet diverge under intervention. We expose this problem with controlled benchmarks that fix the visible scene while varying latent physics. We show that such models may recommend infeasible actions, mispredict interaction outcomes, or certify unsafe behavior. We argue that embodied AI requires world models that identify the simplest physical abstraction sufficient to answer an intervention query. Such a model comprises modular components, including environment representation, latent state and parameter estimation, action specification, interventional dynamics, and query-level response. An autonomous orchestrator should identify the relevant abstraction and compose compatible learned and structured components per query. When closed-form physics is unavailable, uncertain, or costly, the transition model may be analytic, simulated, learned, or hybrid, but it must preserve the structure that determines interventional outcomes. This decomposition makes the model interpretable, its components verifiable, and its outputs auditable against the query. It also provides a design principle for new world models and a feasibility test for existing ones: the right abstraction is not the most detailed model of the world, but the simplest model that preserves the distinctions relevant to the query. We demonstrate this approach on queries that existing systems fail to answer correctly, and outline how an orchestrator can dynamically assemble and adapt physically viable models for planning, control, and verification.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 55 of its 67 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

55 of 67 references.

References · 55

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2018Neural Ordinary Differential Equationscited by 3,779
  3. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  4. 2018World Modelscited by 1,513
  5. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
  6. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  7. 2023Mastering Diverse Domains through World Modelscited by 1,253
  8. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
  9. 2020Mastering Atari with Discrete World Modelscited by 1,007
  10. 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
  11. 2020Object-Centric Learning with Slot Attentioncited by 876
  12. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
38 more
  1. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  2. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  3. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  4. 2019Hamiltonian Neural Networkscited by 712
  5. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  6. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
  7. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
  8. 2021Brax -- A Differentiable Physics Engine for Large Scale Rigid Body Simulationcited by 407
  9. 2020Lagrangian Neural Networkscited by 398
  10. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  11. 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 344
  12. 2022Transformers are Sample-Efficient World Modelscited by 328
  13. 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
  14. 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 258
  15. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
  16. 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 220
  17. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
  18. 2019Contrastive Learning of Structured World Modelscited by 209
  19. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  20. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
  21. 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
  22. 2025Do generative video models understand physical principles?cited by 161
  23. 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 160
  24. 2018PDDLStream: Integrating Symbolic Planners and Blackbox Samplers via Optimistic Adaptive Planningcited by 150
  25. 2022TransDreamer: Reinforcement Learning with Transformer World Modelscited by 143
  26. 2016A Compositional Object-Based Approach to Learning Physical Dynamicscited by 119
  27. 2022MaskViT: Masked Visual Pre-Training for Video Predictioncited by 114
  28. 2021gradSim: Differentiable simulation for system identification and visuomotor controlcited by 100
  29. 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 76
  30. 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 66
  31. 2025Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systemscited by 48
  32. 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imaginationcited by 45
  33. 2026Hierarchical Planning with Latent World Modelscited by 43
  34. 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priorscited by 41
  35. 2024Physically Embodied Gaussian Splatting: A Realtime Correctable World Model for Roboticscited by 40
  36. 2025T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generationcited by 39
  37. 2024AVID: Adapting Video Diffusion Models to World Modelscited by 37
  38. 2024PhysFlow: Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulationcited by 36

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Comprehensive Survey on World Models for Embodied AI
  2. 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
  3. 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
  4. 2026WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulation
  5. 2025Embodied AI Agents: Modeling the World
  6. 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
  7. 2026Explicit World Models for Reliable Human-Robot Collaboration
  8. 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agents