Physically Viable World Models: A Case for Query-Conditioned Embodied AI
On the map: World models → World models for navigation
Abstract (arXiv)
World models for embodied AI must be physically viable: constructed to answer intervention queries by representing the physical structure governing action outcomes, rather than merely predicting future observations. Existing observation-predictive world models can produce visually plausible but physically wrong rollouts. This failure is structural; distinct physical systems can look identical yet diverge under intervention. We expose this problem with controlled benchmarks that fix the visible scene while varying latent physics. We show that such models may recommend infeasible actions, mispredict interaction outcomes, or certify unsafe behavior. We argue that embodied AI requires world models that identify the simplest physical abstraction sufficient to answer an intervention query. Such a model comprises modular components, including environment representation, latent state and parameter estimation, action specification, interventional dynamics, and query-level response. An autonomous orchestrator should identify the relevant abstraction and compose compatible learned and structured components per query. When closed-form physics is unavailable, uncertain, or costly, the transition model may be analytic, simulated, learned, or hybrid, but it must preserve the structure that determines interventional outcomes. This decomposition makes the model interpretable, its components verifiable, and its outputs auditable against the query. It also provides a design principle for new world models and a feasibility test for existing ones: the right abstraction is not the most detailed model of the world, but the simplest model that preserves the distinctions relevant to the query. We demonstrate this approach on queries that existing systems fail to answer correctly, and outline how an orchestrator can dynamically assemble and adapt physically viable models for planning, control, and verification.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 55 of its 67 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
55 of 67 references.
References · 55
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018World Modelscited by 1,513
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2020Object-Centric Learning with Slot Attentioncited by 876
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
38 more
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2019Hamiltonian Neural Networkscited by 712
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2021Brax -- A Differentiable Physics Engine for Large Scale Rigid Body Simulationcited by 407
- 2020Lagrangian Neural Networkscited by 398
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 344
- 2022Transformers are Sample-Efficient World Modelscited by 328
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 258
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 220
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2019Contrastive Learning of Structured World Modelscited by 209
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
- 2025Do generative video models understand physical principles?cited by 161
- 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 160
- 2018PDDLStream: Integrating Symbolic Planners and Blackbox Samplers via Optimistic Adaptive Planningcited by 150
- 2022TransDreamer: Reinforcement Learning with Transformer World Modelscited by 143
- 2016A Compositional Object-Based Approach to Learning Physical Dynamicscited by 119
- 2022MaskViT: Masked Visual Pre-Training for Video Predictioncited by 114
- 2021gradSim: Differentiable simulation for system identification and visuomotor controlcited by 100
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 76
- 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 66
- 2025Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systemscited by 48
- 2024Dream to Manipulate: Compositional World Models Empowering Robot Imitation Learning with Imaginationcited by 45
- 2026Hierarchical Planning with Latent World Modelscited by 43
- 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priorscited by 41
- 2024Physically Embodied Gaussian Splatting: A Realtime Correctable World Model for Roboticscited by 40
- 2025T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generationcited by 39
- 2024AVID: Adapting Video Diffusion Models to World Modelscited by 37
- 2024PhysFlow: Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulationcited by 36
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Path Planning in Physically Viable World Modelscited by 0
- 2026What Must a World Model Distinguish for Planning?cited by 0
- 2026What Must a World Model Distinguish for Planning?26 Sep 2026
- 2026Path Planning in Physically Viable World Models1 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025A Comprehensive Survey on World Models for Embodied AI
- 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
- 2026WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulation
- 2025Embodied AI Agents: Modeling the World
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
- 2026Explicit World Models for Reliable Human-Robot Collaboration
- 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agents