mlsanityData to 14 Oct 2026

Four Principles for Physically Interpretable World Models

arXiv 2503.02143 ↗First posted 4 Mar 2025cs.LG cs.ROcited by 10

On the map: World models → Latent predictive world models

Abstract (arXiv)

As autonomous systems are increasingly deployed in open and uncertain settings, there is a growing need for trustworthy world models that can reliably predict future high-dimensional observations. The learned latent representations in world models lack direct mapping to meaningful physical quantities and dynamics, limiting their utility and interpretability in downstream planning, control, and safety verification. In this paper, we argue for a fundamental shift from physically informed to physically interpretable world models - and crystallize four principles that leverage symbolic knowledge to achieve these ends: (1) functionally organizing the latent space according to the physical intent, (2) learning aligned invariant and equivariant representations of the physical world, (3) integrating multiple forms and strengths of supervision into a unified training process, and (4) partitioning generative outputs to support scalability and verifiability. We experimentally demonstrate the value of each principle on two benchmarks. This paper opens several intriguing research directions to achieve and capitalize on full physical interpretability in world models.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 85 of its 113 references that are in the map. First posted on arXiv 4 Mar 2025.

Builds on

85 of 113 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024Physically Interpretable World Models via Weakly Supervised Representation Learning17 Dec
  2. 2022Learning Symmetric Embeddings for Equivariant World Models24 Apr
  3. 2019SCALOR: Generative World Models with Scalable Object Representations6 Oct
  4. 2018Learning Latent Dynamics for Planning from Pixels12 Nov

Other references · 81

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2023Segment Anythingcited by 8,234
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  4. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  5. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  6. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
  7. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  8. 2018World Modelscited by 1,513
  9. 2023Mastering Diverse Domains through World Modelscited by 1,253
  10. 2023Reasoning with Language Model is Planning with World Modelcited by 861
  11. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
  12. 2018Multi-Task Learning as Multi-Objective Optimizationcited by 821
38 more
  1. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  2. 2019Hamiltonian Neural Networkscited by 712
  3. 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 699
  4. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  5. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 493
  6. 2022DayDreamer: World Models for Physical Robot Learningcited by 400
  7. 2020Planning to Explore via Self-Supervised World Modelscited by 368
  8. 2018Neural Relational Inference for Interacting Systemscited by 339
  9. 2022Transformers are Sample-Efficient World Modelscited by 328
  10. 2024Navigation World Modelscited by 272
  11. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 261
  12. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 233
  13. 2022Masked World Models for Visual Controlcited by 170
  14. 2018Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problemscited by 147
  15. 2023Structured World Models from Human Videoscited by 147
  16. 2022TransDreamer: Reinforcement Learning with Transformer World Modelscited by 143
  17. 2023Transformer-based World Models Are Happy With 100k Interactionscited by 139
  18. 2018Sequential Attend, Infer, Repeat: Generative Modelling of Moving Objectscited by 128
  19. 2023From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thoughtcited by 119
  20. 2021Pathdreamer: A World Model for Indoor Navigationcited by 118
  21. 2020Invariant Causal Prediction for Block MDPscited by 105
  22. 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Drivingcited by 93
  23. 2018Scenic: A Language for Scenario Specification and Scene Generationcited by 83
  24. 2024OccLLaMA: An Occupancy-Language-Action Generative World Model for Autonomous Drivingcited by 83
  25. 2020Improving Generative Imagination in Object-Centric World Modelscited by 71
  26. 2022Denoised MDPs: Learning World Models Better Than the World Itselfcited by 68
  27. 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Predictioncited by 67
  28. 2020Plannable Approximations to MDP Homomorphisms: Equivariance under Actionscited by 61
  29. 2024Think2Drive: Efficient Reinforcement Learning by Thinking in Latent World Model for Quasi-Realistic Autonomous Driving (in CARLA-v2)cited by 52
  30. 2023Linear Spaces of Meanings: Compositional Structures in Vision-Language Modelscited by 48
  31. 2024RenderWorld: World Model with Self-Supervised 3D Labelcited by 46
  32. 2019Structured Object-Aware Physics Prediction for Video Modeling and Planningcited by 43
  33. 2024WorldGPT: Empowering LLM as Multimodal World Modelcited by 42
  34. 2019Exploiting Spatial Invariance for Scalable Unsupervised Object Trackingcited by 40
  35. 2024VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planningcited by 39
  36. 2024AVID: Adapting Video Diffusion Models to World Modelscited by 37
  37. 2019Variational Integrator Networks for Physically Structured Embeddingscited by 36
  38. 2022Safe Reinforcement Learning for Legged Locomotioncited by 35

50 most cited of 81 All 81 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 5.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Tutorial on World Models and Physical AI
  2. 2026Physically Native World Models: A Hamiltonian Perspective on Generative World Modeling
  3. 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks
  4. 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
  5. 2026Rethinking World Models for Safety-Critical Embodied Systems
  6. 2026Physically Viable World Models: A Case for Query-Conditioned Embodied AI
  7. 2026Reduced-Order Models: The Mother of World Models
  8. 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning