mlsanityData to 14 Oct 2026

PH-Dreamer: A Physics-Driven World Model via Port-Hamiltonian Generative Dynamics

arXiv 2605.18303 ↗First posted 18 May 2026cs.LG cs.AI cs.CVcited by 3

On the map: World models → Latent predictive world models

Abstract (arXiv)

World models built on recurrent state space architectures enable efficient latent imagination, yet remain physically unstructured, producing dynamics that violate conservation and dissipative principles. We introduce a unified Port-Hamiltonian framework that remedies this through three synergistic mechanisms. First, we embed implicit physical priors into recurrent transitions by modeling projected latent evolution as action controlled energy routing governed by flow and dissipation, biasing the projected PH phase space toward a more compact and physically structured representation. Second, we develop a kinematics aware energy world model that estimates the Hamiltonian and power balance from proprioceptive observations, providing an explicit physical signal for thermodynamic reasoning. Third, leveraging these energy gradients, we establish an energy guided Actor-Critic that uses Lagrangian multipliers to regularize policy optimization toward lower energy and smoother control. Across visual control benchmarks, this paradigm not only attains superior asymptotic returns but also elevates internal simulator fidelity by establishing a tighter, lower variance alignment between imagined and real rewards, all while reducing latent phase space volume by 4.18-8.41%, energy consumption by up to 7.80%, and mean squared jerk by up to 9.38%.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 30 of its 38 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

30 of 38 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024How Far is Video Generation from World Model: A Physical Law Perspective4 Nov
  2. 2018Learning Latent Dynamics for Planning from Pixels12 Nov

Other references · 28

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  3. 2020Mastering Atari with Discrete World Modelscited by 1,007
  4. 2018DeepMind Control Suitecited by 956
  5. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  6. 2019Hamiltonian Neural Networkscited by 712
  7. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
  8. 2019Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learningcited by 212
  9. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
  10. 2025Do generative video models understand physical principles?cited by 161
  11. 2019Hamiltonian Generative Networkscited by 137
  12. 2025Training Agents Inside of Scalable World Modelscited by 136
16 more
  1. 2024Physics-Informed Diffusion Modelscited by 90
  2. 2023STORM: Efficient Stochastic Transformer based World Models for Reinforcement Learningcited by 89
  3. 2021DreamerPro: Reconstruction-Free Model-Based Reinforcement Learning with Prototypical Representationscited by 74
  4. 2021Fast and Efficient Locomotion via Learned Gait Transitionscited by 54
  5. 2023SafeDreamer: Safe Reinforcement Learning with World Modelscited by 54
  6. 2025RoboScape: Physics-informed Embodied World Modelcited by 40
  7. 2025T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generationcited by 39
  8. 2024SOLD: Slot Object-Centric Latent Dynamics Models for Relational Manipulation Learning from Pixelscited by 24
  9. 2025PIN-WM: Learning Physics-INformed World Models for Non-Prehensile Manipulationcited by 22
  10. 2024Learning Latent Dynamic Robust Representations for World Modelscited by 21
  11. 2020Learning Physical Constraints with Neural Projectionscited by 19
  12. 2022Physics-Informed Model-Based Reinforcement Learningcited by 18
  13. 2024Learning to Walk from Three Minutes of Real-World Data with Semi-structured Dynamics Modelscited by 16
  14. 2026R2-Dreamer: Redundancy-Reduced World Models without Decoders or Augmentationcited by 10
  15. 2023Task Aware Dreamer for Task Generalization in Reinforcement Learningcited by 5
  16. 2025TransDreamerV3: Implanting Transformer In DreamerV3cited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Physically Native World Models: A Hamiltonian Perspective on Generative World Modeling
  2. 2026LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observations
  3. 2026Koopman Dreamer: Spectrally Constrained Latent Dynamics for Stable World-Model Imagination
  4. 2026WALL-SS: Scaling Long-horizon World Models via Next-Scale Autoregression
  5. 2025Dynamics-Aligned Latent Imagination in Contextual World Models for Zero-Shot Generalization
  6. 2026Unlocking Temporal Generalization in Hamiltonian Video Dynamics Models
  7. 2026Generative World Models Enable Predictive Control of Laser Melt Pool Dynamics
  8. 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models