mlsanityData to 7 Oct 2026

OneWorld: Learning Consistent Physics Across Actions in World Models

arXiv 2609.30946 ↗First posted 25 Sep 2026cs.CV cs.AIcited by 0

On the map: World models → Latent predictive world models also fits: Embodied and robot world models

Abstract (arXiv)

Action-conditioned video world models aim to predict scene evolution under different actions, a capability that is essential for reliable planning, decision-making, and interaction in dynamic environments. However, futures generated independently from the same initial scene may each appear plausible while implying incompatible physical properties, such as friction or mass. This inconsistency can lead to contradictory predictions across interventions, making it difficult for the model to maintain a coherent understanding of the underlying world and limiting its reliability for planning and decision-making. To address these issues, we propose OneWorld, a shared-mechanism counterfactual generation framework that jointly models multiple action-conditioned futures under a common latent physical mechanism. A physical mechanism interpreter first infers a distribution over latent mechanisms from each action-outcome branch. These distributions are then aggregated into shared-world evidence, which captures whether the branches admit a common physical explanation while accounting for uncertainty in less informative branches. This evidence constrains flow training and guides sampling, encouraging consistency in the underlying physical mechanism while preserving the distinct outcomes induced by different actions. We further introduce a multi-intervention evaluation protocol in controlled environments, following the interaction settings of ACWM-Phys, to assess whether generated futures can be jointly explained by the same physical parameters, alongside standard measures of single-rollout prediction quality. Experiments in these environments show that OneWorld improves cross-intervention physical consistency while maintaining competitive single-rollout prediction quality.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 20 of its 21 references that are in the map. First posted on arXiv 25 Sep 2026.

Builds on

20 of 21 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026ACWM-Phys: Investigating Generalized Physical Interaction in Action-Conditioned Video World Models9 May
  2. 2022Temporal Difference Learning for Model Predictive Control9 Mar

Other references · 18

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  5. 2022Video Diffusion Modelscited by 2,280
  6. 2024Genie: Generative Interactive Environmentscited by 706
  7. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
  8. 2023Learning Interactive Real-World Simulatorscited by 440
  9. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  10. 2025Do generative video models understand physical principles?cited by 151
  11. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 149
  12. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
6 more
  1. 2019CoPhy: Counterfactual Learning of Physical Dynamicscited by 80
  2. 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 67
  3. 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 40
  4. 2025ProPhy: Progressive Physical Alignment for Dynamic World Simulationcited by 11
  5. 2026Overcoming Statistical Bias in Action-Controllable World Modelscited by 4
  6. 2026Twin Rollouts: Noise-Coupled Counterfactual Branching in Interactive Video World Modelscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observations
  2. 2026Foresight Without Seeing: Latent Futures for World Action Models
  3. 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
  4. 2026MultiEcho: An Experimental Science of Learned Worlds
  5. 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining
  6. 2026Physically Native World Models: A Hamiltonian Perspective on Generative World Modeling
  7. 2026ω-EVA: Envision, Verify, and Act with Latent Interactive World Models
  8. 2026WALL-SS: Scaling Long-horizon World Models via Next-Scale Autoregression