MOSH-WM: Mask-Grounded Soft-Hamiltonian Dynamics for Object-Centric World Models
On the map: World models → Latent predictive world models
Abstract (arXiv)
Object-centric world models forecast future videos by evolving a set of entity slots, but the variables receiving dynamics supervision are often unconstrained visual features. We introduce method, a mask-grounded soft-Hamiltonian world model that makes its position-like state explicitly depend on slot-owned image support. A frozen video-slot encoder produces slots and masks; spatial moments of mask-owned support form a canonical state Q, temporal differences form P, and a learned energy supplies a soft directional bias to a bounded learned increment. Decoder-relevant appearance and identity are stored separately in a causal visual context. A gated composer and bounded residual then combine this context with the propagated phase state to reconstruct decoder-compatible slots. On OBJ3D, given six observed frames and evaluated over the following 30 frames, method reduces LPIPS by 25.0% and spatial MSE by 33.7% relative to the strongest object-centric baseline. On CLEVRER, given six observed frames and evaluated over the following ten frames, the corresponding reductions are 14.5% and 18.7%. Horizon-resolved visual and object-state measurements show that the complete model accumulates error more slowly throughout the 30-frame closed-loop rollout. Project page:https://github.com/moshwm-anon/-moshwm-anon.github.io.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 33 of its 36 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
33 of 36 references.
Closest ancestors · 4
Same direction, newest first
- 2026HaM-World: Soft-Hamiltonian World Models with Selective Memory for Planning7 May
- 2021Conditional Object-Centric Learning from Video24 Nov
- 2019Contrastive Learning of Structured World Models27 Nov
- 2018Learning Latent Dynamics for Planning from Pixels12 Nov
Other references · 29
- 2017Attention Is All You Needcited by 60,361
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018World Modelscited by 1,513
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2020Object-Centric Learning with Slot Attentioncited by 876
- 2019Hamiltonian Neural Networkscited by 712
17 more
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 484
- 2020Lagrangian Neural Networkscited by 398
- 2019MONet: Unsupervised Scene Decomposition and Representationcited by 392
- 2019Multi-Object Representation Learning with Iterative Variational Inferencecited by 360
- 2019GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representationscited by 227
- 2022Bridging the Gap to Real-World Object-Centric Learningcited by 220
- 2019Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learningcited by 212
- 2016Attend, Infer, Repeat: Fast Scene Understanding with Generative Modelscited by 209
- 2022SimVP: Simpler yet Better Video Predictioncited by 184
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 182
- 2017Decomposing Motion and Content for Natural Video Sequence Predictioncited by 169
- 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 147
- 2019Hamiltonian Generative Networkscited by 137
- 2019Entity Abstraction in Visual Model-Based Reinforcement Learningcited by 110
- 2017Visual Interaction Networkscited by 95
- 2020Improving Generative Imagination in Object-Centric World Modelscited by 71
- 2019Unsupervised Discovery of Parts, Structure, and Dynamicscited by 20
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HCLSM: Hierarchical Causal Latent State Machines for Object-Centric World Modeling
- 2026Render, Don't Decode: Weight-Space World Models with Latent Structural Disentanglement
- 2026A Frame is Worth One Token: Efficient Generative World Modeling with Delta Tokens
- 2026MiniWorld: Democratizing the Training of Video World Models from Scratch
- 2026Flow Equivariant World Models: Memory for Partially Observed Dynamic Environments
- 2026Flex-π: A Multi-Stream World-Action Model with Compute Flexibility
- 2025From Masks to Worlds: A Hitchhiker's Guide to World Models
- 2025Back to the Features: DINO as a Foundation for Video World Models