Frozen Flows Forget: Diagnosing and Restoring Lost Motion in a Latent-flow World Model
On the map: World models → Latent predictive world models
Abstract (arXiv)
Latent world models that integrate a flow in a frozen self supervised latent space train stably and cheaply, yet silently lose the property manipulation depends on most: motion. The pretrained flow never moves the manipulated object; retraining it with latent-only losses only trades stillness for teleport-like motion. We trace the failure to the training signal, not the representation: anchor-sparse, latent-only supervision never says where along the horizon change belongs. Decode-augmented rollout training (DART) repairs this while keeping the representation frozen, retraining only the flow with decode-path supervision. DART outperforms its latent only parent on the full protocol, restores the temporal structure of motion, and re-couples predicted motion to the scene; at larger scale it further improves prediction quality, closing nearly half the remaining gap to an oracle-informed interpolation reference. Finally, we report an unexpected finding about evaluation: pixel error alone rewards frozen predictions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 13 of its 16 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
13 of 16 references.
Closest ancestors · 1
Same direction, newest first
Other references · 12
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2024Genie: Generative Interactive Environmentscited by 747
- 2015Deep multi-scale video prediction beyond mean square errorcited by 300
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2024Diffusion Models Are Real-Time Game Enginescited by 296
- 2017Stochastic Variational Video Predictioncited by 234
- 2018Stochastic Adversarial Video Predictioncited by 173
- 2026What Makes Video World Model Latents Action-Relevant: Prediction over Reconstructioncited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LeFlow: Generative Latent Flow Planning for World Models
- 2026FlowS: One-Step Motion Prediction via Local Transport Conditioning
- 2026Flow Equivariant World Models: Memory for Partially Observed Dynamic Environments
- 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution
- 2026FlowMo-WM: A World Model with Object Momentum and Hidden Ambient Drift
- 2026Correcting a learned physical invariant improves world-model rollouts
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation
- 2026Beyond One-Step Accuracy: State-Affine Latent Transition for Reliable Visual Planning