mlsanityData to 14 Oct 2026

Frozen Flows Forget: Diagnosing and Restoring Lost Motion in a Latent-flow World Model

arXiv 2609.28414 ↗First posted 23 Sep 2026cs.CV cs.AI cs.ROcited by 0

On the map: World models → Latent predictive world models

Abstract (arXiv)

Latent world models that integrate a flow in a frozen self supervised latent space train stably and cheaply, yet silently lose the property manipulation depends on most: motion. The pretrained flow never moves the manipulated object; retraining it with latent-only losses only trades stillness for teleport-like motion. We trace the failure to the training signal, not the representation: anchor-sparse, latent-only supervision never says where along the horizon change belongs. Decode-augmented rollout training (DART) repairs this while keeping the representation frozen, retraining only the flow with decode-path supervision. DART outperforms its latent only parent on the full protocol, restores the temporal structure of motion, and re-couples predicted motion to the scene; at larger scale it further improves prediction quality, closing nearly half the remaining gap to an oracle-informed interpolation reference. Finally, we report an unexpected finding about evaluation: pixel error alone rewards frozen predictions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 13 of its 16 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

13 of 16 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026ODEWorld: A Continuous Predictive Architecture via Physical-Time Flow30 Jul

Other references · 12

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  4. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  6. 2024Genie: Generative Interactive Environmentscited by 747
  7. 2015Deep multi-scale video prediction beyond mean square errorcited by 300
  8. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
  9. 2024Diffusion Models Are Real-Time Game Enginescited by 296
  10. 2017Stochastic Variational Video Predictioncited by 234
  11. 2018Stochastic Adversarial Video Predictioncited by 173
  12. 2026What Makes Video World Model Latents Action-Relevant: Prediction over Reconstructioncited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026LeFlow: Generative Latent Flow Planning for World Models
  2. 2026FlowS: One-Step Motion Prediction via Local Transport Conditioning
  3. 2026Flow Equivariant World Models: Memory for Partially Observed Dynamic Environments
  4. 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution
  5. 2026FlowMo-WM: A World Model with Object Momentum and Hidden Ambient Drift
  6. 2026Correcting a learned physical invariant improves world-model rollouts
  7. 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation
  8. 2026Beyond One-Step Accuracy: State-Affine Latent Transition for Reliable Visual Planning