Diagnosing Under-Development of Irreversible Processes in Video Generation
Not on the map. Why?
Abstract (arXiv)
Many physical attributes are irreversible: ice melts but does not re-freeze, paper chars but does not un-burn. Do video generators respect this? We show the question is hard to measure, and that what can be measured reliably is development rather than reversal. Metrics of local reversal are null-degenerate: a per-clip violation rate scores 0.50 on pure noise, and a variance-normalized reversal residual sits at its noise ceiling. What survives null-testing is a two-part protocol: progress (a directional attribute correlation) and a stasis rate. Under this protocol, generated video separates cleanly from real footage, and the gap is human-validated. Across seven text-to-video models, real reference footage advances (ρ=+0.40, 35% static) while every generator shows near-zero progress and 92--100% stasis; nine annotators rate real footage far above generated (2.75 vs. 0.99 on a 0--4 scale). The reliable finding is under-development: generators barely advance irreversible attributes rather than reversing them. As a complementary mechanism, we show that post-hoc readout guidance is gameable, whereas enforcing monotonicity by construction in a disentangled attribute latent removes the gameable readout, validated in controlled and semi-synthetic settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 34 references that are in the map. First posted on arXiv 1 Aug 2026.
Builds on
31 of 34 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,056
- 2020Concept Bottleneck Modelscited by 1,022
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2023Adversarial Diffusion Distillationcited by 741
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
19 more
- 2025Do generative video models understand physical principles?cited by 151
- 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 116
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
- 2024Constrained Synthesis with Projected Diffusion Modelscited by 83
- 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 74
- 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 49
- 2021Representation Learning via Global Temporal Alignment and Cycle-Consistencycited by 43
- 2022Look for the Change: Learning Object States and State-Modifying Actions from Untrimmed Web Videoscited by 39
- 2023GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videoscited by 39
- 2019Learning Dynamical Systems from Partial Observationscited by 36
- 2022Constrained Monotonic Neural Networkscited by 31
- 2025Seeing the Arrow of Time in Large Multimodal Modelscited by 28
- 2023VideoDreamer: Customized Multi-Subject Text-to-Video Generation with Disen-Mix Finetuning on Language-Video Foundation Modelscited by 16
- 2026Physical Simulator In-the-Loop Video Generationcited by 12
- 2026Phantom: Physics-Infused Video Generation via Joint Modeling of Visual and Latent Physical Dynamicscited by 10
- 2022Invertible Monotone Operators for Normalizing Flowscited by 6
- 2022AUTM Flow: Atomic Unrestricted Time Machine for Monotonic Normalizing Flowscited by 5
- 2026OSCBench: Benchmarking Object State Change in Text-to-Video Generationcited by 3
- 2025FluencyVE: Marrying Temporal-Aware Mamba with Bypass Attention for Video Editingcited by 2
Built on by
Not cited yet.