Temporal State Transport in Video Generation: Diagnosing and Correcting Spectral Imbalance
Not on the map. Why?
Abstract (arXiv)
Reliable video generation requires more than high-quality frames to form a coherent story: a model must maintain a persistent state, transporting visual attributes such as identity, scene layout, motion, and fine details across time. Existing training-free methods mainly strengthen cross-frame attention or analyze local attention entropy, but these views do not reveal whether temporal interactions stay in a healthy transport regime. In this work, we study video generation through the perspective of Temporal State Transport. We introduce Spectral Tension, a signed diagnostic that compares local attention diffuseness with global spectral diversity, and use it to identify two opposite temporal failures: fragmented transport and over-mixing hotspots. Based on this diagnosis, we propose Spectral Transport Homeostasis, a training-free regulator that softly corrects pathological temporal states while largely preserving balanced ones. Experiments on pretrained video generation models show that the original model often occupies imbalanced temporal regimes, whereas our method selectively applies larger corrections to the worst temporal hotspots and improves temporal consistency and visual quality without finetuning. Code: https://github.com/lytang63/temporal-state-transport
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 32 references that are in the map. First posted on arXiv 8 Sep 2026.
Builds on
27 of 32 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 302
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
- 2023FreeU: Free Lunch in Diffusion U-Netcited by 196
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 183
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
15 more
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 89
- 2015Describing Videos by Exploiting Temporal Structurecited by 88
- 2021Space-time Mixing Attention for Video Transformercited by 84
- 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 64
- 2023Hierarchical Spatio-temporal Decoupling for Text-to-Video Generationcited by 50
- 2018Why Self-Attention? A Targeted Evaluation of Neural Machine Translation Architecturescited by 30
- 2025Mask2DiT: Dual Mask-based Diffusion Transformer for Multi-Scene Long Video Generationcited by 25
- 2023Denoising Diffusion Step-aware Modelscited by 24
- 2025Through-The-Mask: Mask-based Motion Trajectories for Image-to-Video Generationcited by 20
- 2025Training-Free Motion-Guided Video Generation with Enhanced Temporal Consistency Using Motion Consistency Losscited by 15
- 2025Towards Better & Faster Autoregressive Image Generation: From the Perspective of Entropycited by 12
- 2025Enhance-A-Video: Better Generated Video for Freecited by 11
- 2024Rethinking Human Evaluation Protocol for Text-to-Video Models: Enhancing Reliability,Reproducibility, and Practicalitycited by 4
- 2025Context Guided Transformer Entropy Modeling for Video Compressioncited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.