mlsanityData to 14 Oct 2026

Temporal State Transport in Video Generation: Diagnosing and Correcting Spectral Imbalance

arXiv 2609.08505 ↗First posted 8 Sep 2026cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Reliable video generation requires more than high-quality frames to form a coherent story: a model must maintain a persistent state, transporting visual attributes such as identity, scene layout, motion, and fine details across time. Existing training-free methods mainly strengthen cross-frame attention or analyze local attention entropy, but these views do not reveal whether temporal interactions stay in a healthy transport regime. In this work, we study video generation through the perspective of Temporal State Transport. We introduce Spectral Tension, a signed diagnostic that compares local attention diffuseness with global spectral diversity, and use it to identify two opposite temporal failures: fragmented transport and over-mixing hotspots. Based on this diagnosis, we propose Spectral Transport Homeostasis, a training-free regulator that softly corrects pathological temporal states while largely preserving balanced ones. Experiments on pretrained video generation models show that the original model often occupies imbalanced temporal regimes, whereas our method selectively applies larger corrections to the worst temporal hotspots and improves temporal consistency and visual quality without finetuning. Code: https://github.com/lytang63/temporal-state-transport

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 32 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

27 of 32 references.

References · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  4. 2023ModelScope Text-to-Video Technical Reportcited by 658
  5. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  6. 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 302
  7. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
  8. 2023FreeU: Free Lunch in Diffusion U-Netcited by 196
  9. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 183
  10. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
  11. 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
  12. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
15 more
  1. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
  2. 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 89
  3. 2015Describing Videos by Exploiting Temporal Structurecited by 88
  4. 2021Space-time Mixing Attention for Video Transformercited by 84
  5. 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 64
  6. 2023Hierarchical Spatio-temporal Decoupling for Text-to-Video Generationcited by 50
  7. 2018Why Self-Attention? A Targeted Evaluation of Neural Machine Translation Architecturescited by 30
  8. 2025Mask2DiT: Dual Mask-based Diffusion Transformer for Multi-Scene Long Video Generationcited by 25
  9. 2023Denoising Diffusion Step-aware Modelscited by 24
  10. 2025Through-The-Mask: Mask-based Motion Trajectories for Image-to-Video Generationcited by 20
  11. 2025Training-Free Motion-Guided Video Generation with Enhanced Temporal Consistency Using Motion Consistency Losscited by 15
  12. 2025Towards Better & Faster Autoregressive Image Generation: From the Perspective of Entropycited by 12
  13. 2025Enhance-A-Video: Better Generated Video for Freecited by 11
  14. 2024Rethinking Human Evaluation Protocol for Text-to-Video Models: Enhancing Reliability,Reproducibility, and Practicalitycited by 4
  15. 2025Context Guided Transformer Entropy Modeling for Video Compressioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.