FreqForcing: Autoregressive Long Video Generation via Spectral Self-Anchoring
On the map: Diffusion models → Video generation
Abstract (arXiv)
Autoregressive video diffusion models enable real-time streaming video generation. However, errors introduced during self-rollout accumulate over long horizons, manifesting as color drift, motion stagnation, and eventual visual collapse. In this paper, we characterize this phenomenon from a frequency-domain perspective: error accumulation appears as a pronounced energy drift in the low-frequency bands. We further investigate the effectiveness of attention sink in the frequency domain, and find that it improves the video quality by alleviating the spectral energy drift to some extent, but cannot fully resolve it. Motivated by the above analysis, we propose FreqForcing, a training-free framework that addresses error accumulation in long-video generation via Spectral Self-Anchoring (SSA). The proposed SSA leverages the low-frequency components of anchor attention to maintain long-horizon visual stability, while preserving dynamic motion through the high-frequency components of local attention. Our FreqForcing extends Self-Forcing pretrained on 5s clips to two-minute generation, achieving 24x extrapolation. Extensive experiments show that FreqForcing outperforms existing training-free methods quantitatively and qualitatively while remaining competitive with representative training-based approaches.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 29 of its 33 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
29 of 33 references.
Closest ancestors · 11
Same direction, newest first
- 2026FreeSpec: Training-Free Long Video Generation via Singular-Spectrum Reconstruction7 May
- 2026Train Short, Inference Long: Training-free Horizon Extension for Autoregressive Video Generation15 Feb
- 2026Rolling Sink: Bridging Limited-Horizon Training and Open-Ended Testing in Autoregressive Video Diffusion8 Feb
- 2025Deep Forcing: Training-Free Long Video Generation with Deep Sink and Participative Compression4 Dec
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rollout25 Nov
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generation2 Oct
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
- 2025SkyReels-V2: Infinite-length Film Generative Model17 Apr
- 2024Autoregressive Video Generation without Vector Quantization18 Dec
- 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attention29 Jul
Other references · 18
- 2017Attention Is All You Needcited by 59,932
- 2025Qwen3 Technical Reportcited by 8,195
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2024Genie: Generative Interactive Environmentscited by 706
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
6 more
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2024When Attention Sink Emerges in Language Models: An Empirical Viewcited by 200
- 2023FreeU: Free Lunch in Diffusion U-Netcited by 195
- 2025HunyuanVideo 1.5 Technical Reportcited by 148
- 2025Dialogue Without Limits: Constant-Sized KV Caches for Extended Responses in LLMscited by 20
- 2025FreeLong++: Training-Free Long Video Generation via Multi-band SpectralFusioncited by 15
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026SAGA: Stable Acceleration Guidance for Autoregressive Video Generation
- 2026Self-Aligned Forcing: Streaming Video Diffusion with Differentiable Noisy History
- 2025VideoSSM: Autoregressive Long Video Generation with Hybrid State-Space Memory
- 2026AdaState: Self-Evolving Anchors for Streaming Video Generation
- 2026Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model
- 2026Towards Error-Free Long Video Generation
- 2024Progressive Autoregressive Video Diffusion Models
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation