mlsanityData to 14 Oct 2026

LoL: Longer than Longer, Scaling Video Generation to Hour

arXiv 2601.16914 ↗First posted 23 Jan 2026cs.CV cs.AIcited by 32

Not on the map. Why?

Abstract (arXiv)

Recent research in long-form video generation has shifted from bidirectional to autoregressive models, yet these methods commonly suffer from error accumulation and a loss of long-term coherence. While attention sink frames have been introduced to mitigate this performance decay, they often induce a critical failure mode we term sink-collapse: the generated content repeatedly reverts to the sink frame, resulting in abrupt scene resets and cyclic motion patterns. Our analysis reveals that sink-collapse originates from an inherent conflict between the periodic structure of Rotary Position Embedding (RoPE) and the multi-head attention mechanisms prevalent in current generative models. To address it, we propose a lightweight, training-free approach that effectively suppresses this behavior by introducing multi-head RoPE jitter that breaks inter-head attention homogenization and mitigates long-horizon collapse. Extensive experiments show that our method successfully alleviates sink-collapse while preserving generation quality. To the best of our knowledge, this work achieves the first demonstration of real-time, streaming, and infinite-length video generation with little quality decay. As an illustration of this robustness, we generate continuous videos up to 12 hours in length, which, to our knowledge, is among the longest publicly demonstrated results in streaming video generation.

Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 47 of its 50 references that are in the map. First posted on arXiv 23 Jan 2026.

Builds on

47 of 50 references.

References · 47

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  8. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
  9. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  10. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  11. 2018Self-Attention with Relative Position Representationscited by 1,120
  12. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
35 more
  1. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  2. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
  3. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  4. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  5. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  6. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  7. 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 601
  8. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  9. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
  10. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  11. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
  12. 2025LongLive: Real-time Interactive Long Video Generationcited by 265
  13. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  14. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
  15. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 229
  16. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
  17. 2024Autoregressive Video Generation without Vector Quantizationcited by 186
  18. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
  19. 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 163
  20. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
  21. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
  22. 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 96
  23. 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformercited by 94
  24. 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 90
  25. 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 86
  26. 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 86
  27. 2025LongCat-Video Technical Reportcited by 85
  28. 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 73
  29. 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 66
  30. 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resamplingcited by 52
  31. 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 48
  32. 2025ATI: Any Trajectory Instruction for Controllable Video Generationcited by 43
  33. 2025LoViC: Efficient Long Video Generation with Context Compressioncited by 19
  34. 2025InfLVG: Reinforce Inference-Time Consistent Long Video Generation with GRPOcited by 15
  35. 2025TinyHistory: Lightweight Video History Embeddings via Two-Stage Context Learningcited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 32.

32 papers.

Sort:

By area:

  1. 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
  2. 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 30
  3. 2026MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokenscited by 27
  4. 2026Flow caching for autoregressive video generationcited by 25
  5. 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generationcited by 24
  6. 2026Anchor Forcing: Anchor Memory and Tri-Region RoPE for Interactive Streaming Video Diffusioncited by 16
  7. 2026LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generationcited by 16
  8. 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPUcited by 16
  9. 2026Pathwise Test-Time Correction for Autoregressive Long Video Generationcited by 15
  10. 2026Forcing-KV: Hybrid KV Cache Compression for Efficient Autoregressive Video Diffusion Modelscited by 15
  11. 2026Addressable Memory for Video World Modelscited by 15
  12. 2026SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformercited by 11
20 more
  1. 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narrativescited by 10
  2. 2026RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPOcited by 7
  3. 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generationcited by 7
  4. 2026DySink: Dynamic Frame Sinks for Autoregressive Long Video Generationcited by 6
  5. 2026Head Forcing: Long Autoregressive Video Generation via Head Heterogeneitycited by 5
  6. 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillationcited by 5
  7. 2026GeoStream: Toward Precise Camera Controlled Streaming Video Generationcited by 4
  8. 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytellingcited by 4
  9. 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Modelscited by 3
  10. 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generationcited by 3
  11. 2026DCARL: A Divide-and-Conquer Framework for Autoregressive Long-Trajectory Video Generationcited by 2
  12. 2026Audio-Visual Intelligence in Large Foundation Modelscited by 2
  13. 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memorycited by 2
  14. 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Modelscited by 1
  15. 2026Progression as Latent Drift: Generative Forecasting of Slow-Evolving Pathologiescited by 0
  16. 2026Test-Time Noise Guided Adaptation for Realistic Autoregressive Video Generationcited by 0
  17. 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillationcited by 0
  18. 2026Recency Forcing: Bridging the Long-Horizon Gap in Autoregressive Video Generationcited by 0
  19. 2026Prospective Forcing: Learning to Look Ahead for Autoregressive Long Video Diffusioncited by 0
  20. 2026LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rolloutcited by 0