LoL: Longer than Longer, Scaling Video Generation to Hour
Not on the map. Why?
Abstract (arXiv)
Recent research in long-form video generation has shifted from bidirectional to autoregressive models, yet these methods commonly suffer from error accumulation and a loss of long-term coherence. While attention sink frames have been introduced to mitigate this performance decay, they often induce a critical failure mode we term sink-collapse: the generated content repeatedly reverts to the sink frame, resulting in abrupt scene resets and cyclic motion patterns. Our analysis reveals that sink-collapse originates from an inherent conflict between the periodic structure of Rotary Position Embedding (RoPE) and the multi-head attention mechanisms prevalent in current generative models. To address it, we propose a lightweight, training-free approach that effectively suppresses this behavior by introducing multi-head RoPE jitter that breaks inter-head attention homogenization and mitigates long-horizon collapse. Extensive experiments show that our method successfully alleviates sink-collapse while preserving generation quality. To the best of our knowledge, this work achieves the first demonstration of real-time, streaming, and infinite-length video generation with little quality decay. As an illustration of this robustness, we generate continuous videos up to 12 hours in length, which, to our knowledge, is among the longest publicly demonstrated results in streaming video generation.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 47 of its 50 references that are in the map. First posted on arXiv 23 Jan 2026.
Builds on
47 of 50 references.
References · 47
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2018Self-Attention with Relative Position Representationscited by 1,120
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
35 more
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 601
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 229
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
- 2024Autoregressive Video Generation without Vector Quantizationcited by 186
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 163
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
- 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 96
- 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformercited by 94
- 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 90
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 86
- 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 86
- 2025LongCat-Video Technical Reportcited by 85
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 73
- 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 66
- 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resamplingcited by 52
- 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 48
- 2025ATI: Any Trajectory Instruction for Controllable Video Generationcited by 43
- 2025LoViC: Efficient Long Video Generation with Context Compressioncited by 19
- 2025InfLVG: Reinforce Inference-Time Consistent Long Video Generation with GRPOcited by 15
- 2025TinyHistory: Lightweight Video History Embeddings via Two-Stage Context Learningcited by 15
Built on by
Citing papers per year: 2026: 32.
32 papers.
Sort:
By area:
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 30
- 2026MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokenscited by 27
- 2026Flow caching for autoregressive video generationcited by 25
- 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generationcited by 24
- 2026Anchor Forcing: Anchor Memory and Tri-Region RoPE for Interactive Streaming Video Diffusioncited by 16
- 2026LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generationcited by 16
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPUcited by 16
- 2026Pathwise Test-Time Correction for Autoregressive Long Video Generationcited by 15
- 2026Forcing-KV: Hybrid KV Cache Compression for Efficient Autoregressive Video Diffusion Modelscited by 15
- 2026Addressable Memory for Video World Modelscited by 15
- 2026SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformercited by 11
20 more
- 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narrativescited by 10
- 2026RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPOcited by 7
- 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generationcited by 7
- 2026DySink: Dynamic Frame Sinks for Autoregressive Long Video Generationcited by 6
- 2026Head Forcing: Long Autoregressive Video Generation via Head Heterogeneitycited by 5
- 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillationcited by 5
- 2026GeoStream: Toward Precise Camera Controlled Streaming Video Generationcited by 4
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytellingcited by 4
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Modelscited by 3
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generationcited by 3
- 2026DCARL: A Divide-and-Conquer Framework for Autoregressive Long-Trajectory Video Generationcited by 2
- 2026Audio-Visual Intelligence in Large Foundation Modelscited by 2
- 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memorycited by 2
- 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Modelscited by 1
- 2026Progression as Latent Drift: Generative Forecasting of Slow-Evolving Pathologiescited by 0
- 2026Test-Time Noise Guided Adaptation for Realistic Autoregressive Video Generationcited by 0
- 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillationcited by 0
- 2026Recency Forcing: Bridging the Long-Horizon Gap in Autoregressive Video Generationcited by 0
- 2026Prospective Forcing: Learning to Look Ahead for Autoregressive Long Video Diffusioncited by 0
- 2026LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rolloutcited by 0
- 2026LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rollout13 Oct 2026
- 2026Prospective Forcing: Learning to Look Ahead for Autoregressive Long Video Diffusion10 Oct 2026
- 2026Recency Forcing: Bridging the Long-Horizon Gap in Autoregressive Video Generation17 Sep 2026
- 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation10 Sep 2026
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generation27 Aug 2026
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Models26 Aug 2026
- 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation13 Aug 2026
- 2026Addressable Memory for Video World Models7 Aug 2026
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling29 Jul 2026
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul 2026
- 2026Test-Time Noise Guided Adaptation for Realistic Autoregressive Video Generation17 Jul 2026
- 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Models10 Jul 2026
20 more
- 2026Progression as Latent Drift: Generative Forecasting of Slow-Evolving Pathologies9 Jul 2026
- 2026GeoStream: Toward Precise Camera Controlled Streaming Video Generation13 Jun 2026
- 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation6 Jun 2026
- 2026LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generation1 Jun 2026
- 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory29 May 2026
- 2026SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer28 May 2026
- 2026DySink: Dynamic Frame Sinks for Autoregressive Long Video Generation20 May 2026
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generation18 May 2026
- 2026RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPO14 May 2026
- 2026Head Forcing: Long Autoregressive Video Generation via Head Heterogeneity14 May 2026
- 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narratives12 May 2026
- 2026Forcing-KV: Hybrid KV Cache Compression for Efficient Autoregressive Video Diffusion Models10 May 2026
- 2026Audio-Visual Intelligence in Large Foundation Models5 May 2026
- 2026DCARL: A Divide-and-Conquer Framework for Autoregressive Long-Trajectory Video Generation25 Mar 2026
- 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generation22 Mar 2026
- 2026Anchor Forcing: Anchor Memory and Tri-Region RoPE for Interactive Streaming Video Diffusion12 Mar 2026
- 2026MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokens12 Mar 2026
- 2026Helios: Real Real-Time Long Video Generation Model4 Mar 2026
- 2026Flow caching for autoregressive video generation11 Feb 2026
- 2026Pathwise Test-Time Correction for Autoregressive Long Video Generation5 Feb 2026
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 30
- 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generationcited by 24
- 2026Anchor Forcing: Anchor Memory and Tri-Region RoPE for Interactive Streaming Video Diffusioncited by 16
- 2026Pathwise Test-Time Correction for Autoregressive Long Video Generationcited by 15
- 2026Forcing-KV: Hybrid KV Cache Compression for Efficient Autoregressive Video Diffusion Modelscited by 15
- 2026SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformercited by 11
- 2026RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPOcited by 7
- 2026Head Forcing: Long Autoregressive Video Generation via Head Heterogeneitycited by 5
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytellingcited by 4
- 2026Test-Time Noise Guided Adaptation for Realistic Autoregressive Video Generationcited by 0
- 2026Prospective Forcing: Learning to Look Ahead for Autoregressive Long Video Diffusioncited by 0
- 2026Prospective Forcing: Learning to Look Ahead for Autoregressive Long Video Diffusion10 Oct 2026
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling29 Jul 2026
- 2026Test-Time Noise Guided Adaptation for Realistic Autoregressive Video Generation17 Jul 2026
- 2026SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer28 May 2026
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generation18 May 2026
- 2026RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPO14 May 2026
- 2026Head Forcing: Long Autoregressive Video Generation via Head Heterogeneity14 May 2026
- 2026Forcing-KV: Hybrid KV Cache Compression for Efficient Autoregressive Video Diffusion Models10 May 2026
- 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generation22 Mar 2026
- 2026Anchor Forcing: Anchor Memory and Tri-Region RoPE for Interactive Streaming Video Diffusion12 Mar 2026
- 2026Pathwise Test-Time Correction for Autoregressive Long Video Generation5 Feb 2026
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPUcited by 16
- 2026Addressable Memory for Video World Modelscited by 15
- 2026GeoStream: Toward Precise Camera Controlled Streaming Video Generationcited by 4
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Modelscited by 3
- 2026DCARL: A Divide-and-Conquer Framework for Autoregressive Long-Trajectory Video Generationcited by 2
- 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memorycited by 2
- 2026LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rolloutcited by 0
- 2026LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rollout13 Oct 2026
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Models26 Aug 2026
- 2026Addressable Memory for Video World Models7 Aug 2026
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul 2026
- 2026GeoStream: Toward Precise Camera Controlled Streaming Video Generation13 Jun 2026
- 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory29 May 2026
- 2026DCARL: A Divide-and-Conquer Framework for Autoregressive Long-Trajectory Video Generation25 Mar 2026
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
- 2026MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokenscited by 27
- 2026Flow caching for autoregressive video generationcited by 25
- 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narrativescited by 10
- 2026DySink: Dynamic Frame Sinks for Autoregressive Long Video Generationcited by 6
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generationcited by 3
- 2026Audio-Visual Intelligence in Large Foundation Modelscited by 2
- 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Modelscited by 1
- 2026Progression as Latent Drift: Generative Forecasting of Slow-Evolving Pathologiescited by 0
- 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillationcited by 0
- 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation10 Sep 2026
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generation27 Aug 2026
- 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Models10 Jul 2026
- 2026Progression as Latent Drift: Generative Forecasting of Slow-Evolving Pathologies9 Jul 2026
- 2026DySink: Dynamic Frame Sinks for Autoregressive Long Video Generation20 May 2026
- 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narratives12 May 2026
- 2026Audio-Visual Intelligence in Large Foundation Models5 May 2026
- 2026MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokens12 Mar 2026
- 2026Helios: Real Real-Time Long Video Generation Model4 Mar 2026
- 2026Flow caching for autoregressive video generation11 Feb 2026