mlsanityData to 7 Oct 2026

Train Short, Inference Long: Training-free Horizon Extension for Autoregressive Video Generation

arXiv 2602.14027 ↗First posted 15 Feb 2026cs.CVcited by 9

On the map: Diffusion models → Video generation

Abstract (arXiv)

Autoregressive video diffusion models have emerged as a scalable paradigm for long video generation. However, they often suffer from severe extrapolation failure, where rapid error accumulation leads to significant temporal degradation when extending beyond training horizons. We identify that this failure primarily stems from the spectral bias of 3D positional embeddings and the lack of dynamic priors in noise sampling. To address these issues, we propose FLEX (Frequency-aware Length EXtension), a training-free inference-time framework that bridges the gap between short-term training and long-term inference. FLEX introduces Frequency-aware RoPE Modulation to adaptively interpolate under-trained low-frequency components while extrapolating high-frequency ones to preserve multi-scale temporal discriminability. This is integrated with Antiphase Noise Sampling (ANS) to inject high-frequency dynamic priors and Inference-only Attention Sink to anchor global structure. Extensive evaluations on VBench demonstrate that FLEX significantly outperforms state-of-the-art models at 6x extrapolation (30s duration) and matches the performance of long-video fine-tuned baselines at 12x scale (60s duration). As a plug-and-play augmentation, FLEX seamlessly integrates into existing inference pipelines for horizon extension. It effectively pushes the generation limits of models such as LongLive, supporting consistent and dynamic video synthesis at a 4-minute scale. Project page is available at https://ga-lee.github.io/FLEX_demo.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 30 of its 34 references that are in the map. First posted on arXiv 15 Feb 2026.

Builds on

30 of 34 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rollout25 Nov
  2. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
  3. 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer29 Sep
  4. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
  5. 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusion10 Mar
  6. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  8. 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Rescheduling23 Oct
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul

Other references · 21

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  4. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  6. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  8. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,085
  9. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  10. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
  11. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  12. 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 584
9 more
  1. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
  2. 2024LongRoPE: Extending LLM Context Window Beyond 2 Million Tokenscited by 302
  3. 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 266
  4. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  5. 2025History-Guided Video Diffusioncited by 165
  6. 2025LongVie: Multimodal-Guided Controllable Ultra-Long Video Generationcited by 21
  7. 2025FreeLong++: Training-Free Long Video Generation via Multi-band SpectralFusioncited by 15
  8. 2024Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspectivecited by 13
  9. 2026StableWorld: Towards Stable and Consistent Long Interactive Video Generationcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model
  2. 2026Self Gradient Forcing: Native Long Video Extrapolation
  3. 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generation
  4. 2026FlowLong: Inference-time Long Video Generation via Manifold-constrained Tweedie Matching
  5. 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resampling
  6. 2025Long-Context Autoregressive Video Modeling with Next-Frame Prediction
  7. 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attention
  8. 2026TokenTrim: Inference-Time Token Pruning for Autoregressive Long Video Generation