mlsanityData to 14 Oct 2026

Not All Frames Deserve Full Computation: Accelerating Autoregressive Video Generation via Selective Computation and Predictive Extrapolation

arXiv 2604.02979 ↗First posted 3 Apr 2026cs.CVcited by 5

On the map: Diffusion models → Video generation

Abstract (arXiv)

Autoregressive (AR) video diffusion models enable long-form video generation but remain expensive due to repeated multi-step denoising. Existing training-free acceleration methods rely on binary cache-or-recompute decisions, overlooking intermediate cases where direct reuse is too coarse yet full recomputation is unnecessary. Moreover, asynchronous AR schedules assign different noise levels to co-generated frames, yet existing methods process the entire valid interval uniformly. To address these AR-specific inefficiencies, we present SCOPE, a training-free framework for efficient AR video diffusion. SCOPE introduces a tri-modal scheduler over cache, predict, and recompute, where prediction via noise-level Taylor extrapolation fills the gap between reuse and recomputation with explicit stability controls backed by error propagation analysis. It further introduces selective computation that restricts execution to the active frame interval. On MAGI-1 and SkyReels-V2, SCOPE achieves up to 4.73x speedup while maintaining quality comparable to the original output, outperforming all training-free baselines.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 41 of its 56 references that are in the map. First posted on arXiv 3 Apr 2026.

Builds on

41 of 56 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025SkyReels-V2: Infinite-length Film Generative Model17 Apr
  2. 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusion10 Mar
  3. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model28 Nov
  4. 2024Adaptive Caching for Faster Video Generation with Diffusion Transformers4 Nov
  5. 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality25 Oct
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  7. 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  10. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generation23 Nov
  11. 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct

Other references · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  9. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  11. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  12. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
18 more
  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  2. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  3. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  4. 2022Token Merging: Your ViT But Fastercited by 1,021
  5. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  6. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  7. 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 717
  8. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  9. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  10. 2024Autoregressive Image Generation without Vector Quantizationcited by 651
  11. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  12. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 502
  13. 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformerscited by 175
  14. 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 149
  15. 2024Learning-to-Cache: Accelerating Diffusion Transformer via Layer Cachingcited by 142
  16. 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeerscited by 136
  17. 2026Flow caching for autoregressive video generationcited by 25
  18. 2023FRDiff : Feature Reuse for Universal Training-free Acceleration of Diffusion Modelscited by 20

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DSA: Dynamic Step Allocation for Fast Autoregressive Video Generation
  2. 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
  3. 2026HiAR: Efficient Autoregressive Long Video Generation via Hierarchical Denoising
  4. 2026OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators
  5. 2026Test-Time Noise Guided Adaptation for Realistic Autoregressive Video Generation
  6. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models
  7. 2026Streaming Autoregressive Video Generation via Diagonal Distillation
  8. 2026ForcingBooster: Adaptive Patch-wise Denoising for Fast Autoregressive Video Diffusion