mlsanityData to 14 Oct 2026

DynamicRad: Content-Adaptive Sparse Attention for Long Video Diffusion

arXiv 2604.20470 ↗First posted 22 Apr 2026cs.CVcited by 1

On the map: Diffusion models → Video generation

Abstract (arXiv)

Leveraging the natural spatiotemporal energy decay in video diffusion offers a path to efficiency, yet relying solely on rigid static masks risks losing critical long-range information in complex dynamics. To address this issue, we propose DynamicRad, a unified sparse-attention paradigm that grounds adaptive selection within a radial locality prior. DynamicRad introduces a dual-mode strategy: textitstatic-ratio for speed-optimized execution and textitdynamic-threshold for quality-first filtering. To ensure robustness without online search overhead, we integrate an offline Bayesian Optimization (BO) pipeline coupled with a semantic motion router. This lightweight projection module maps prompt embeddings to optimal sparsity regimes with minimal runtime overhead. Unlike online profiling methods, our offline BO optimizes attention reconstruction error (MSE) on a physics-based proxy task, ensuring rapid convergence. Experiments on HunyuanVideo and Wan2.1-14B demonstrate that DynamicRad pushes the efficiency--quality Pareto frontier, achieving 1.7×--2.5× inference speedups with over 80% effective sparsity. In some long-sequence settings, the dynamic mode even matches or exceeds the dense baseline, while mask-aware LoRA further improves long-horizon coherence. Code is available at https://github.com/Adamlong3/DynamicRad.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 36 of its 43 references that are in the map. First posted on arXiv 22 Apr 2026.

Builds on

36 of 43 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025Radial Attention: O(nlog n) Sparse Attention with Energy Decay for Long Video Generation24 Jun
  2. 2025VORTA: Efficient Video Diffusion via Routing Sparse Attention24 May
  3. 2025VSA: Faster Video Diffusion with Trainable Sparse Attention19 May
  4. 2025Efficient-vDiT: Efficient Video Diffusion Transformers With Attention Tile10 Feb
  5. 2025Fast Video Generation with Sliding Tile Attention6 Feb
  6. 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity3 Feb
  7. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model28 Nov
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  9. 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
  10. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  11. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
  12. 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct

Other references · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  7. 2020Longformer: The Long-Document Transformercited by 3,413
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  11. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  12. 2020Reformer: The Efficient Transformercited by 1,668
12 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2020Rethinking Attention with Performerscited by 1,601
  3. 2019Generating Long Sequences with Sparse Transformerscited by 1,546
  4. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  5. 2022Token Merging: Your ViT But Fastercited by 1,021
  6. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  7. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  8. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  9. 2023DeepCache: Accelerating Diffusion Models for Freecited by 359
  10. 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 357
  11. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  12. 2025PowerAttention: Exponentially Scaling of Receptive Fields for Effective Sparse Attentioncited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Ride the Wave: Precision-Allocated Sparse Attention for Smooth Video Generation
  2. 2026SPADE: An Input-Adaptive Sparse Attention Engine for Fast Video Diffusion Models Inference
  3. 2026DFSAttn: Dynamic Fine-grained Sparse Attention for Efficient Video Generation
  4. 2026Motion-Adaptive Temporal Attention for Lightweight Video Generation with Stable Diffusion
  5. 2025Compact Attention: Exploiting Structured Spatio-Temporal Sparsity for Fast Video Generation
  6. 2026Veda: Scalable Video Diffusion via Distilled Sparse Attention
  7. 2026Mixture of Distributions Matters: Dynamic Sparse Attention for Efficient Video Diffusion Transformers
  8. 2026Light Forcing: Accelerating Autoregressive Video Diffusion via Sparse Attention