DraftAttention2: Fast Video Diffusion with Low-Resolution-Guided Mixed-Precision Attention
On the map: Diffusion models → Video generation
Abstract (arXiv)
Video generation has broad applications in content creation and entertainment. Diffusion transformers have advanced the quality of generated videos, but attention over spatiotemporal tokens becomes increasingly expensive as video resolution and duration increase. We present DraftAttention2, a training-free framework that uses the low-resolution draft attention map to jointly select attention blocks and assign their numerical precision. Specifically, spatial 2D average- and max-pooled queries and keys capture complementary regional statistics to estimate block importance, and a shared ranking assigns higher precision to important blocks, lower precision to less important retained blocks, and skips the rest under configurable budgets. Our analysis separates sparsification error from attention-weighted quantization error, establishing when recovering skipped interactions with low-bit computation tightens the output-error bound. This analysis motivates retaining more interactions at low precision while reserving higher precision for blocks with larger attention mass. To translate these fine-grained assignments into practical speedups, we further develop fused operand preparation and a single attention kernel with precision-specific phases, sharing data movement, softmax statistics, and output accumulation across precisions. Experiments demonstrate that our method achieves a superior quality-efficiency trade-off over existing efficient video generation methods. Notably, its advantage is particularly pronounced for few-step video diffusion, where jointly combining sparsity with 4- and 8-bit mixed-precision computation substantially improves generation quality while retaining significant acceleration. Code is available at https://github.com/anemoi-project/anemoi
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 21 of its 23 references that are in the map. First posted on arXiv 26 Sep 2026.
Builds on
21 of 23 references.
Closest ancestors · 7
Same direction, newest first
- 2026Sol-Attn: Accelerating Video Generation Inference via On-the-Fly Attention Sparsification27 Jul
- 2026Attention Sparsity is Input-Stable: Training-Free Sparse Attention for Video Generation via Offline Sparsity Profiling and Online QK Co-Clustering19 Mar
- 2026SVG-EAR: Parameter-Free Linear Compensation for Sparse Video Generation via Error-aware Routing9 Mar
- 2025Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation24 May
- 2025DraftAttention: Fast Video Diffusion via Low-Resolution Attention Guidance17 May
- 2025Training-free and Adaptive Sparse Attention for Efficient Long Video Generation28 Feb
- 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity3 Feb
Other references · 14
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 519
- 2024SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationcited by 160
- 2025XAttention: Block Sparse Attention with Antidiagonal Scoringcited by 137
- 2025SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inferencecited by 120
- 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 114
- 2025SageAttention3: Microscaling FP4 Attention for Inference and An Exploration of 8-Bit Trainingcited by 66
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SPADE: An Input-Adaptive Sparse Attention Engine for Fast Video Diffusion Models Inference
- 2026Ride the Wave: Precision-Allocated Sparse Attention for Smooth Video Generation
- 2025VSA: Faster Video Diffusion with Trainable Sparse Attention
- 2025Rectified SpaAttn: Revisiting Attention Sparsity for Efficient Video Generation
- 2025Attention Surgery: An Efficient Recipe to Linearize Your Video Diffusion Transformer
- 2026MonarchRT: Efficient Attention for Real-Time Video Generation
- 2025Training-Free Efficient Video Generation via Dynamic Token Carving
- 2026PARK: Accurate Block Retrieval for Sparse Attention in Video Diffusion Transformers