Collaborative Few-Step Distillation and Low-Bit Quantization for Wan2.2 Dual-Expert Video Diffusion Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Large video diffusion models achieve strong visual quality but remain expensive to deploy because each sample requires many denoising steps and a large resident parameter footprint. This paper studies a deployment-oriented compression pipeline for Wan2.2-T2V-A14B by combining few-step distribution-matching distillation with low-bit quantization. The pipeline follows the model's dual-expert denoising route, calibrates the high-noise and low-noise branches separately, protects sensitive entrance layers, and uses HiF4-style low-bit representation to improve dynamic-range coverage. Quantization is calibrated on the distilled few-step student rather than on the original long-step trajectory, reducing activation-distribution mismatch during inference. The proposed co-design keeps the quantized model close to the same-step full-precision model and surpasses the original full-precision baseline at 8 and 20 steps on average. The 20-step setting gives the best quality-efficiency trade-off in the tested configurations.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 18 of its 21 references that are in the map. First posted on arXiv 30 May 2026.
Builds on
18 of 21 references.
Closest ancestors · 4
Same direction, newest first
- 2025Phased DMD: Few-step Distribution Matching Distillation via Score Matching within Subintervals31 Oct
- 2023One-step Diffusion with Distribution Matching Distillation30 Nov
- 2023Consistency Models2 Mar
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 14
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Video Diffusion Modelscited by 2,280
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Modelscited by 1,338
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
2 more
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Dynamic-in-Few-Step: Unifying Dynamic Computation and Few-Step Distillation for Efficient Video Generation
- 20266Bit-Diffusion: Inference-Time Mixed-Precision Quantization for Video Diffusion Models
- 2025S2Q-VDiT: Accurate Quantized Video Diffusion Transformer with Salient Data and Sparse Token Distillation
- 2025DVD-Quant: Data-free Video Diffusion Transformers Quantization
- 2026Transition Matching Distillation for Fast Video Generation
- 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers
- 2025LRQ-DiT: Log-Rotation Post-Training Quantization of Diffusion Transformers for Image and Video Generation
- 2026PulseQuant: Propagation-Guided Subspace Correction for 4-Bit Video Diffusion Transformers