mlsanityData to 7 Oct 2026

Boundary-Protection W8A8 HiFloat8 Quantization for Large-Scale Text-to-Video Diffusion Transformers

arXiv 2606.00957 ↗First posted 31 May 2026cs.CVcited by 1

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

We present a post-training quantization (PTQ) approach for Wan2.1-T2V-14B, a 14-billion-parameter text-to-video diffusion transformer, targeting the W8A8 HiFloat8 (HiF8) format on Ascend 910B NPUs. A central challenge in quantizing video DiT models is the heterogeneous activation distribution across transformer blocks: boundary blocks (the first and last few blocks) exhibit fundamentally different statistical properties from middle blocks, making uniform quantization ineffective. We conduct a systematic per-block activation analysis across all 40 WanAttentionBlocks and use the findings to motivate a boundary-protection strategy that retains the first two and last three blocks in BF16 while quantizing the remaining 35 blocks with W8A8 HiF8. The proposed PTQ method matches or marginally exceeds the BF16 baseline on all five VBench dimensions evaluated, indicating no measurable accuracy loss within the 5-prompt evaluation set. An ablation study over four protection configurations confirms that full boundary protection yields the highest average VBench score, validating the data-driven block selection. We additionally investigate quantization-aware training (QAT) as a complementary fine-tuning stage and analyze the conditions under which it fails to outperform plain PTQ on single-card hardware.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 8 of its 9 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

8 of 9 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers25 Jun
  2. 2023Q-Diffusion: Quantizing Diffusion Models8 Feb
  3. 2022Scalable Diffusion Models with Transformers19 Dec

Other references · 5

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  4. 2022SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Modelscited by 1,338
  5. 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 881

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation
  2. 2025TreeQ: Pushing the Quantization Boundary of Diffusion Transformer via Tree-Structured Mixed-Precision Search
  3. 2026AdaTSQ: Pushing the Pareto Frontier of Diffusion Transformers via Temporal-Sensitivity Quantization
  4. 2024TaQ-DiT: Time-aware Quantization for Diffusion Transformers
  5. 2025DVD-Quant: Data-free Video Diffusion Transformers Quantization
  6. 2024HQ-DiT: Efficient Diffusion Transformer with FP4 Hybrid Quantization
  7. 20266Bit-Diffusion: Inference-Time Mixed-Precision Quantization for Video Diffusion Models
  8. 2025Q-VDiT: Towards Accurate Quantization and Distillation of Video-Generation Diffusion Transformers