Joint Branch-Space Transform Coding for Diffusion Activation Quantization with Classifier-Free Guidance
On the map: Diffusion models → Diffusion foundations and sampling also fits: Flow matching, time series and science
Abstract (arXiv)
Post-training quantization for diffusion models increasingly exploits timestep, feature, and layer structure. While recent work has begun incorporating CFG structure into diffusion quantization, activation quantization still operates independently across conditional and unconditional coordinates, leaving cross-activation structure unexploited. We show that matched CFG activations form a strongly correlated two-dimensional source and that, under a fixed bit budget, the choice of branch coding basis materially affects quantization fidelity. Motivated by this observation, we introduce branch-space transform coding, which rotates matched CFG branches via an offline derived 2x2 orthogonal matrix, requiring minimal modifications to model parameters or the quantization pipeline. We further derive the Guidance-Correlation Branch Transform (GCBT), which jointly incorporates the CFG guidance direction and cross-branch second moments. Under an equal-rate quantization-noise surrogate, GCBT admits a closed-form per-layer solution without gradient optimization or angle search. Applied on top of existing diffusion PTQ methods, GCBT yields statistically significant fidelity gains in most evaluated comparisons with no statistically significant degradation, while leaving the underlying host quantization pipeline unchanged.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 24 of its 29 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
24 of 29 references.
Closest ancestors · 13
Same direction, newest first
- 2026Closing the Null Space: Guidance-Aware Quantization for Classifier-Free Diffusion9 Jul
- 2026OrbitQuant: Data-Agnostic Quantization for Image and Video Diffusion Transformers2 Jul
- 2025TR-DQ: Time-Rotation Diffusion Quantization9 Mar
- 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers25 Jun
- 2024ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation4 Jun
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation7 Mar
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
- 2023Q-Diffusion: Quantizing Diffusion Models8 Feb
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Classifier-Free Diffusion Guidance26 Jul
- 2021Improved Denoising Diffusion Probabilistic Models18 Feb
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
1 more
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 11
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2024QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMscited by 598
- 2024SpinQuant: LLM quantization with learned rotationscited by 446
- 2024QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebookscited by 354
- 2024FlatQuant: Flatness Matters for LLM Quantizationcited by 116
- 2025OstQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fittingcited by 94
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Towards Accurate Post-training Quantization for Diffusion Models
- 2024DilateQuant: Accurate and Efficient Diffusion Quantization via Weight Dilation
- 2026Chameleon: Dynamic Format Adapter for Efficient Diffusion
- 2024Efficiency Meets Fidelity: A Novel Quantization Framework for Stable Diffusion
- 2026KroQuant: Kronecker-Structured Block Transforms for Efficient Post-Training Quantization of Diffusion Transformers
- 2024TCAQ-DM: Timestep-Channel Adaptive Quantization for Diffusion Models
- 2024TaQ-DiT: Time-aware Quantization for Diffusion Transformers
- 2023EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Diffusion Models