Hadamard-Domain Model Quantization for Learned Image Coding
Not on the map. Why?
Abstract (arXiv)
Uniform INT8 quantization is attractive for deploying learned image coding (LIC), but its rate--distortion (R--D) performance is often limited by heavy-tailed tensors and large inter-channel variations. Existing methods mainly adapt the quantizer through mixed precision or non-uniform codebooks. We propose Hadamard-Transform-domain Quantization (HaTQ), which uses orthogonal Hadamard reparameterization before quantization to redistribute weight and activation responses in the original domain across channels. The reparameterization preserves the original function mapping of each linear operator, while making its weights and activations more amenable to uniform INT8 quantization. HaTQ provides two complementary forms. Double-Hadamard quantization transforms both the input activations and weights, whereas weight-only Hadamard quantization transforms only the weights. This distinction is important because the constant Hadamard basis can coherently accumulate a nonzero channel mean and enlarge the activation range in sensitive layers. We identify these sensitive layers through offline profiling and assign the appropriate form to each layer without input-dependent branching. HaTQ supports both post-training quantization (PTQ) and quantization-aware training (QAT), uses uniform INT8 quantizers, and is compatible with integer-only execution. Experiments on representative LIC architectures and datasets demonstrate consistent improvements across different quantization settings. The resulting QAT models further outperform competing mixed-precision and non-uniform quantization methods. TensorRT deployment results demonstrate practical INT8 inference efficiency. The source code will be publicly released.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 51 of its 94 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
51 of 94 references.
References · 51
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2022SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Modelscited by 1,386
- 2018Variational image compression with a scale hyperpriorcited by 935
- 2016End-to-end Optimized Image Compressioncited by 696
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 664
- 2024QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMscited by 634
- 2020Up or Down? Adaptive Rounding for Post-Training Quantizationcited by 621
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 590
- 2021BRECQ: Pushing the Limit of Post-Training Quantization by Block Reconstructioncited by 479
- 2021A White Paper on Neural Network Quantizationcited by 472
- 2024SpinQuant: LLM quantization with learned rotationscited by 471
- 2019HAWQ: Hessian AWare Quantization of Neural Networks with Mixed-Precisioncited by 402
38 more
- 2024QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebookscited by 378
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 301
- 2023SqueezeLLM: Dense-and-Sparse Quantizationcited by 294
- 2020Channel-wise Autoregressive Entropy Models for Learned Image Compressioncited by 264
- 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 211
- 2019Low-bit Quantization of Neural Networks for Efficient Inferencecited by 193
- 2015Variable Rate Image Compression with Recurrent Neural Networkscited by 173
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 170
- 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 147
- 2020Nonlinear Transform Codingcited by 136
- 2015Density Modeling of Images using a Generalized Normalization Transformationcited by 127
- 2022Entroformer: A Transformer-based Entropy Model for Learned Image Compressioncited by 107
- 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 84
- 2017Learning Convolutional Networks for Content-weighted Image Compressioncited by 76
- 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Priorcited by 60
- 2019Efficient 8-Bit Quantization of Transformer Neural Machine Language Translation Modelcited by 59
- 2021Lossy Compression for Lossless Predictioncited by 52
- 2022Contextformer: A Transformer with Spatio-Channel Attention for Context Modeling in Learned Image Compressioncited by 45
- 2024Lossy Image Compression with Foundation Diffusion Modelscited by 36
- 2023QARV: Quantization-Aware ResNet VAE for Lossy Image Compressioncited by 32
- 2023TransTIC: Transferring Transformer-based Image Compression from Human Perception to Machine Perceptioncited by 32
- 20228-bit Numerical Formats for Deep Neural Networkscited by 25
- 2025Linear Attention Modeling for Learned Image Compressioncited by 23
- 2025MambaIC: State Space Models for High-Performance Learned Image Compressioncited by 20
- 2019Deep Residual Learning for Image Compressioncited by 16
- 2022Post-Training Quantization for Cross-Platform Learned Image Compressioncited by 14
- 2018Neural Multi-scale Image Compressioncited by 11
- 2022Device Interoperability for Learned Image Compression with Weights and Activations Quantizationcited by 11
- 2020End-to-end Learned Image Compression with Fixed Point Weight Quantizationcited by 10
- 2022Q-LIC: Quantizing Learned Image Compression with Channel Splittingcited by 10
- 2022Rate-Distortion Optimized Post-Training Quantization for Learned Image Compressioncited by 10
- 2026YODA: Yet Another One-step Diffusion-based Video Compressorcited by 9
- 2023Quantized Decoder in Learned Image Compression for Deterministic Reconstructioncited by 5
- 2026DiT-IC: Aligned Diffusion Transformer for Efficient Image Compressioncited by 5
- 2025Flexible Mixed Precision Quantization for Learned Image Compressioncited by 4
- 2025On Quantizing Neural Representation for Variable-Rate Video Codingcited by 3
- 2025Structured Pruning and Quantization for Learned Image Compressioncited by 1
- 2025Perception-Oriented Latent Coding for High-Performance Compressed Domain Semantic Inferencecited by 1
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Distribution-Aware Hadamard Quantization for Hardware-Efficient Implicit Neural Representations
- 2024HLQ: Fast and Efficient Backpropagation via Hadamard Low-rank Quantization
- 2026Dissecting Quantization Error: A Concentration-Alignment Perspective
- 2025WUSH: Near-Optimal Adaptive Transforms for LLM Quantization
- 2024STanH : Parametric Quantization for Variable Rate Learned Image Compression
- 2026QAM-W: Joint 2D Codebook Quantization for LLM Weights via Hadamard Rotation and Activation-Aware Scaling
- 2026HARP: Hadamard-Preconditioned Adaptive Rotation Processor for Extreme LLM Quantization
- 2025Robust Residual Finite Scalar Quantization for Neural Compression