mlsanityData to 14 Oct 2026

Hadamard-Domain Model Quantization for Learned Image Coding

arXiv 2608.01653 ↗First posted 3 Aug 2026eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Uniform INT8 quantization is attractive for deploying learned image coding (LIC), but its rate--distortion (R--D) performance is often limited by heavy-tailed tensors and large inter-channel variations. Existing methods mainly adapt the quantizer through mixed precision or non-uniform codebooks. We propose Hadamard-Transform-domain Quantization (HaTQ), which uses orthogonal Hadamard reparameterization before quantization to redistribute weight and activation responses in the original domain across channels. The reparameterization preserves the original function mapping of each linear operator, while making its weights and activations more amenable to uniform INT8 quantization. HaTQ provides two complementary forms. Double-Hadamard quantization transforms both the input activations and weights, whereas weight-only Hadamard quantization transforms only the weights. This distinction is important because the constant Hadamard basis can coherently accumulate a nonzero channel mean and enlarge the activation range in sensitive layers. We identify these sensitive layers through offline profiling and assign the appropriate form to each layer without input-dependent branching. HaTQ supports both post-training quantization (PTQ) and quantization-aware training (QAT), uses uniform INT8 quantizers, and is compatible with integer-only execution. Experiments on representative LIC architectures and datasets demonstrate consistent improvements across different quantization settings. The resulting QAT models further outperform competing mixed-precision and non-uniform quantization methods. TensorRT deployment results demonstrate practical INT8 inference efficiency. The source code will be publicly released.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 51 of its 94 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

51 of 94 references.

References · 51

  1. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  2. 2022SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Modelscited by 1,386
  3. 2018Variational image compression with a scale hyperpriorcited by 935
  4. 2016End-to-end Optimized Image Compressioncited by 696
  5. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 664
  6. 2024QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMscited by 634
  7. 2020Up or Down? Adaptive Rounding for Post-Training Quantizationcited by 621
  8. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 590
  9. 2021BRECQ: Pushing the Limit of Post-Training Quantization by Block Reconstructioncited by 479
  10. 2021A White Paper on Neural Network Quantizationcited by 472
  11. 2024SpinQuant: LLM quantization with learned rotationscited by 471
  12. 2019HAWQ: Hessian AWare Quantization of Neural Networks with Mixed-Precisioncited by 402
38 more
  1. 2024QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebookscited by 378
  2. 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 301
  3. 2023SqueezeLLM: Dense-and-Sparse Quantizationcited by 294
  4. 2020Channel-wise Autoregressive Entropy Models for Learned Image Compressioncited by 264
  5. 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 211
  6. 2019Low-bit Quantization of Neural Networks for Efficient Inferencecited by 193
  7. 2015Variable Rate Image Compression with Recurrent Neural Networkscited by 173
  8. 2022Lossy Image Compression with Conditional Diffusion Modelscited by 170
  9. 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 147
  10. 2020Nonlinear Transform Codingcited by 136
  11. 2015Density Modeling of Images using a Generalized Normalization Transformationcited by 127
  12. 2022Entroformer: A Transformer-based Entropy Model for Learned Image Compressioncited by 107
  13. 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 84
  14. 2017Learning Convolutional Networks for Content-weighted Image Compressioncited by 76
  15. 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Priorcited by 60
  16. 2019Efficient 8-Bit Quantization of Transformer Neural Machine Language Translation Modelcited by 59
  17. 2021Lossy Compression for Lossless Predictioncited by 52
  18. 2022Contextformer: A Transformer with Spatio-Channel Attention for Context Modeling in Learned Image Compressioncited by 45
  19. 2024Lossy Image Compression with Foundation Diffusion Modelscited by 36
  20. 2023QARV: Quantization-Aware ResNet VAE for Lossy Image Compressioncited by 32
  21. 2023TransTIC: Transferring Transformer-based Image Compression from Human Perception to Machine Perceptioncited by 32
  22. 20228-bit Numerical Formats for Deep Neural Networkscited by 25
  23. 2025Linear Attention Modeling for Learned Image Compressioncited by 23
  24. 2025MambaIC: State Space Models for High-Performance Learned Image Compressioncited by 20
  25. 2019Deep Residual Learning for Image Compressioncited by 16
  26. 2022Post-Training Quantization for Cross-Platform Learned Image Compressioncited by 14
  27. 2018Neural Multi-scale Image Compressioncited by 11
  28. 2022Device Interoperability for Learned Image Compression with Weights and Activations Quantizationcited by 11
  29. 2020End-to-end Learned Image Compression with Fixed Point Weight Quantizationcited by 10
  30. 2022Q-LIC: Quantizing Learned Image Compression with Channel Splittingcited by 10
  31. 2022Rate-Distortion Optimized Post-Training Quantization for Learned Image Compressioncited by 10
  32. 2026YODA: Yet Another One-step Diffusion-based Video Compressorcited by 9
  33. 2023Quantized Decoder in Learned Image Compression for Deterministic Reconstructioncited by 5
  34. 2026DiT-IC: Aligned Diffusion Transformer for Efficient Image Compressioncited by 5
  35. 2025Flexible Mixed Precision Quantization for Learned Image Compressioncited by 4
  36. 2025On Quantizing Neural Representation for Variable-Rate Video Codingcited by 3
  37. 2025Structured Pruning and Quantization for Learned Image Compressioncited by 1
  38. 2025Perception-Oriented Latent Coding for High-Performance Compressed Domain Semantic Inferencecited by 1

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Distribution-Aware Hadamard Quantization for Hardware-Efficient Implicit Neural Representations
  2. 2024HLQ: Fast and Efficient Backpropagation via Hadamard Low-rank Quantization
  3. 2026Dissecting Quantization Error: A Concentration-Alignment Perspective
  4. 2025WUSH: Near-Optimal Adaptive Transforms for LLM Quantization
  5. 2024STanH : Parametric Quantization for Variable Rate Learned Image Compression
  6. 2026QAM-W: Joint 2D Codebook Quantization for LLM Weights via Hadamard Rotation and Activation-Aware Scaling
  7. 2026HARP: Hadamard-Preconditioned Adaptive Rotation Processor for Extreme LLM Quantization
  8. 2025Robust Residual Finite Scalar Quantization for Neural Compression