mlsanityData to 7 Oct 2026

ChWDTA: Channel-wise Wavelet-Domain Transformer Attention and Entropy Modeling for Learned Image Compression

arXiv 2606.00111 ↗First posted 27 May 2026eess.IV cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

State-of-the-art learned image compression (LIC) schemes are increasingly based on hybrid CNN-transformer architectures. To further improve rate-distortion performance, we introduce channel-wise wavelet transforms into both the transformer and entropy-coding components. First, we propose a channel-wise wavelet-domain transformer attention (ChWDTA) mechanism. ChWDTA keeps the efficient windowed spatial self-attention used in modern LIC backbones, but computes the Q/K/V projections on channel-wise wavelet-transformed features before mapping the attention output back with the inverse transform. The resulting Channel-wise Wavelet-Domain Transformer Block (ChWDTB) therefore preserves the spatial tokenization pattern of windowed attention while sparsifying the channel covariance seen by the attention projections. Second, in the entropy-coding stage, we introduce a channel-wise wavelet packet (ChWP) decomposition that produces four equal-sized subbands, which better fit channel-wise slice-based autoregressive entropy modeling. When each channel-wise subband is divided into two slices, we use eight slices for entropy coding. With this configuration, the proposed scheme obtains BD-rate reductions of -17.82%, -19.15%, and -22.56% on the Kodak, CLIC Professional Validation, and Tecnick test sets, respectively. Even when each channel-wise subband is coded as a single slice, the scheme still retains most of the coding gains with lower complexity. The results confirm the advantage of introducing wavelet transform in CNN-transformer-based LIC schemes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 42 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

30 of 42 references.

References · 30

  1. 2018Variational image compression with a scale hyperpriorcited by 910
  2. 2016End-to-end Optimized Image Compressioncited by 673
  3. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
  4. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
  5. 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
  6. 2020Channel-wise Autoregressive Entropy Models for Learned Image Compressioncited by 255
  7. 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 205
  8. 2021Checkerboard Context Model for Efficient Learned Image Compressioncited by 193
  9. 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 141
  10. 2022Entroformer: A Transformer-based Entropy Model for Learned Image Compressioncited by 102
  11. 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 80
  12. 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 56
18 more
  1. 2023Frequency-Aware Transformer for Learned Image Compressioncited by 56
  2. 2021Learned Image Compression with Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modulescited by 33
  3. 2025Learned Image Compression with Dictionary-based Entropy Modelcited by 29
  4. 2024MambaVC: Learned Visual Compression with Selective State Spacescited by 28
  5. 2025Learned Image Compression with Hierarchical Progressive Context Modelingcited by 20
  6. 2023Frequency Disentangled Features in Neural Image Compressioncited by 14
  7. 2020Learned Multi-Resolution Variable-Rate Image Compression with Octave-based Residual Blockscited by 12
  8. 2022aiWave: Volumetric Image Compression with 3-D Trained Affine Wavelet-like Transformcited by 11
  9. 2025On Disentangled Training for Nonlinear Transform in Learned Image Compressioncited by 8
  10. 2025MLICv2: Enhanced Multi-Reference Entropy Modeling for Learned Image Compressioncited by 6
  11. 2026Cool-chic 5.0: Faster Encoding and Inter-Feature Entropy Modeling for Overfitted Image Compressioncited by 3
  12. 2022Image Compression With Learned Lifting-Based DWT and Learned Tree-Based Entropy Modelscited by 2
  13. 2024Channel-wise Feature Decorrelation for Enhanced Learned Image Compressioncited by 2
  14. 2024Window-based Channel Attention for Wavelet-enhanced Learned Image Compressioncited by 2
  15. 20253DM-WeConvene: Learned Image Compression with 3D Multi-Level Wavelet-Domain Convolution and Entropy Modelcited by 2
  16. 2026What Matters in Practical Learned Image Compressioncited by 2
  17. 2024Bi-Level Spatial and Channel-aware Transformer for Learned Image Compressioncited by 1
  18. 2026Spatial Competition for Low-Complexity Learned Image Compressioncited by 1

Built on by

Not cited yet.