ChWDTA: Channel-wise Wavelet-Domain Transformer Attention and Entropy Modeling for Learned Image Compression
Not on the map. Why?
Abstract (arXiv)
State-of-the-art learned image compression (LIC) schemes are increasingly based on hybrid CNN-transformer architectures. To further improve rate-distortion performance, we introduce channel-wise wavelet transforms into both the transformer and entropy-coding components. First, we propose a channel-wise wavelet-domain transformer attention (ChWDTA) mechanism. ChWDTA keeps the efficient windowed spatial self-attention used in modern LIC backbones, but computes the Q/K/V projections on channel-wise wavelet-transformed features before mapping the attention output back with the inverse transform. The resulting Channel-wise Wavelet-Domain Transformer Block (ChWDTB) therefore preserves the spatial tokenization pattern of windowed attention while sparsifying the channel covariance seen by the attention projections. Second, in the entropy-coding stage, we introduce a channel-wise wavelet packet (ChWP) decomposition that produces four equal-sized subbands, which better fit channel-wise slice-based autoregressive entropy modeling. When each channel-wise subband is divided into two slices, we use eight slices for entropy coding. With this configuration, the proposed scheme obtains BD-rate reductions of -17.82%, -19.15%, and -22.56% on the Kodak, CLIC Professional Validation, and Tecnick test sets, respectively. Even when each channel-wise subband is coded as a single slice, the scheme still retains most of the coding gains with lower complexity. The results confirm the advantage of introducing wavelet transform in CNN-transformer-based LIC schemes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 42 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
30 of 42 references.
References · 30
- 2018Variational image compression with a scale hyperpriorcited by 910
- 2016End-to-end Optimized Image Compressioncited by 673
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2020Channel-wise Autoregressive Entropy Models for Learned Image Compressioncited by 255
- 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 205
- 2021Checkerboard Context Model for Efficient Learned Image Compressioncited by 193
- 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 141
- 2022Entroformer: A Transformer-based Entropy Model for Learned Image Compressioncited by 102
- 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 80
- 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 56
18 more
- 2023Frequency-Aware Transformer for Learned Image Compressioncited by 56
- 2021Learned Image Compression with Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modulescited by 33
- 2025Learned Image Compression with Dictionary-based Entropy Modelcited by 29
- 2024MambaVC: Learned Visual Compression with Selective State Spacescited by 28
- 2025Learned Image Compression with Hierarchical Progressive Context Modelingcited by 20
- 2023Frequency Disentangled Features in Neural Image Compressioncited by 14
- 2020Learned Multi-Resolution Variable-Rate Image Compression with Octave-based Residual Blockscited by 12
- 2022aiWave: Volumetric Image Compression with 3-D Trained Affine Wavelet-like Transformcited by 11
- 2025On Disentangled Training for Nonlinear Transform in Learned Image Compressioncited by 8
- 2025MLICv2: Enhanced Multi-Reference Entropy Modeling for Learned Image Compressioncited by 6
- 2026Cool-chic 5.0: Faster Encoding and Inter-Feature Entropy Modeling for Overfitted Image Compressioncited by 3
- 2022Image Compression With Learned Lifting-Based DWT and Learned Tree-Based Entropy Modelscited by 2
- 2024Channel-wise Feature Decorrelation for Enhanced Learned Image Compressioncited by 2
- 2024Window-based Channel Attention for Wavelet-enhanced Learned Image Compressioncited by 2
- 20253DM-WeConvene: Learned Image Compression with 3D Multi-Level Wavelet-Domain Convolution and Entropy Modelcited by 2
- 2026What Matters in Practical Learned Image Compressioncited by 2
- 2024Bi-Level Spatial and Channel-aware Transformer for Learned Image Compressioncited by 1
- 2026Spatial Competition for Low-Complexity Learned Image Compressioncited by 1
Built on by
Not cited yet.