mlsanityData to 14 Oct 2026

Dynamic Kernel-Based Adaptive Spatial Aggregation for Learned Image Compression

arXiv 2308.08723 ↗First posted 17 Aug 2023eess.IV cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Learned image compression methods have shown superior rate-distortion performance and remarkable potential compared to traditional compression methods. Most existing learned approaches use stacked convolution or window-based self-attention for transform coding, which aggregate spatial information in a fixed range. In this paper, we focus on extending spatial aggregation capability and propose a dynamic kernel-based transform coding. The proposed adaptive aggregation generates kernel offsets to capture valid information in the content-conditioned range to help transform. With the adaptive aggregation strategy and the sharing weights mechanism, our method can achieve promising transform capability with acceptable model complexity. Besides, according to the recent progress of entropy model, we define a generalized coarse-to-fine entropy model, considering the coarse global context, the channel-wise, and the spatial context. Based on it, we introduce dynamic kernel in hyper-prior to generate more expressive global context. Furthermore, we propose an asymmetric spatial-channel entropy model according to the investigation of the spatial characteristics of the grouped latents. The asymmetric entropy model aims to reduce statistical redundancy while maintaining coding efficiency. Experimental results demonstrate that our method achieves superior rate-distortion performance on three benchmarks compared to the state-of-the-art learning-based methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 62 references that are in the map. First posted on arXiv 17 Aug 2023.

Builds on

40 of 62 references.

References · 40

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2016Layer Normalizationcited by 5,669
  6. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  7. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  8. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  9. 2017Deformable Convolutional Networkscited by 1,488
  10. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  11. 2018Variational image compression with a scale hyperpriorcited by 935
  12. 2016End-to-end Optimized Image Compressioncited by 696
28 more
  1. 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
  2. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 664
  3. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 590
  4. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
  5. 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
  6. 2019Dynamic Convolution: Attention over Convolution Kernelscited by 356
  7. 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
  8. 2020High-Fidelity Generative Image Compressioncited by 338
  9. 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 301
  10. 2020CompressAI: a PyTorch library and evaluation platform for end-to-end compression researchcited by 276
  11. 2019CondConv: Conditionally Parameterized Convolutions for Efficient Inferencecited by 273
  12. 2020Channel-wise Autoregressive Entropy Models for Learned Image Compressioncited by 264
  13. 2021Checkerboard Context Model for Efficient Learned Image Compressioncited by 202
  14. 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 147
  15. 2020Interpreting Super-Resolution Networks with Local Attribution Mapscited by 136
  16. 2021Enhanced Invertible Encoding for Learned Image Compressioncited by 105
  17. 2019Non-local Attention Optimized Deep Image Compressioncited by 92
  18. 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 84
  19. 2020Causal Contextual Prediction for Learned Image Compressioncited by 73
  20. 2021Transformer-based Image Compressioncited by 62
  21. 2020Learning End-to-End Lossy Image Compression: A Benchmarkcited by 60
  22. 2020A Unified End-to-End Framework for Efficient Deep Image Compressioncited by 58
  23. 2021Joint Global and Local Hierarchical Priors for Learned Image Compressioncited by 54
  24. 2021Learned Image Compression with Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modulescited by 35
  25. 2020Learned Block-based Hybrid Image Compressioncited by 30
  26. 2022Neural Data-Dependent Transform for Learned Image Compressioncited by 30
  27. 2022High-Efficiency Lossy Image Coding Through Adaptive Neighborhood Information Aggregationcited by 20
  28. 2023Multistage Spatial Context Models for Learned Image Compressioncited by 5

Built on by

Not cited yet.