mlsanityData to 7 Oct 2026

Few-Shot Domain Adaptation for Learned Image Compression

arXiv 2409.11111 ↗First posted 17 Sep 2024eess.IV cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Learned image compression (LIC) has achieved state-of-the-art rate-distortion performance, deemed promising for next-generation image compression techniques. However, pre-trained LIC models usually suffer from significant performance degradation when applied to out-of-training-domain images, implying their poor generalization capabilities. To tackle this problem, we propose a few-shot domain adaptation method for LIC by integrating plug-and-play adapters into pre-trained models. Drawing inspiration from the analogy between latent channels and frequency components, we examine domain gaps in LIC and observe that out-of-training-domain images disrupt pre-trained channel-wise decomposition. Consequently, we introduce a method for channel-wise re-allocation using convolution-based adapters and low-rank adapters, which are lightweight and compatible to mainstream LIC schemes. Extensive experiments across multiple domains and multiple representative LIC schemes demonstrate that our method significantly enhances pre-trained models, achieving comparable performance to H.266/VVC intra coding with merely 25 target-domain samples. Additionally, our method matches the performance of full-model finetune while transmitting fewer than 2% of the parameters.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 52 references that are in the map. First posted on arXiv 17 Sep 2024.

Builds on

34 of 52 references.

References · 34

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  3. 2018Variational image compression with a scale hyperpriorcited by 910
  4. 2016End-to-end Optimized Image Compressioncited by 673
  5. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
  6. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
  7. 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
  8. 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 205
  9. 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
  10. 2021BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Imagescited by 130
  11. 2015Density Modeling of Images using a Generalized Normalization Transformationcited by 123
  12. 2021Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformercited by 116
22 more
  1. 2020Improving Inference for Neural Image Compressioncited by 81
  2. 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 80
  3. 2021Cross-domain Few-shot Learning with Task-specific Adapterscited by 79
  4. 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 56
  5. 2021Implicit Transformer Network for Screen Content Image Continuous Super-Resolutioncited by 46
  6. 2021One-Shot Generative Domain Adaptationcited by 41
  7. 2019Content Adaptive Optimization for Neural Image Compressioncited by 40
  8. 2021Overfitting for Fun and Profit: Instance-Adaptive Data Compressioncited by 38
  9. 2024USTC-TD: A Test Dataset and Benchmark for Image and Video Coding in 2020scited by 37
  10. 2022One-Shot Adaptation of GAN in Just One CLIPcited by 31
  11. 2020Unsupervised BatchNorm Adaptation (UBNA): A Domain Adaptation Method for Semantic Segmentation Without Using Source Domain Representationscited by 24
  12. 2022Generalized One-shot Domain Adaptation of Generative Adversarial Networkscited by 19
  13. 2021Instance-Adaptive Video Compression: Improving Neural Codecs by Training on the Test Setcited by 18
  14. 2021Few-Shot Domain Adaptation with Polymorphic Transformerscited by 14
  15. 2022Universal Deep Image Compression via Content-Adaptive Optimization with Adapterscited by 11
  16. 2023Dynamic Low-Rank Instance Adaptation for Universal Neural Image Compressioncited by 10
  17. 2020Inductive Unsupervised Domain Adaptation for Few-Shot Classification via Clusteringcited by 8
  18. 2022Cluster-to-adapt: Few Shot Domain Adaptation for Semantic Segmentation across Disjoint Labelscited by 7
  19. 2021Adaptation and Attention for Neural Video Codingcited by 6
  20. 2022Opening the Black Box of Learned Image Coderscited by 5
  21. 2021DANICE: Domain adaptation without forgetting in neural image compressioncited by 2
  22. 2024Domain Adaptation for Learned Image Compression with Supervised Adapterscited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.