Few-Shot Domain Adaptation for Learned Image Compression
Not on the map. Why?
Abstract (arXiv)
Learned image compression (LIC) has achieved state-of-the-art rate-distortion performance, deemed promising for next-generation image compression techniques. However, pre-trained LIC models usually suffer from significant performance degradation when applied to out-of-training-domain images, implying their poor generalization capabilities. To tackle this problem, we propose a few-shot domain adaptation method for LIC by integrating plug-and-play adapters into pre-trained models. Drawing inspiration from the analogy between latent channels and frequency components, we examine domain gaps in LIC and observe that out-of-training-domain images disrupt pre-trained channel-wise decomposition. Consequently, we introduce a method for channel-wise re-allocation using convolution-based adapters and low-rank adapters, which are lightweight and compatible to mainstream LIC schemes. Extensive experiments across multiple domains and multiple representative LIC schemes demonstrate that our method significantly enhances pre-trained models, achieving comparable performance to H.266/VVC intra coding with merely 25 target-domain samples. Additionally, our method matches the performance of full-model finetune while transmitting fewer than 2% of the parameters.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 52 references that are in the map. First posted on arXiv 17 Sep 2024.
Builds on
34 of 52 references.
References · 34
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2018Variational image compression with a scale hyperpriorcited by 910
- 2016End-to-end Optimized Image Compressioncited by 673
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 205
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2021BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Imagescited by 130
- 2015Density Modeling of Images using a Generalized Normalization Transformationcited by 123
- 2021Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformercited by 116
22 more
- 2020Improving Inference for Neural Image Compressioncited by 81
- 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 80
- 2021Cross-domain Few-shot Learning with Task-specific Adapterscited by 79
- 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 56
- 2021Implicit Transformer Network for Screen Content Image Continuous Super-Resolutioncited by 46
- 2021One-Shot Generative Domain Adaptationcited by 41
- 2019Content Adaptive Optimization for Neural Image Compressioncited by 40
- 2021Overfitting for Fun and Profit: Instance-Adaptive Data Compressioncited by 38
- 2024USTC-TD: A Test Dataset and Benchmark for Image and Video Coding in 2020scited by 37
- 2022One-Shot Adaptation of GAN in Just One CLIPcited by 31
- 2020Unsupervised BatchNorm Adaptation (UBNA): A Domain Adaptation Method for Semantic Segmentation Without Using Source Domain Representationscited by 24
- 2022Generalized One-shot Domain Adaptation of Generative Adversarial Networkscited by 19
- 2021Instance-Adaptive Video Compression: Improving Neural Codecs by Training on the Test Setcited by 18
- 2021Few-Shot Domain Adaptation with Polymorphic Transformerscited by 14
- 2022Universal Deep Image Compression via Content-Adaptive Optimization with Adapterscited by 11
- 2023Dynamic Low-Rank Instance Adaptation for Universal Neural Image Compressioncited by 10
- 2020Inductive Unsupervised Domain Adaptation for Few-Shot Classification via Clusteringcited by 8
- 2022Cluster-to-adapt: Few Shot Domain Adaptation for Semantic Segmentation across Disjoint Labelscited by 7
- 2021Adaptation and Attention for Neural Video Codingcited by 6
- 2022Opening the Black Box of Learned Image Coderscited by 5
- 2021DANICE: Domain adaptation without forgetting in neural image compressioncited by 2
- 2024Domain Adaptation for Learned Image Compression with Supervised Adapterscited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.