mlsanityData to 7 Oct 2026

Test-time adaptation for image compression with distribution regularization

arXiv 2410.12191 ↗First posted 16 Oct 2024cs.CV cs.MMcited by 3

Not on the map. Why?

Abstract (arXiv)

Current test- or compression-time adaptation image compression (TTA-IC) approaches, which leverage both latent and decoder refinements as a two-step adaptation scheme, have potentially enhanced the rate-distortion (R-D) performance of learned image compression models on cross-domain compression tasks, textite.g., from natural to screen content images. However, compared with the emergence of various decoder refinement variants, the latent refinement, as an inseparable ingredient, is barely tailored to cross-domain scenarios. To this end, we aim to develop an advanced latent refinement method by extending the effective hybrid latent refinement (HLR) method, which is designed for textitin-domain inference improvement but shows noticeable degradation of the rate cost in textitcross-domain tasks. Specifically, we first provide theoretical analyses, in a cue of marginalization approximation from in- to cross-domain scenarios, to uncover that the vanilla HLR suffers from an underlying mismatch between refined Gaussian conditional and hyperprior distributions, leading to deteriorated joint probability approximation of marginal distribution with increased rate consumption. To remedy this issue, we introduce a simple Bayesian approximation-endowed textitdistribution regularization to encourage learning a better joint probability approximation in a plug-and-play manner. Extensive experiments on six in- and cross-domain datasets demonstrate that our proposed method not only improves the R-D performance compared with other latent refinement counterparts, but also can be flexibly integrated into existing TTA-IC methods with incremental benefits.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 29 of its 41 references that are in the map. First posted on arXiv 16 Oct 2024.

Builds on

29 of 41 references.

References · 29

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  3. 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,327
  4. 2018Variational image compression with a scale hyperpriorcited by 910
  5. 2016End-to-end Optimized Image Compressioncited by 673
  6. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
  7. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
  8. 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
  9. 2020CompressAI: a PyTorch library and evaluation platform for end-to-end compression researchcited by 271
  10. 2020Channel-wise Autoregressive Entropy Models for Learned Image Compressioncited by 255
  11. 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 141
  12. 2019Practical Lossless Compression with Latent Variables using Bits Back Codingcited by 85
17 more
  1. 2020Improving Inference for Neural Image Compressioncited by 81
  2. 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 80
  3. 2023C3: High-performance and low-complexity neural compression from a single image or videocited by 54
  4. 2019Content Adaptive Optimization for Neural Image Compressioncited by 40
  5. 2021Overfitting for Fun and Profit: Instance-Adaptive Data Compressioncited by 38
  6. 2022Test-Time Training Can Close the Natural Distribution Shift Performance Gap in Deep Learning Based Compressed Sensingcited by 37
  7. 2019Compression with Flows via Local Bits-Back Codingcited by 34
  8. 2022ViTALiTy: Unifying Low-rank and Sparse Approximation for Vision Transformer Acceleration with a Linear Taylor Attentioncited by 29
  9. 2021Improving Lossless Compression Rates via Monte Carlo Bits-Back Codingcited by 19
  10. 2023Efficient Test-Time Adaptation for Super-Resolution with Second-Order Degradation and Reconstructioncited by 18
  11. 2020Efficient Adaptation of Neural Network Filter for Video Compressioncited by 13
  12. 2022Universal Deep Image Compression via Content-Adaptive Optimization with Adapterscited by 11
  13. 2023Test Time Adaptation for Blind Image Quality Assessmentcited by 11
  14. 2023Dynamic Low-Rank Instance Adaptation for Universal Neural Image Compressioncited by 10
  15. 2022Downscaled Representation Matters: Improving Image Rescaling with Collaborative Downscaled Imagescited by 8
  16. 2021Adaptation and Attention for Neural Video Codingcited by 6
  17. 2024Learned Compression of Encoding Distributionscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.