A Lightweight Model for Perceptual Image Compression via Implicit Priors
Not on the map. Why?
Abstract (arXiv)
Perceptual image compression has shown strong potential for producing visually appealing results at low bitrates, surpassing classical standards and pixel-wise distortion-oriented neural methods. However, existing methods typically improve compression performance by incorporating explicit semantic priors, such as segmentation maps and textual features, into the encoder or decoder, which increases model complexity by adding parameters and floating-point operations. This limits the model's practicality, as image compression often occurs on resource-limited mobile devices. To alleviate this problem, we propose a lightweight perceptual Image Compression method using Implicit Semantic Priors (ICISP). We first develop an enhanced visual state space block that exploits local and global spatial dependencies to reduce redundancy. Since different frequency information contributes unequally to compression, we develop a frequency decomposition modulation block to adaptively preserve or reduce the low-frequency and high-frequency information. We establish the above blocks as the main modules of the encoder-decoder, and to further improve the perceptual quality of the reconstructed images, we develop a semantic-informed discriminator that uses implicit semantic priors from a pretrained DINOv2 encoder. Experiments on popular benchmarks show that our method achieves competitive compression performance and has significantly fewer network parameters and floating point operations than the existing state-of-the-art.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 33 of its 52 references that are in the map. First posted on arXiv 19 Feb 2025.
Builds on
33 of 52 references.
References · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2018Demystifying MMD GANscited by 1,293
- 2018Variational image compression with a scale hyperpriorcited by 935
- 2016Conditional Image Generation with PixelCNN Decoderscited by 862
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2016End-to-end Optimized Image Compressioncited by 696
21 more
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 664
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 590
- 2019Selective Kernel Networkscited by 403
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
- 2020High-Fidelity Generative Image Compressioncited by 338
- 2018Generative Adversarial Networks for Extreme Learned Image Compressioncited by 219
- 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 211
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 170
- 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 147
- 2015Density Modeling of Images using a Generalized Normalization Transformationcited by 127
- 2023Towards image compression with perfect realism at ultra-low bitratescited by 103
- 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 94
- 2023Text + Sketch: Image Compression at Ultra Low Ratescited by 67
- 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Priorcited by 60
- 2023Frequency-Aware Transformer for Learned Image Compressioncited by 58
- 2022PO-ELIC: Perception-Oriented Efficient Learned Image Codingcited by 36
- 2018DSSLIC: Deep Semantic Segmentation-based Layered Image Compressioncited by 27
- 2024Neural Image Compression with Text-guided Encoding for both Pixel-level and Perceptual Fidelitycited by 23
- 2024RDEIC: Accelerating Diffusion-Based Extreme Image Compression with Relay Residual Diffusioncited by 23
- 2023Multi-Modality Deep Network for Extreme Learned Image Compressioncited by 16
- 2024Correcting Diffusion-Based Perceptual Image Compression with Privileged End-to-End Decodercited by 13
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compressioncited by 1
- 2026Geometric Transformation-Embedded Mamba for Learned Video Compressioncited by 0
- 2026Faithful Extreme Image Rescaling with Learnable Reversible Transformation and Semantic Priorscited by 0
- 2026SAMIC: A Lightweight Semantic-Aware Mamba for Efficient Perceptual Image Compressioncited by 0
- 2026Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compression1 Jun 2026
- 2026SAMIC: A Lightweight Semantic-Aware Mamba for Efficient Perceptual Image Compression6 May 2026
- 2026Faithful Extreme Image Rescaling with Learnable Reversible Transformation and Semantic Priors1 May 2026
- 2026Geometric Transformation-Embedded Mamba for Learned Video Compression9 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Dual-Representation Image Compression at Ultra-Low Bitrates via Explicit Semantics and Implicit Textures
- 2021Thousand to One: Semantic Prior Modeling for Conceptual Coding
- 2026Compression as Adaptation: Implicit Visual Representation with Diffusion Foundation Models
- 2026Rethinking Generative Image Compression at Extremely Low Bitrates
- 2025PerCoV2: Ultra-Low Bit-Rate Perceptual Image Compression via Query-Based 1D Multimodal Image Tokens
- 2025Diff-ICMH: Harmonizing Machine and Human Vision in Image Compression with Generative Prior
- 2026SCENE: Semantic-aware Codec Enhancement with Neural Embeddings
- 2024UniMIC: Towards Universal Multi-modality Perceptual Image Compression