Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modules
Not on the map. Why?
Cited by 52 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Image compression is a fundamental research field and many well-known compression standards have been developed for many decades. Recently, learned compression methods exhibit a fast development trend with promising results. However, there is still a performance gap between learned compression algorithms and reigning compression standards, especially in terms of widely used PSNR metric. In this paper, we explore the remaining redundancy of recent learned compression algorithms. We have found accurate entropy models for rate estimation largely affect the optimization of network parameters and thus affect the rate-distortion performance. Therefore, in this paper, we propose to use discretized Gaussian Mixture Likelihoods to parameterize the distributions of latent codes, which can achieve a more accurate and flexible entropy model. Besides, we take advantage of recent attention modules and incorporate them into network architecture to enhance the performance. Experimental results demonstrate our proposed method achieves a state-of-the-art performance compared to existing learned compression methods on both Kodak and high-resolution datasets. To our knowledge our approach is the first work to achieve comparable performance with latest compression standard Versatile Video Coding (VVC) regarding PSNR. More importantly, our approach generates more visually pleasant results when optimized by MS-SSIM. This project page is at this https URL https://github.com/ZhengxueCheng/Learned-Image-Compression-with-GMM-and-Attention
Key facts. Cited by 570 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 43; 2022: 79; 2023: 98; 2024: 144; 2025: 122; 2026: 84.
570 papers.
Sort:
By area:
- 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 425
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 289
- 2021COIN: COmpression with Implicit Neural representationscited by 232
- 2021Deep Contextual Video Compressioncited by 216
- 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 205
- 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 202
- 2021Checkerboard Context Model for Efficient Learned Image Compressioncited by 193
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 165
- 2021Implicit Neural Representations for Image Compressioncited by 161
- 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 141
- 2023Invisible Image Watermarks Are Provably Removable Using Generative AIcited by 124
38 more
- 2022Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compressioncited by 123
- 2021Temporal Context Mining for Learned Video Compressioncited by 112
- 2022Entroformer: A Transformer-based Entropy Model for Learned Image Compressioncited by 102
- 2023Towards image compression with perfect realism at ultra-low bitratescited by 99
- 2024GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splattingcited by 97
- 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 90
- 2022COIN++: Neural Compression Across Modalitiescited by 81
- 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 80
- 2023GIVT: Generative Infinite-Vocabulary Transformerscited by 80
- 2022Multi-Realism Image Compression with a Conditional Generatorcited by 79
- 2022An Introduction to Neural Data Compressioncited by 78
- 2024An Undetectable Watermark for Generative Image Modelscited by 74
- 2025Improving the Diffusability of Autoencoderscited by 74
- 2023Text + Sketch: Image Compression at Ultra Low Ratescited by 63
- 2021Transformer-based Image Compressioncited by 60
- 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 56
- 2023Frequency-Aware Transformer for Learned Image Compressioncited by 56
- 2022Coarse-to-fine Deep Video Coding with Hyperprior-guided Mode Predictioncited by 55
- 2023C3: High-performance and low-complexity neural compression from a single image or videocited by 54
- 2021Joint Global and Local Hierarchical Priors for Learned Image Compressioncited by 52
- 2025HAC++: Towards 100X Compression of 3D Gaussian Splattingcited by 52
- 2023WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Modelscited by 51
- 2023EVC: Towards Real-Time Neural Image Compression with Mask Decaycited by 46
- 2021DeepWiVe: Deep-Learning-Aided Wireless Video Transmissioncited by 45
- 2022CANF-VC: Conditional Augmented Normalizing Flows for Video Compressioncited by 44
- 2022Contextformer: A Transformer with Spatio-Channel Attention for Context Modeling in Learned Image Compressioncited by 42
- 2023Backdoor Attacks Against Deep Image Compression via Adaptive Frequency Triggercited by 40
- 2023Towards Scalable Neural Representation for Diverse Videoscited by 37
- 2024USTC-TD: A Test Dataset and Benchmark for Image and Video Coding in 2020scited by 37
- 2022DeepJSCC-Q: Constellation Constrained Deep Joint Source-Channel Codingcited by 36
- 2022Towards Semantic Communications: Deep Learning-Based Image Semantic Codingcited by 35
- 2024OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarkingcited by 35
- 2024Image-GS: Content-Adaptive Image Representation via 2D Gaussianscited by 34
- 2021Learned Image Compression with Gaussian-Laplacian-Logistic Mixture Model and Concatenated Residual Modulescited by 33
- 2024Attack-Resilient Image Watermarking Using Stable Diffusioncited by 33
- 2022Lossy Image Compression with Quantized Hierarchical VAEscited by 32
- 2022Image Compression with Product Quantized Masked Image Modelingcited by 32
- 2025Token Communications: A Large Model-Driven Framework for Cross-modal Context-aware Semantic Communicationscited by 32
50 most cited of 570 All 570 (JSON)
- 2026Task-Oriented Visual Feature Compression via Residual Vector Quantization for Device-Edge Multimodal Inference29 Sep 2026
- 2026Rate-Distortion Adaptive Primitive Selection for Omnidirectional Gaussian Splatting28 Sep 2026
- 2026REALIS: A Curated Dataset for Studying the Challenges of AI Image Detection26 Sep 2026
- 2026Where Does the Watermark Hide? Push-Pull Disentanglement for Invisible Watermark Removal22 Sep 2026
- 2026You've Seen Enough: Quality-Constrained Image Coding for Machines20 Sep 2026
- 2026Compressing 3D Gaussian Splatting via Cross-Representation Priors19 Sep 2026
- 2026PULSE: Unlocking Practical Image Compression on Single-Thread CPU16 Sep 2026
- 2026From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity9 Sep 2026
- 2026Tree-VQ: Progressive Image Compression from Pretrained Vector Quantizers3 Sep 2026
- 2026Multi-scale Image Representation Compression2 Sep 2026
- 2026Ada-TokenCom: Rate-Adaptive Token Communications via Large-Model-Driven Token Compression and Generation28 Aug 2026
- 2026M3ISR: A Multi-Modal Multi-View Benchmark for 3D/4D Gaussian Splatting and Feedforward Compression23 Aug 2026
38 more
- 2026Fast Test-Time Refinement for Robust Learned Image Compression15 Aug 2026
- 2026HAMP-LIC: Hessian-Aware Mixed-Precision Post-Training Quantization for Learned Image Compression12 Aug 2026
- 2026Every Packet Counts: Dispersing Information for Loss-Resilient Learned Image Compression11 Aug 2026
- 2026DeepFreqMark: End-To-End Learnable Frequency-Domain Watermarking with Spherical Attack Simulation for Latent Diffusion Models10 Aug 2026
- 2026Visual Token Codec: Unleashing Spatial Redundancy for ViT Feature Coding9 Aug 2026
- 2026Clear-Weighted Bit Allocation for Satellite Downlinks2 Aug 2026
- 2026ReGenVC: End-to-End Real-Time Generative Video Coding at Ultra-Low Bitrate30 Jul 2026
- 2026Correlation-Aware and Gaussianity-Preserving Robust Latent Angular Watermarking for Diffusion Models24 Jul 2026
- 2026Wavefront Parallelization for Efficient Learned Image Compression21 Jul 2026
- 2026ECoNGS: Efficient Compressive Neural Gaussian Splats for Volume Visualization20 Jul 2026
- 2026EVOLVE: Efficient Learned Volume Compression with Variable-Rate Encoding on a Cross-Domain Database20 Jul 2026
- 2026Locality-Aware Density Control for Efficient Gaussian-based Image Representation20 Jul 2026
- 2026MixCompress: Mixture of Experts for Variable Rate Learned Image Compression15 Jul 2026
- 2026Optimizing Image Preparation and Compression for Face Recognition within 1024 Bytes29 Jun 2026
- 2026MLVC: Multi-platform Learned Video Codec for Real-World Deployment26 Jun 2026
- 2026DinoLink: A Token-Centric Representation Compression Framework for Bandwidth-Constrained Collaborative V2X Perception24 Jun 2026
- 2026MambaRaw: Selective State Space Modeling for Efficient 4K Raw Image Reconstruction23 Jun 2026
- 2026MoECodec: Image Compression for joint human and machine perception via Mixture-of-Experts19 Jun 2026
- 2026Variable-Rate Deep Image Compression based on Low-Rank Adaptation by Progressive Learning15 Jun 2026
- 2026Dual-Constrained Diffusion Image Compression for Operational Rate-Distortion-Perception Optimization11 Jun 2026
- 2026Efficient, Robust, and Anti-Collusion Fingerprinting of Image Diffusion Models11 Jun 2026
- 2026Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compression1 Jun 2026
- 2026Reducing the GPU Memory Bottleneck with Lossless Compression for ML -- Extended29 May 2026
- 2026ChWDTA: Channel-wise Wavelet-Domain Transformer Attention and Entropy Modeling for Learned Image Compression27 May 2026
- 2026Efficient Learned Image Compression without Entropy Coding22 May 2026
- 2026Deep learning-based compression of giga-resolution whole slide images17 May 2026
- 2026Adaptive Fused Prior Transfer for Controllable Generative Image Compression16 May 2026
- 2026PrismQuant: Rate-Distortion-Optimal Vector Quantization for Gaussian-Mixture Sources15 May 2026
- 2026Dual-Latent Collaborative Decoding for Fidelity-Perception Balanced Image Compression14 May 2026
- 2026Coarse-to-Fine: Progressive Image Compression for Semantically Hierarchical Classification8 May 2026
- 2026Soft Anisotropic Diagrams for Differentiable Image Representation23 Apr 2026
- 2026CoD-Lite: Real-Time Diffusion-Based Generative Image Compression14 Apr 2026
- 2026NTIRE 2026 Challenge on Robust AI-Generated Image Detection in the Wild13 Apr 2026
- 2026Differentiable Vector Quantization for Rate-Distortion Optimization of Generative Image Compression12 Apr 2026
- 2026What and Where to Adapt: Structure-Semantics Co-Tuning for Machine Vision Compression via Synergistic Adapters11 Apr 2026
- 2026Towards Robust Content Watermarking Against Removal and Forgery Attacks8 Apr 2026
- 2026Prompt-Guided Prefiltering for VLM Image Compression31 Mar 2026
- 2026End-to-End Image Compression with Segmentation Guided Dual Coding for Wind Turbines31 Mar 2026
50 newest of 570 All 570 (JSON)
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 289
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 165
- 2024An Undetectable Watermark for Generative Image Modelscited by 74
- 2025Improving the Diffusability of Autoencoderscited by 74
- 2023WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Modelscited by 51
- 2024Attack-Resilient Image Watermarking Using Stable Diffusioncited by 33
- 2022Extreme Generative Image Compression by Learning Text Embedding from Diffusion Modelscited by 30
- 2024WMAdapter: Adding WaterMark Control to Latent Diffusion Modelscited by 29
- 2025StableCodec: Taming One-Step Diffusion for Extreme Image Compressioncited by 29
- 2023High Perceptual Quality Wireless Image Delivery with Denoising Diffusion Modelscited by 23
- 2025One-Step Diffusion-Based Image Compression with Semantic Distillationcited by 23
- 2024DiffuseTrace: A Transparent and Flexible Watermarking Scheme for Latent Diffusion Modelcited by 21
12 most cited of 52 All 52 (JSON)
- 2026DeepFreqMark: End-To-End Learnable Frequency-Domain Watermarking with Spherical Attack Simulation for Latent Diffusion Models10 Aug 2026
- 2026Correlation-Aware and Gaussianity-Preserving Robust Latent Angular Watermarking for Diffusion Models24 Jul 2026
- 2026Efficient, Robust, and Anti-Collusion Fingerprinting of Image Diffusion Models11 Jun 2026
- 2026Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compression1 Jun 2026
- 2026CoD-Lite: Real-Time Diffusion-Based Generative Image Compression14 Apr 2026
- 2026GVCC: Zero-Shot Video Compression via Codebook-Driven Stochastic Rectified Flow27 Mar 2026
- 2026Gaussian Shannon: High-Precision Diffusion Model Watermarking Based on Communication27 Mar 2026
- 2026Joint Degradation-Aware Arbitrary-Scale Super-Resolution for Variable-Rate Extreme Image Compression18 Mar 2026
- 2026Next-Frame Decoding for Ultra-Low-Bitrate Image Compression with Video Diffusion Priors16 Mar 2026
- 2026CADC: Content Adaptive Diffusion-Based Generative Image Compression25 Feb 2026
- 2026ONRW: Optimizing inversion noise for high-quality and robust watermark24 Jan 2026
- 2026PhaseMark: A Post-hoc, Optimization-Free Watermarking of AI-generated Images in the Latent Frequency Domain19 Jan 2026
12 newest of 52 All 52 (JSON)
- 2023Invisible Image Watermarks Are Provably Removable Using Generative AIcited by 124
- 2024LaWa: Using Latent Space for In-Generation Image Watermarkingcited by 27
- 2024Protecting NeRFs' Copyright via Plug-And-Play Watermarking Base Modelcited by 18
- 2025Watermarking Autoregressive Image Generationcited by 15
- 2024RAW: A Robust and Agile Plug-and-Play Watermark Framework for AI-Generated Images with Provable Guaranteescited by 7
- 2025OptMark: Robust Multi-bit Diffusion Watermarking via Inference Time Optimizationcited by 2
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspectivecited by 1
- 2025MOLM: Mixture of LoRA Markerscited by 0
- 2026ALIEN: Analytic Latent Watermarking for Controllable Generationcited by 0
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspective25 Mar 2026
- 2026ALIEN: Analytic Latent Watermarking for Controllable Generation5 Feb 2026
- 2025MOLM: Mixture of LoRA Markers30 Sep 2025
- 2025OptMark: Robust Multi-bit Diffusion Watermarking via Inference Time Optimization29 Aug 2025
- 2025Watermarking Autoregressive Image Generation19 Jun 2025
- 2024LaWa: Using Latent Space for In-Generation Image Watermarking11 Aug 2024
- 2024Protecting NeRFs' Copyright via Plug-And-Play Watermarking Base Model10 Jul 2024
- 2024RAW: A Robust and Agile Plug-and-Play Watermark Framework for AI-Generated Images with Provable Guarantees23 Jan 2024
- 2023Invisible Image Watermarks Are Provably Removable Using Generative AI2 Jun 2023
- 2025Task-Oriented Feature Compression for Multimodal Understanding via Device-Edge Co-Inferencecited by 18
- 2024High Efficiency Image Compression for Large Visual-Language Modelscited by 6
- 2024Tell Codec What Worth Compressing: Semantically Disentangled Image Coding for Machine with LMMscited by 5
- 2025Revisiting MLLM Token Technology through the Lens of Classical Visual Codingcited by 3
- 2025UniMIC: Token-Based Multimodal Interactive Coding for Human-AI Collaborationcited by 0
- 2025Benchmarking and Enhancing VLM for Compressed Image Understandingcited by 0
- 2026Prompt-Guided Prefiltering for VLM Image Compressioncited by 0
- 2026Task-Oriented Visual Feature Compression via Residual Vector Quantization for Device-Edge Multimodal Inferencecited by 0
- 2026Task-Oriented Visual Feature Compression via Residual Vector Quantization for Device-Edge Multimodal Inference29 Sep 2026
- 2026Prompt-Guided Prefiltering for VLM Image Compression31 Mar 2026
- 2025Benchmarking and Enhancing VLM for Compressed Image Understanding24 Dec 2025
- 2025UniMIC: Token-Based Multimodal Interactive Coding for Human-AI Collaboration26 Sep 2025
- 2025Revisiting MLLM Token Technology through the Lens of Classical Visual Coding19 Aug 2025
- 2025Task-Oriented Feature Compression for Multimodal Understanding via Device-Edge Co-Inference17 Mar 2025
- 2024Tell Codec What Worth Compressing: Semantically Disentangled Image Coding for Machine with LMMs16 Aug 2024
- 2024High Efficiency Image Compression for Large Visual-Language Models24 Jul 2024
- 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 425
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2021COIN: COmpression with Implicit Neural representationscited by 232
- 2021Deep Contextual Video Compressioncited by 216
- 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 205
- 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 202
- 2021Checkerboard Context Model for Efficient Learned Image Compressioncited by 193
- 2021Implicit Neural Representations for Image Compressioncited by 161
- 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 141
- 2022Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compressioncited by 123
- 2021Temporal Context Mining for Learned Video Compressioncited by 112
- 2022Entroformer: A Transformer-based Entropy Model for Learned Image Compressioncited by 102
12 most cited of 492 All 492 (JSON)
- 2026Rate-Distortion Adaptive Primitive Selection for Omnidirectional Gaussian Splatting28 Sep 2026
- 2026REALIS: A Curated Dataset for Studying the Challenges of AI Image Detection26 Sep 2026
- 2026Where Does the Watermark Hide? Push-Pull Disentanglement for Invisible Watermark Removal22 Sep 2026
- 2026You've Seen Enough: Quality-Constrained Image Coding for Machines20 Sep 2026
- 2026Compressing 3D Gaussian Splatting via Cross-Representation Priors19 Sep 2026
- 2026PULSE: Unlocking Practical Image Compression on Single-Thread CPU16 Sep 2026
- 2026From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity9 Sep 2026
- 2026Tree-VQ: Progressive Image Compression from Pretrained Vector Quantizers3 Sep 2026
- 2026Multi-scale Image Representation Compression2 Sep 2026
- 2026M3ISR: A Multi-Modal Multi-View Benchmark for 3D/4D Gaussian Splatting and Feedforward Compression23 Aug 2026
- 2026Fast Test-Time Refinement for Robust Learned Image Compression15 Aug 2026
- 2026HAMP-LIC: Hessian-Aware Mixed-Precision Post-Training Quantization for Learned Image Compression12 Aug 2026
12 newest of 492 All 492 (JSON)