Variational image compression with a scale hyperprior
Not on the map. Why?
Cited by 77 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We describe an end-to-end trainable model for image compression based on variational autoencoders. The model incorporates a hyperprior to effectively capture spatial dependencies in the latent representation. This hyperprior relates to side information, a concept universal to virtually all modern image codecs, but largely unexplored in image compression using artificial neural networks (ANNs). Unlike existing autoencoder compression methods, our model trains a complex prior jointly with the underlying autoencoder. We demonstrate that this model leads to state-of-the-art image compression when measuring visual quality using the popular MS-SSIM index, and yields rate-distortion performance surpassing published ANN-based methods when evaluated using a more traditional metric based on squared error (PSNR). Furthermore, we provide a qualitative comparison of models trained for different distortion metrics.
Key facts. Cited by 910 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 94; 2022: 125; 2023: 146; 2024: 207; 2025: 193; 2026: 145.
910 papers.
Sort:
By area:
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 289
- 2021COIN: COmpression with Implicit Neural representationscited by 232
- 2021Deep Contextual Video Compressioncited by 216
- 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 205
- 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 202
- 2021Checkerboard Context Model for Efficient Learned Image Compressioncited by 193
- 2023EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingScited by 191
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 165
- 2021Implicit Neural Representations for Image Compressioncited by 161
- 2023Neural Video Compression with Diverse Contextscited by 155
- 2021FVC: A New Framework towards Deep Video Compression in Feature Spacecited by 149
38 more
- 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 141
- 2023Invisible Image Watermarks Are Provably Removable Using Generative AIcited by 124
- 2022Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compressioncited by 123
- 2024Neural Video Compression with Feature Modulationcited by 115
- 2021Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challengescited by 114
- 2021Temporal Context Mining for Learned Video Compressioncited by 112
- 2022Entroformer: A Transformer-based Entropy Model for Learned Image Compressioncited by 102
- 2023Towards image compression with perfect realism at ultra-low bitratescited by 99
- 2024ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Modelcited by 98
- 2024GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splattingcited by 97
- 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 90
- 2024WAVES: Benchmarking the Robustness of Image Watermarkscited by 89
- 2023Collaborative Perception in Autonomous Driving: Methods, Datasets and Challengescited by 87
- 2022COIN++: Neural Compression Across Modalitiescited by 81
- 2024CompGS: Efficient 3D Scene Representation via Compressed Gaussian Splattingcited by 80
- 2022Multi-Realism Image Compression with a Conditional Generatorcited by 79
- 2022An Introduction to Neural Data Compressioncited by 78
- 2022VCT: A Video Compression Transformercited by 74
- 2024An Undetectable Watermark for Generative Image Modelscited by 74
- 2025Improving the Diffusability of Autoencoderscited by 74
- 2021Nonlinear Transform Source-Channel Coding for Semantic Communicationscited by 73
- 2023HiNeRV: Video Compression with Hierarchical Encoding-based Neural Representationcited by 70
- 2021Sparse Tensor-based Multiscale Representation for Point Cloud Geometry Compressioncited by 69
- 2021ELF-VC: Efficient Learned Flexible-Rate Video Codingcited by 68
- 2021VoxelContext-Net: An Octree based Framework for Point Cloud Compressioncited by 60
- 2021Transformer-based Image Compressioncited by 60
- 2021Variable-Rate Deep Image Compression through Spatially-Adaptive Feature Transformcited by 56
- 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 56
- 2023Frequency-Aware Transformer for Learned Image Compressioncited by 56
- 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Priorcited by 56
- 2022Coarse-to-fine Deep Video Coding with Hyperprior-guided Mode Predictioncited by 55
- 2023C3: High-performance and low-complexity neural compression from a single image or videocited by 54
- 2021Joint Global and Local Hierarchical Priors for Learned Image Compressioncited by 52
- 2025HAC++: Towards 100X Compression of 3D Gaussian Splattingcited by 52
- 2021Lossy Compression for Lossless Predictioncited by 51
- 2021Optimal Representations for Covariate Shiftcited by 51
- 2023WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Modelscited by 51
- 2022NIRVANA: Neural Implicit Representations of Videos with Adaptive Networks and Autoregressive Patch-wise Modelingcited by 50
50 most cited of 910 All 910 (JSON)
- 2026Latent Watermarks under Generative Editing: A Benchmark and Analysis of Detection Survival7 Oct 2026
- 2026WARP: A Unified Benchmark for Invisible Image Watermarking -- Robustness and Protection Against Attacks30 Sep 2026
- 2026ResARC: Residual-Aware AutoRegressive Coding for Ultra-Low Bitrate Image Compression30 Sep 2026
- 2026Rethinking Generative Image Compression at Extremely Low Bitrates30 Sep 2026
- 2026On Task Scope and Information Retention in Source Coding29 Sep 2026
- 2026Task-Oriented Visual Feature Compression via Residual Vector Quantization for Device-Edge Multimodal Inference29 Sep 2026
- 2026Rate-Distortion Adaptive Primitive Selection for Omnidirectional Gaussian Splatting28 Sep 2026
- 2026FeCoSplat: Feedback-Guided Compression for Feed-Forward 3D Gaussian Splatting27 Sep 2026
- 2026Learned Compression of SAR Phase-History Data: A Rate-Honest Feasibility Study on GOTCHA25 Sep 2026
- 2026Rate-Adaptive One-Step Diffusion Compression for AIGC Images25 Sep 2026
- 2026FeatMark: Feature-level Watermark Protection against Mimicry Attacks with Diffusion Models25 Sep 2026
- 2026Selective Amortization of Full-Budget Counterfactual Reasoning for Visual Token Communication25 Sep 2026
38 more
- 2026Towards Practical Compression of 3D Gaussian Splatting24 Sep 2026
- 2026Where Does the Watermark Hide? Push-Pull Disentanglement for Invisible Watermark Removal22 Sep 2026
- 2026Neural Residual Modeling for Scientific Data Compression under Guaranteed Error Bounds19 Sep 2026
- 2026Compressing 3D Gaussian Splatting via Cross-Representation Priors19 Sep 2026
- 2026PULSE: Unlocking Practical Image Compression on Single-Thread CPU16 Sep 2026
- 2026Semantic-Aware Neural Video Codec for Error-Resilient Low-Latency Transmission14 Sep 2026
- 2026EMMI: Edge Multi-Modal Intelligence for Communication-Efficient MLLM Inference via Fused Representation Compression10 Sep 2026
- 2026PIC: Revisiting INR for Image Coding with Fast Encoding and Sub-Millisecond Decoding8 Sep 2026
- 2026Tree-VQ: Progressive Image Compression from Pretrained Vector Quantizers3 Sep 2026
- 2026Multi-scale Image Representation Compression2 Sep 2026
- 2026Superposed Latent Autoencoder1 Sep 2026
- 2026Ada-TokenCom: Rate-Adaptive Token Communications via Large-Model-Driven Token Compression and Generation28 Aug 2026
- 2026Distributed Semantic Segmentation With Improved Rate-Distortion Trade-Off26 Aug 2026
- 2026CrossMambaTuning: Synergistic Spatial and Cross-Layer Adaptation for Machine Vision Compression26 Aug 2026
- 2026Token-Oriented Semantic Communication with Pretrained Vision Transformers26 Aug 2026
- 2026M3ISR: A Multi-Modal Multi-View Benchmark for 3D/4D Gaussian Splatting and Feedforward Compression23 Aug 2026
- 2026HiFiC-G: Adapting HiFiC for Hi-C Contact Matrices19 Aug 2026
- 2026UniTAC: Universal Task-Aware Compression via Weighted Distortion Measures17 Aug 2026
- 2026Hardware-Aware Deployment of Joint SAR Compression and Despeckling on FPGA11 Aug 2026
- 2026Every Packet Counts: Dispersing Information for Loss-Resilient Learned Image Compression11 Aug 2026
- 2026Multiple Scale Latents for Learned Image Compression11 Aug 2026
- 2026Mixture-of-Experts-based Entropy Model for Learned Image Compression11 Aug 2026
- 2026DeepFreqMark: End-To-End Learnable Frequency-Domain Watermarking with Spherical Attack Simulation for Latent Diffusion Models10 Aug 2026
- 2026Visual Token Codec: Unleashing Spatial Redundancy for ViT Feature Coding9 Aug 2026
- 2026FARI: Robust One-Step Inversion for Watermarking in Diffusion Models29 Jul 2026
- 2026Codebook Capacity Governs Perceptual Quality Across Resolutions in Hierarchical Discrete Video Compression25 Jul 2026
- 2026Correlation-Aware and Gaussianity-Preserving Robust Latent Angular Watermarking for Diffusion Models24 Jul 2026
- 2026Wavefront Parallelization for Efficient Learned Image Compression21 Jul 2026
- 2026ECoNGS: Efficient Compressive Neural Gaussian Splats for Volume Visualization20 Jul 2026
- 2026EVOLVE: Efficient Learned Volume Compression with Variable-Rate Encoding on a Cross-Domain Database20 Jul 2026
- 2026Locality-Aware Density Control for Efficient Gaussian-based Image Representation20 Jul 2026
- 2026MixCompress: Mixture of Experts for Variable Rate Learned Image Compression15 Jul 2026
- 2026DCVC-MB: Neural B-Frame Video Compression using State Space Models15 Jul 2026
- 2026Differentiable Proxy Learning for Adaptive Quantization Control in H.264 Video Coding11 Jul 2026
- 2026Collaborative Synthetic Data Generation for Knowledge Transfer in Federated Learning8 Jul 2026
- 2026Optimizing Image Preparation and Compression for Face Recognition within 1024 Bytes29 Jun 2026
- 2026Entropy-Coded MS-VQ-VAE with Learned Priors for Ultra-Low Bitrate Video Compression28 Jun 2026
- 2026Enhanced Neural Video Representation Compression Across Extreme Complexity and Quality Scales26 Jun 2026
50 newest of 910 All 910 (JSON)
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 289
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 165
- 2024An Undetectable Watermark for Generative Image Modelscited by 74
- 2025Improving the Diffusability of Autoencoderscited by 74
- 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Priorcited by 56
- 2023WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Modelscited by 51
- 2024Lossy Image Compression with Foundation Diffusion Modelscited by 34
- 2023A Residual Diffusion Model for High Perceptual Quality Codec Augmentationcited by 33
- 2024Attack-Resilient Image Watermarking Using Stable Diffusioncited by 33
- 2022Extreme Generative Image Compression by Learning Text Embedding from Diffusion Modelscited by 30
- 2024WMAdapter: Adding WaterMark Control to Latent Diffusion Modelscited by 29
- 2025StableCodec: Taming One-Step Diffusion for Extreme Image Compressioncited by 29
12 most cited of 77 All 77 (JSON)
- 2026FeatMark: Feature-level Watermark Protection against Mimicry Attacks with Diffusion Models25 Sep 2026
- 2026DeepFreqMark: End-To-End Learnable Frequency-Domain Watermarking with Spherical Attack Simulation for Latent Diffusion Models10 Aug 2026
- 2026FARI: Robust One-Step Inversion for Watermarking in Diffusion Models29 Jul 2026
- 2026Correlation-Aware and Gaussianity-Preserving Robust Latent Angular Watermarking for Diffusion Models24 Jul 2026
- 2026FlowCodec: One-Step Flow Prior for Generative Image Compression19 Jun 2026
- 2026Efficient, Robust, and Anti-Collusion Fingerprinting of Image Diffusion Models11 Jun 2026
- 2026Few-step Generative Models as Lossy Compression9 Jun 2026
- 2026CoD-Lite: Real-Time Diffusion-Based Generative Image Compression14 Apr 2026
- 2026A Noise Constrained Diffusion (NC-Diffusion) Framework for High Fidelity Image Compression8 Apr 2026
- 2026On the Robustness of Diffusion-Based Image Compression to Bit-Flip Errors7 Apr 2026
- 2026Region-Adaptive Generative Compression with Spatially Varying Diffusion Models1 Apr 2026
- 2026GVCC: Zero-Shot Video Compression via Codebook-Driven Stochastic Rectified Flow27 Mar 2026
12 newest of 77 All 77 (JSON)
- 2023Invisible Image Watermarks Are Provably Removable Using Generative AIcited by 124
- 2024LaWa: Using Latent Space for In-Generation Image Watermarkingcited by 27
- 2024Protecting NeRFs' Copyright via Plug-And-Play Watermarking Base Modelcited by 18
- 2025Watermarking Autoregressive Image Generationcited by 15
- 2024RAW: A Robust and Agile Plug-and-Play Watermark Framework for AI-Generated Images with Provable Guaranteescited by 7
- 2025OptMark: Robust Multi-bit Diffusion Watermarking via Inference Time Optimizationcited by 2
- 2026DeMark: A Query-Free Black-Box Attack on Deepfake Watermarking Defensescited by 1
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspectivecited by 1
- 2025MOLM: Mixture of LoRA Markerscited by 0
- 2026ALIEN: Analytic Latent Watermarking for Controllable Generationcited by 0
- 2026Latent Watermarks under Generative Editing: A Benchmark and Analysis of Detection Survivalcited by 0
- 2026Latent Watermarks under Generative Editing: A Benchmark and Analysis of Detection Survival7 Oct 2026
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspective25 Mar 2026
- 2026ALIEN: Analytic Latent Watermarking for Controllable Generation5 Feb 2026
- 2026DeMark: A Query-Free Black-Box Attack on Deepfake Watermarking Defenses23 Jan 2026
- 2025MOLM: Mixture of LoRA Markers30 Sep 2025
- 2025OptMark: Robust Multi-bit Diffusion Watermarking via Inference Time Optimization29 Aug 2025
- 2025Watermarking Autoregressive Image Generation19 Jun 2025
- 2024LaWa: Using Latent Space for In-Generation Image Watermarking11 Aug 2024
- 2024Protecting NeRFs' Copyright via Plug-And-Play Watermarking Base Model10 Jul 2024
- 2024RAW: A Robust and Agile Plug-and-Play Watermark Framework for AI-Generated Images with Provable Guarantees23 Jan 2024
- 2023Invisible Image Watermarks Are Provably Removable Using Generative AI2 Jun 2023
- 2025Task-Oriented Feature Compression for Multimodal Understanding via Device-Edge Co-Inferencecited by 18
- 2024Bridging Compressed Image Latents and Multimodal Large Language Modelscited by 8
- 2024High Efficiency Image Compression for Large Visual-Language Modelscited by 6
- 2024Tell Codec What Worth Compressing: Semantically Disentangled Image Coding for Machine with LMMscited by 5
- 2025Revisiting MLLM Token Technology through the Lens of Classical Visual Codingcited by 3
- 2024LL-ICM: Image Compression for Low-level Machine Vision via Large Vision-Language Modelcited by 0
- 2025Privacy-Shielded Image Compression: Defending Against Exploitation from Vision-Language Pretrained Modelscited by 0
- 2025Benchmarking and Enhancing VLM for Compressed Image Understandingcited by 0
- 2026Task-Oriented Visual Feature Compression via Residual Vector Quantization for Device-Edge Multimodal Inferencecited by 0
- 2026Task-Oriented Visual Feature Compression via Residual Vector Quantization for Device-Edge Multimodal Inference29 Sep 2026
- 2025Benchmarking and Enhancing VLM for Compressed Image Understanding24 Dec 2025
- 2025Revisiting MLLM Token Technology through the Lens of Classical Visual Coding19 Aug 2025
- 2025Privacy-Shielded Image Compression: Defending Against Exploitation from Vision-Language Pretrained Models18 Jun 2025
- 2025Task-Oriented Feature Compression for Multimodal Understanding via Device-Edge Co-Inference17 Mar 2025
- 2024LL-ICM: Image Compression for Low-level Machine Vision via Large Vision-Language Model5 Dec 2024
- 2024Tell Codec What Worth Compressing: Semantically Disentangled Image Coding for Machine with LMMs16 Aug 2024
- 2024Bridging Compressed Image Latents and Multimodal Large Language Models29 Jul 2024
- 2024High Efficiency Image Compression for Large Visual-Language Models24 Jul 2024
- 2024MambaVC: Learned Visual Compression with Selective State Spacescited by 28
- 2025Content-Aware Mamba for Learned Image Compressioncited by 5
- 2026SAMIC: A Lightweight Semantic-Aware Mamba for Efficient Perceptual Image Compressioncited by 0
- 2026MambaRaw: Selective State Space Modeling for Efficient 4K Raw Image Reconstructioncited by 0
- 2026DCVC-MB: Neural B-Frame Video Compression using State Space Modelscited by 0
- 2026DCVC-MB: Neural B-Frame Video Compression using State Space Models15 Jul 2026
- 2026MambaRaw: Selective State Space Modeling for Efficient 4K Raw Image Reconstruction23 Jun 2026
- 2026SAMIC: A Lightweight Semantic-Aware Mamba for Efficient Perceptual Image Compression6 May 2026
- 2025Content-Aware Mamba for Learned Image Compression4 Aug 2025
- 2024MambaVC: Learned Visual Compression with Selective State Spaces24 May 2024
- 20253D Gaussian Splatting Data Compression with Mixture of Priorscited by 5
- 2026MoECodec: Image Compression for joint human and machine perception via Mixture-of-Expertscited by 0
- 2026MixCompress: Mixture of Experts for Variable Rate Learned Image Compressioncited by 0
- 2026Mixture-of-Experts-based Entropy Model for Learned Image Compressioncited by 0
- 2026Mixture-of-Experts-based Entropy Model for Learned Image Compression11 Aug 2026
- 2026MixCompress: Mixture of Experts for Variable Rate Learned Image Compression15 Jul 2026
- 2026MoECodec: Image Compression for joint human and machine perception via Mixture-of-Experts19 Jun 2026
- 20253D Gaussian Splatting Data Compression with Mixture of Priors6 May 2025
- 2021Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challengescited by 114
- 2026FibQuant: Universal Vector Quantization for Random-Access KV-Cache Compressioncited by 2
- 2026Ada-TokenCom: Rate-Adaptive Token Communications via Large-Model-Driven Token Compression and Generationcited by 1
- 2026Ada-TokenCom: Rate-Adaptive Token Communications via Large-Model-Driven Token Compression and Generation28 Aug 2026
- 2026FibQuant: Universal Vector Quantization for Random-Access KV-Cache Compression12 May 2026
- 2021Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges8 Mar 2021
- 2026Learned Image Compression for Vision-Language-Action Models15 Jun 2026
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2021COIN: COmpression with Implicit Neural representationscited by 232
- 2021Deep Contextual Video Compressioncited by 216
- 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 205
- 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 202
- 2021Checkerboard Context Model for Efficient Learned Image Compressioncited by 193
- 2023EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingScited by 191
- 2021Implicit Neural Representations for Image Compressioncited by 161
- 2023Neural Video Compression with Diverse Contextscited by 155
- 2021FVC: A New Framework towards Deep Video Compression in Feature Spacecited by 149
- 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 141
- 2022Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compressioncited by 123
12 most cited of 799 All 799 (JSON)
- 2026WARP: A Unified Benchmark for Invisible Image Watermarking -- Robustness and Protection Against Attacks30 Sep 2026
- 2026ResARC: Residual-Aware AutoRegressive Coding for Ultra-Low Bitrate Image Compression30 Sep 2026
- 2026Rethinking Generative Image Compression at Extremely Low Bitrates30 Sep 2026
- 2026On Task Scope and Information Retention in Source Coding29 Sep 2026
- 2026Rate-Distortion Adaptive Primitive Selection for Omnidirectional Gaussian Splatting28 Sep 2026
- 2026FeCoSplat: Feedback-Guided Compression for Feed-Forward 3D Gaussian Splatting27 Sep 2026
- 2026Learned Compression of SAR Phase-History Data: A Rate-Honest Feasibility Study on GOTCHA25 Sep 2026
- 2026Rate-Adaptive One-Step Diffusion Compression for AIGC Images25 Sep 2026
- 2026Selective Amortization of Full-Budget Counterfactual Reasoning for Visual Token Communication25 Sep 2026
- 2026Towards Practical Compression of 3D Gaussian Splatting24 Sep 2026
- 2026Where Does the Watermark Hide? Push-Pull Disentanglement for Invisible Watermark Removal22 Sep 2026
- 2026Neural Residual Modeling for Scientific Data Compression under Guaranteed Error Bounds19 Sep 2026
12 newest of 799 All 799 (JSON)