Next-Frame Decoding for Ultra-Low-Bitrate Image Compression with Video Diffusion Priors
On the map: Diffusion models → Diffusion for compression and wireless
Abstract (arXiv)
We present a novel paradigm for ultra-low-bitrate image compression (ULB-IC) that exploits the ``temporal'' evolution in generative image compression. Specifically, we define an explicit intermediate state during decoding: a compact anchor frame, which preserves the scene geometry and semantic layout while discarding high-frequency details. We then reinterpret generative decoding as a virtual temporal transition from this anchor to the final reconstructed image. To model this progression, we leverage a pretrained video diffusion model (VDM) as a temporal prior: the anchor frame serves as the initial frame and the original image as the target frame, transforming the decoding process into a next-frame prediction task. In contrast to image diffusion-based ULB-IC models, our decoding proceeds from a visible, semantically faithful anchor, which improves both fidelity and realism for perceptual image compression. Extensive experiments demonstrate that our method achieves superior rate-distortion performance. On the CLIC2020 test set, our method achieves over 50% bitrate savings across LPIPS, DISTS, FID, and KID compared to DiffC, while also delivering a significant decoding speedup of up to ×5. Code will be released at https://github.com/UnoC-727/NeFIC.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Diffusion for compression and wireless, one of 14 directions in Diffusion models. Builds on 89 of its 108 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
89 of 108 references.
Closest ancestors · 16
Same direction, newest first
- 2025Generative Image Coding with Diffusion Prior17 Sep
- 2025StableCodec: Taming One-Step Diffusion for Extreme Image Compression27 Jun
- 2025One-Step Diffusion-Based Image Compression with Semantic Distillation22 May
- 2025OSCAR: One-Step Diffusion Codec Across Multiple Bit-rates22 May
- 2025Ultra Lowrate Image Compression with Semantic Residual Coding and Compression-aware Diffusion13 May
- 2025PICD: Versatile Perceptual Image Compression with Diffusion Rendering9 May
- 2025Lossy Compression with Pretrained Diffusion Models16 Jan
- 2024RDEIC: Accelerating Diffusion-Based Extreme Image Compression with Relay Residual Diffusion3 Oct
- 2024PerCo (SD): Open Perceptual Compression30 Sep
- 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Prior29 Apr
- 2024Lossy Image Compression with Foundation Diffusion Models12 Apr
- 2024Correcting Diffusion-Based Perceptual Image Compression with Privileged End-to-End Decoder7 Apr
4 more
Other references · 73
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
38 more
- 2022Video Diffusion Modelscited by 2,305
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2018Demystifying MMD GANscited by 1,293
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2018Variational image compression with a scale hyperpriorcited by 935
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2016End-to-end Optimized Image Compressioncited by 696
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 664
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 590
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
- 2020High-Fidelity Generative Image Compressioncited by 338
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 301
- 2020Channel-wise Autoregressive Entropy Models for Learned Image Compressioncited by 264
- 2018Generative Adversarial Networks for Extreme Learned Image Compressioncited by 219
- 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 211
- 2023Neural Video Compression with Diverse Contextscited by 165
- 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 147
- 2022Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compressioncited by 128
- 2023Towards image compression with perfect realism at ultra-low bitratescited by 103
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
- 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 94
- 2021Ensembling Off-the-shelf Models for GAN Trainingcited by 86
- 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 84
- 2022Multi-Realism Image Compression with a Conditional Generatorcited by 80
- 2023Text + Sketch: Image Compression at Ultra Low Ratescited by 67
- 2020A Unified End-to-End Framework for Efficient Deep Image Compressioncited by 58
- 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 58
- 2023Frequency-Aware Transformer for Learned Image Compressioncited by 58
- 2023EVC: Towards Real-Time Neural Image Compression with Mask Decaycited by 49
- 2022Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Modelscited by 45
- 2024LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexitycited by 43
- 2022Image Compression with Product Quantized Masked Image Modelingcited by 33
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Single-step Diffusion for Image Compression at Ultra-Low Bitrates
- 2026Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusion
- 2026A Causal Diffusion Model for Video Reconstruction from Ultra-Low-Bitrate Representations
- 2026Rethinking Generative Image Compression at Extremely Low Bitrates
- 2026Diffusion-aided Extreme Video Compression with Lightweight Semantics Guidance
- 2026Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compression
- 2025Low-Bitrate Video Compression through Semantic-Conditioned Diffusion
- 2026ReGenVC: End-to-End Real-Time Generative Video Coding at Ultra-Low Bitrate