mlsanityData to 14 Oct 2026

Next-Frame Decoding for Ultra-Low-Bitrate Image Compression with Video Diffusion Priors

arXiv 2603.15129 ↗First posted 16 Mar 2026cs.CVcited by 3

On the map: Diffusion models → Diffusion for compression and wireless

Abstract (arXiv)

We present a novel paradigm for ultra-low-bitrate image compression (ULB-IC) that exploits the ``temporal'' evolution in generative image compression. Specifically, we define an explicit intermediate state during decoding: a compact anchor frame, which preserves the scene geometry and semantic layout while discarding high-frequency details. We then reinterpret generative decoding as a virtual temporal transition from this anchor to the final reconstructed image. To model this progression, we leverage a pretrained video diffusion model (VDM) as a temporal prior: the anchor frame serves as the initial frame and the original image as the target frame, transforming the decoding process into a next-frame prediction task. In contrast to image diffusion-based ULB-IC models, our decoding proceeds from a visible, semantically faithful anchor, which improves both fidelity and realism for perceptual image compression. Extensive experiments demonstrate that our method achieves superior rate-distortion performance. On the CLIC2020 test set, our method achieves over 50% bitrate savings across LPIPS, DISTS, FID, and KID compared to DiffC, while also delivering a significant decoding speedup of up to ×5. Code will be released at https://github.com/UnoC-727/NeFIC.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Diffusion for compression and wireless, one of 14 directions in Diffusion models. Builds on 89 of its 108 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

89 of 108 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025Generative Image Coding with Diffusion Prior17 Sep
  2. 2025StableCodec: Taming One-Step Diffusion for Extreme Image Compression27 Jun
  3. 2025One-Step Diffusion-Based Image Compression with Semantic Distillation22 May
  4. 2025OSCAR: One-Step Diffusion Codec Across Multiple Bit-rates22 May
  5. 2025Ultra Lowrate Image Compression with Semantic Residual Coding and Compression-aware Diffusion13 May
  6. 2025PICD: Versatile Perceptual Image Compression with Diffusion Rendering9 May
  7. 2025Lossy Compression with Pretrained Diffusion Models16 Jan
  8. 2024RDEIC: Accelerating Diffusion-Based Extreme Image Compression with Relay Residual Diffusion3 Oct
  9. 2024PerCo (SD): Open Perceptual Compression30 Sep
  10. 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Prior29 Apr
  11. 2024Lossy Image Compression with Foundation Diffusion Models12 Apr
  12. 2024Correcting Diffusion-Based Perceptual Image Compression with Privileged End-to-End Decoder7 Apr
4 more
  1. 2023High-Fidelity Image Compression with Score-based Generative Models26 May
  2. 2023A Residual Diffusion Model for High Perceptual Quality Codec Augmentation13 Jan
  3. 2022Lossy Image Compression with Conditional Diffusion Models14 Sep
  4. 2022Lossy Compression with Gaussian Diffusion17 Jun

Other references · 73

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2022Generative Adversarial Networkscited by 5,627
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  12. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
38 more
  1. 2022Video Diffusion Modelscited by 2,305
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  3. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  5. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  6. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  7. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  8. 2018Demystifying MMD GANscited by 1,293
  9. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  10. 2018Variational image compression with a scale hyperpriorcited by 935
  11. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  12. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  13. 2016End-to-end Optimized Image Compressioncited by 696
  14. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 664
  15. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 590
  16. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
  17. 2020High-Fidelity Generative Image Compressioncited by 338
  18. 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 301
  19. 2020Channel-wise Autoregressive Entropy Models for Learned Image Compressioncited by 264
  20. 2018Generative Adversarial Networks for Extreme Learned Image Compressioncited by 219
  21. 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 211
  22. 2023Neural Video Compression with Diverse Contextscited by 165
  23. 2022The Devil Is in the Details: Window-based Attention for Image Compressioncited by 147
  24. 2022Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compressioncited by 128
  25. 2023Towards image compression with perfect realism at ultra-low bitratescited by 103
  26. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
  27. 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 94
  28. 2021Ensembling Off-the-shelf Models for GAN Trainingcited by 86
  29. 2022MLIC: Multi-Reference Entropy Model for Learned Image Compressioncited by 84
  30. 2022Multi-Realism Image Compression with a Conditional Generatorcited by 80
  31. 2023Text + Sketch: Image Compression at Ultra Low Ratescited by 67
  32. 2020A Unified End-to-End Framework for Efficient Deep Image Compressioncited by 58
  33. 2023MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compressioncited by 58
  34. 2023Frequency-Aware Transformer for Learned Image Compressioncited by 58
  35. 2023EVC: Towards Real-Time Neural Image Compression with Mask Decaycited by 49
  36. 2022Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Modelscited by 45
  37. 2024LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexitycited by 43
  38. 2022Image Compression with Product Quantized Masked Image Modelingcited by 33

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Single-step Diffusion for Image Compression at Ultra-Low Bitrates
  2. 2026Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusion
  3. 2026A Causal Diffusion Model for Video Reconstruction from Ultra-Low-Bitrate Representations
  4. 2026Rethinking Generative Image Compression at Extremely Low Bitrates
  5. 2026Diffusion-aided Extreme Video Compression with Lightweight Semantics Guidance
  6. 2026Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compression
  7. 2025Low-Bitrate Video Compression through Semantic-Conditioned Diffusion
  8. 2026ReGenVC: End-to-End Real-Time Generative Video Coding at Ultra-Low Bitrate