mlsanityData to 7 Oct 2026

Generative Preprocessing for Image Compression with Pre-trained Diffusion Models

arXiv 2512.15270 ↗First posted 17 Dec 2025eess.IV cs.CV cs.MMcited by 0

On the map: Diffusion models → Diffusion for compression and wireless

Abstract (arXiv)

Preprocessing is a well-established technique for optimizing compression, yet existing methods are predominantly Rate-Distortion (R-D) optimized and constrained by pixel-level fidelity. This work pioneers a shift towards Rate-Perception (R-P) optimization by, for the first time, adapting a large-scale pre-trained diffusion model for compression preprocessing. We propose a two-stage framework: first, we distill the multi-step Stable Diffusion 2.1 into a compact, one-step image-to-image model using Consistent Score Identity Distillation (CiD). Second, we perform a parameter-efficient fine-tuning of the distilled model's attention modules, guided by a Rate-Perception loss and a differentiable codec surrogate. Our method seamlessly integrates with standard codecs without any modification and leverages the model's powerful generative priors to enhance texture and mitigate artifacts. Experiments show substantial R-P gains, achieving up to a 30.13% BD-rate reduction in DISTS on the Kodak dataset and delivering superior subjective visual quality.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion for compression and wireless, one of 14 directions in Diffusion models. Builds on 15 of its 20 references that are in the map. First posted on arXiv 17 Dec 2025.

Builds on

15 of 20 references.

References · 15

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2022Generative Adversarial Networkscited by 5,603
  8. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  9. 2018Variational image compression with a scale hyperpriorcited by 910
  10. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  11. 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
  12. 2020High-Fidelity Generative Image Compressioncited by 331
3 more
  1. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
  2. 2019Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoffcited by 207
  3. 2025GenDR: Lighten Generative Detail Restorationcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Generative Image Coding with Diffusion Prior
  2. 2024Enhancing the Rate-Distortion-Perception Flexibility of Learned Image Codecs with Conditional Diffusion Decoders
  3. 2026Towards Efficient Low-rate Image Compression with Frequency-aware Diffusion Prior Refinement
  4. 2024Controllable Distortion-Perception Tradeoff Through Latent Diffusion for Neural Image Compression
  5. 2026FlowCodec: One-Step Flow Prior for Generative Image Compression
  6. 2026CoD-Lite: Real-Time Diffusion-Based Generative Image Compression
  7. 2023High-Fidelity Image Compression with Score-based Generative Models
  8. 2025Single-step Diffusion for Image Compression at Ultra-Low Bitrates