mlsanityData to 7 Oct 2026

Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration

arXiv 2506.21722 ↗First posted 26 Jun 2025cs.CV cs.AIcited by 3

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

While diffusion models demonstrate strong generative capabilities in image restoration (IR) tasks, their complex architectures and iterative processes limit their practical application compared to mainstream reconstruction-based general ordinary IR networks. Existing approaches primarily focus on optimizing network architecture and diffusion paths but overlook the integration of the diffusion training paradigm within general ordinary IR frameworks. To address these challenges, this paper elucidates key principles for adapting the diffusion training paradigm to general IR training through systematic analysis of time-step dependencies, network hierarchies, noise-level relationships, and multi-restoration task correlations, proposing a new IR framework supported by diffusion-based training. To enable IR networks to simultaneously restore images and model generative representations, we introduce a series of regularization strategies that align diffusion objectives with IR tasks, improving generalization in single-task scenarios. Furthermore, recognizing that diffusion-based generation exerts varying influences across different IR tasks, we develop an incremental training paradigm and task-specific adaptors, further enhancing performance in multi-task unified IR. Experiments demonstrate that our method significantly improves the generalization of IR networks in single-task IR and achieves superior performance in multi-task unified IR. Notably, the proposed framework can be seamlessly integrated into existing general IR architectures.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 45 of its 75 references that are in the map. First posted on arXiv 26 Jun 2025.

Builds on

45 of 75 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024DiffLoss: unleashing diffusion model as constraint for training image restoration network27 Jun
  2. 2024Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration26 Jun
  3. 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model17 Mar
  4. 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion16 Oct
  5. 2023DiffIR: Efficient Diffusion Model for Image Restoration16 Mar

Other references · 40

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  9. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  10. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  11. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  12. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
28 more
  1. 2021Multi-Stage Progressive Image Restorationcited by 813
  2. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
  3. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
  4. 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
  5. 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
  6. 2017Benchmarking Single Image Dehazing and Beyondcited by 445
  7. 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 351
  8. 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 311
  9. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
  10. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
  11. 2019Progressive Image Deraining Networks: A Better and Simpler Baselinecited by 271
  12. 2022Vision Transformers for Single Image Dehazingcited by 255
  13. 2020Multi-Scale Boosted Dehazing Network with Dense Feature Fusioncited by 229
  14. 2019GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazingcited by 227
  15. 2020CycleISP: Real Image Restoration via Improved Data Synthesiscited by 212
  16. 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
  17. 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
  18. 2020Deblurring by Realistic Blurringcited by 187
  19. 2023Image Restoration with Mean-Reverting Stochastic Differential Equationscited by 182
  20. 2022Generative Modelling With Inverse Heat Dissipationcited by 164
  21. 2023Controlling Vision-Language Models for Multi-Task Image Restorationcited by 108
  22. 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
  23. 2021BANet: Blur-aware Attention Networks for Dynamic Scene Deblurringcited by 44
  24. 2024Efficient Diffusion Models: A Comprehensive Survey from Principles to Practicescited by 39
  25. 2023Language-driven All-in-one Adverse Weather Removalcited by 36
  26. 2024Restore Anything with Masks: Leveraging Mask Image Modeling for Blind All-in-One Image Restorationcited by 20
  27. 2021Clean Images are Hard to Reblur: Exploiting the Ill-Posed Inverse Task for Dynamic Scene Deblurringcited by 16
  28. 2022Robust Single Image Dehazing Based on Consistent and Contrast-Assisted Reconstructioncited by 4

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Taming Diffusion Models for Image Restoration: A Review
  2. 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Survey
  3. 2025IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Models
  4. 2026Your Pre-trained Diffusion Model Secretly Knows Restoration
  5. 2023Restoration based Generative Models
  6. 2024Decoupled Data Consistency with Diffusion Purification for Image Restoration
  7. 2025INDIGO+: A Unified INN-Guided Probabilistic Diffusion Algorithm for Blind and Non-Blind Image Restoration
  8. 2024A Modular Conditional Diffusion Framework for Image Reconstruction