mlsanityData to 14 Oct 2026

GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restoration

arXiv 2411.17687 ↗First posted 26 Nov 2024cs.CVcited by 13

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Deep learning-based models for All-In-One Image Restoration (AIOR) have achieved significant advancements in recent years. However, their practical applicability is limited by poor generalization to samples outside the training distribution. This limitation arises primarily from insufficient diversity in degradation variations and scenes within existing datasets, resulting in inadequate representations of real-world scenarios. Additionally, capturing large-scale real-world paired data for degradations such as haze, low-light, and raindrops is often cumbersome and sometimes infeasible. In this paper, we leverage the generative capabilities of latent diffusion models to synthesize high-quality degraded images from their clean counterparts. Specifically, we introduce GenDeg, a degradation and intensity-aware conditional diffusion model capable of producing diverse degradation patterns on clean images. Using GenDeg, we synthesize over 550k samples across six degradation types: haze, rain, snow, motion blur, low-light, and raindrops. These generated samples are integrated with existing datasets to form the GenDS dataset, comprising over 750k samples. Our experiments reveal that image restoration models trained on the GenDS dataset exhibit significant improvements in out-of-distribution performance compared to those trained solely on existing datasets. Furthermore, we provide comprehensive analyses on implications of diffusion model-based synthetic degradations for AIOR.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 55 of its 82 references that are in the map. First posted on arXiv 26 Nov 2024.

Builds on

55 of 82 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation25 Mar
  2. 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model17 Mar
  3. 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion16 Oct

Other references · 52

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2023Segment Anythingcited by 8,234
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  9. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  11. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  12. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
38 more
  1. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  2. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  3. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  4. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
  5. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  6. 2021Multi-Stage Progressive Image Restorationcited by 816
  7. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
  8. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 723
  9. 2022Simple Baselines for Image Restorationcited by 708
  10. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
  11. 2018Learning to See in the Darkcited by 460
  12. 2017Benchmarking Single Image Dehazing and Beyondcited by 447
  13. 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 327
  14. 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
  15. 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
  16. 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
  17. 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
  18. 2020Human-Aware Motion Deblurringcited by 175
  19. 2023DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Modelscited by 162
  20. 2019Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learningcited by 157
  21. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 140
  22. 2019Uncertainty Guided Multi-Scale Residual Learning-using a Cycle Spinning CNN for Single Image De-Rainingcited by 117
  23. 2020NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Imagescited by 108
  24. 2019Dense Haze: A benchmark for image dehazing with dense-haze and haze-free imagescited by 107
  25. 2018O-HAZE: a dehazing benchmark with real hazy and haze-free outdoor imagescited by 95
  26. 2023Leaving Reality to Imagination: Robust Classification via Generated Datasetscited by 91
  27. 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
  28. 2023Diversity is Definitely Needed: Improving Model-Agnostic Zero-shot Classification via Stable Diffusioncited by 81
  29. 2021Enhancing Photorealism Enhancementcited by 74
  30. 2018I-HAZE: a dehazing benchmark with real hazy and haze-free indoor imagescited by 64
  31. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 60
  32. 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discoverycited by 54
  33. 2018Robust Video Content Alignment and Compensation for Rain Removal in a CNN Frameworkcited by 53
  34. 2024Diff-Plugin: Revitalizing Details for Diffusion-based Low-level Taskscited by 48
  35. 2022Toward Real-world Single Image Deraining: A New Benchmark and Beyondcited by 40
  36. 2023From Sky to the Ground: A Large-scale Benchmark and Simple Baseline Towards Real Rain Removalcited by 39
  37. 2024AWRaCLe: All-Weather Image Restoration using Visual In-Context Learningcited by 18
  38. 2017Joint Transmission Map Estimation and Dehazing using Deep Networkscited by 16

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 8.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025UniRes: Universal Image Restoration for Complex Degradations
  2. 2025Diffusion Once and Done: Degradation-Aware LoRA for Efficient All-in-One Image Restoration
  3. 2023Generative Diffusion Prior for Unified Image Restoration and Enhancement
  4. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models
  5. 2026Bridging Degradation Discrimination and Generation for Universal Image Restoration
  6. 2025Restoring Real-World Images with an Internal Detail Enhancement Diffusion Model
  7. 2025DGSolver: Diffusion Generalist Solver with Universal Posterior Sampling for Image Restoration
  8. 2025UniLDiff: Unlocking the Power of Diffusion Priors for All-in-One Image Restoration