GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restoration
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Deep learning-based models for All-In-One Image Restoration (AIOR) have achieved significant advancements in recent years. However, their practical applicability is limited by poor generalization to samples outside the training distribution. This limitation arises primarily from insufficient diversity in degradation variations and scenes within existing datasets, resulting in inadequate representations of real-world scenarios. Additionally, capturing large-scale real-world paired data for degradations such as haze, low-light, and raindrops is often cumbersome and sometimes infeasible. In this paper, we leverage the generative capabilities of latent diffusion models to synthesize high-quality degraded images from their clean counterparts. Specifically, we introduce GenDeg, a degradation and intensity-aware conditional diffusion model capable of producing diverse degradation patterns on clean images. Using GenDeg, we synthesize over 550k samples across six degradation types: haze, rain, snow, motion blur, low-light, and raindrops. These generated samples are integrated with existing datasets to form the GenDS dataset, comprising over 750k samples. Our experiments reveal that image restoration models trained on the GenDS dataset exhibit significant improvements in out-of-distribution performance compared to those trained solely on existing datasets. Furthermore, we provide comprehensive analyses on implications of diffusion model-based synthetic degradations for AIOR.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 55 of its 82 references that are in the map. First posted on arXiv 26 Nov 2024.
Builds on
55 of 82 references.
Closest ancestors · 3
Same direction, newest first
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation25 Mar
- 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model17 Mar
- 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion16 Oct
Other references · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
38 more
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 723
- 2022Simple Baselines for Image Restorationcited by 708
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
- 2018Learning to See in the Darkcited by 460
- 2017Benchmarking Single Image Dehazing and Beyondcited by 447
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 327
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
- 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
- 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
- 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
- 2020Human-Aware Motion Deblurringcited by 175
- 2023DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Modelscited by 162
- 2019Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learningcited by 157
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 140
- 2019Uncertainty Guided Multi-Scale Residual Learning-using a Cycle Spinning CNN for Single Image De-Rainingcited by 117
- 2020NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Imagescited by 108
- 2019Dense Haze: A benchmark for image dehazing with dense-haze and haze-free imagescited by 107
- 2018O-HAZE: a dehazing benchmark with real hazy and haze-free outdoor imagescited by 95
- 2023Leaving Reality to Imagination: Robust Classification via Generated Datasetscited by 91
- 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
- 2023Diversity is Definitely Needed: Improving Model-Agnostic Zero-shot Classification via Stable Diffusioncited by 81
- 2021Enhancing Photorealism Enhancementcited by 74
- 2018I-HAZE: a dehazing benchmark with real hazy and haze-free indoor imagescited by 64
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 60
- 2023DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discoverycited by 54
- 2018Robust Video Content Alignment and Compensation for Rain Removal in a CNN Frameworkcited by 53
- 2024Diff-Plugin: Revitalizing Details for Diffusion-based Low-level Taskscited by 48
- 2022Toward Real-world Single Image Deraining: A New Benchmark and Beyondcited by 40
- 2023From Sky to the Ground: A Large-scale Benchmark and Simple Baseline Towards Real Rain Removalcited by 39
- 2024AWRaCLe: All-Weather Image Restoration using Visual In-Context Learningcited by 18
- 2017Joint Transmission Map Estimation and Dehazing using Deep Networkscited by 16
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 5; 2026: 8.
13 papers.
Sort:
By area:
- 2025IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Modelscited by 11
- 2025FoundIR-v2: Optimizing Pre-Training Data Mixtures for Image Restoration Foundation Modelcited by 9
- 2026RealRestorer: Towards Generalizable Real-World Image Restoration with Large-Scale Image Editing Modelscited by 9
- 20263D Smoke Scene Reconstruction Guided by Vision Priors from Multimodal Large Language Modelscited by 7
- 2025MoCHA-former: Moir'e-Conditioned Hybrid Adaptive Transformer for Video Demoir'eingcited by 1
- 2025Degradation-Aware Metric Prompting for Hyperspectral Image Restorationcited by 1
- 2026Unifying Heterogeneous Degradations: Uncertainty-Aware Diffusion Bridge Model for All-in-One Image Restorationcited by 1
- 2026ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancementcited by 1
- 2026HNDiff: Haze-Noise Diffusion for Image Dehazingcited by 1
- 2025Salient Object Detection in Complex Weather Conditions via Noise Indicatorscited by 0
- 2026Your Pre-trained Diffusion Model Secretly Knows Restorationcited by 0
- 20266thGrid-Net: Unified Remote Sensing Image Dehazing Based on Color Restoration and Edge-Preservingcited by 0
- 2026HNDiff: Haze-Noise Diffusion for Image Dehazing11 Aug 2026
- 2026Robust Image Processing Techniques for Construction Environment Monitoring Using Underwater Robots2 Jul 2026
- 2026ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancement25 May 2026
- 20266thGrid-Net: Unified Remote Sensing Image Dehazing Based on Color Restoration and Edge-Preserving27 Apr 2026
- 20263D Smoke Scene Reconstruction Guided by Vision Priors from Multimodal Large Language Models7 Apr 2026
- 2026Your Pre-trained Diffusion Model Secretly Knows Restoration6 Apr 2026
- 2026RealRestorer: Towards Generalizable Real-World Image Restoration with Large-Scale Image Editing Models26 Mar 2026
- 2026Unifying Heterogeneous Degradations: Uncertainty-Aware Diffusion Bridge Model for All-in-One Image Restoration29 Jan 2026
- 2025Degradation-Aware Metric Prompting for Hyperspectral Image Restoration23 Dec 2025
- 2025Salient Object Detection in Complex Weather Conditions via Noise Indicators11 Dec 2025
- 2025FoundIR-v2: Optimizing Pre-Training Data Mixtures for Image Restoration Foundation Model10 Dec 2025
- 2025MoCHA-former: Moir'e-Conditioned Hybrid Adaptive Transformer for Video Demoir'eing20 Aug 2025
- 2026RealRestorer: Towards Generalizable Real-World Image Restoration with Large-Scale Image Editing Modelscited by 9
- 2025MoCHA-former: Moir'e-Conditioned Hybrid Adaptive Transformer for Video Demoir'eingcited by 1
- 2025Degradation-Aware Metric Prompting for Hyperspectral Image Restorationcited by 1
- 2026Unifying Heterogeneous Degradations: Uncertainty-Aware Diffusion Bridge Model for All-in-One Image Restorationcited by 1
- 2026ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancementcited by 1
- 2026HNDiff: Haze-Noise Diffusion for Image Dehazingcited by 1
- 2025Salient Object Detection in Complex Weather Conditions via Noise Indicatorscited by 0
- 20266thGrid-Net: Unified Remote Sensing Image Dehazing Based on Color Restoration and Edge-Preservingcited by 0
- 2026Robust Image Processing Techniques for Construction Environment Monitoring Using Underwater Robotscited by 0
- 2026HNDiff: Haze-Noise Diffusion for Image Dehazing11 Aug 2026
- 2026Robust Image Processing Techniques for Construction Environment Monitoring Using Underwater Robots2 Jul 2026
- 2026ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancement25 May 2026
- 20266thGrid-Net: Unified Remote Sensing Image Dehazing Based on Color Restoration and Edge-Preserving27 Apr 2026
- 2026RealRestorer: Towards Generalizable Real-World Image Restoration with Large-Scale Image Editing Models26 Mar 2026
- 2026Unifying Heterogeneous Degradations: Uncertainty-Aware Diffusion Bridge Model for All-in-One Image Restoration29 Jan 2026
- 2025Degradation-Aware Metric Prompting for Hyperspectral Image Restoration23 Dec 2025
- 2025Salient Object Detection in Complex Weather Conditions via Noise Indicators11 Dec 2025
- 2025MoCHA-former: Moir'e-Conditioned Hybrid Adaptive Transformer for Video Demoir'eing20 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025UniRes: Universal Image Restoration for Complex Degradations
- 2025Diffusion Once and Done: Degradation-Aware LoRA for Efficient All-in-One Image Restoration
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancement
- 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models
- 2026Bridging Degradation Discrimination and Generation for Universal Image Restoration
- 2025Restoring Real-World Images with an Internal Detail Enhancement Diffusion Model
- 2025DGSolver: Diffusion Generalist Solver with Universal Posterior Sampling for Image Restoration
- 2025UniLDiff: Unlocking the Power of Diffusion Priors for All-in-One Image Restoration