mlsanityData to 7 Oct 2026

Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models

arXiv 2207.14626 ↗First posted 29 Jul 2022cs.CV cs.LGcited by 215

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Image restoration under adverse weather conditions has been of significant interest for various computer vision applications. Recent successful methods rely on the current progress in deep neural network architectural designs (e.g., with vision transformers). Motivated by the recent progress achieved with state-of-the-art conditional generative models, we present a novel patch-based image restoration algorithm based on denoising diffusion probabilistic models. Our patch-based diffusion modeling approach enables size-agnostic image restoration by using a guided denoising process with smoothed noise estimates across overlapping patches during inference. We empirically evaluate our model on benchmark datasets for image desnowing, combined deraining and dehazing, and raindrop removal. We demonstrate our approach to achieve state-of-the-art performances on both weather-specific and multi-weather image restoration, and experimentally show strong generalization to real-world test images.

Key facts. Cited by 215 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 52 of its 77 references that are in the map. First posted on arXiv 29 Jul 2022.

Builds on

52 of 77 references.

Closest ancestors · 3

Same direction, newest first

  1. 2022Denoising Diffusion Restoration Models27 Jan
  2. 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction9 Dec
  3. 2021Deblurring via Stochastic Refinement5 Dec

Other references · 49

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  11. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  12. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
37 more
  1. 2016Wide Residual Networkscited by 3,057
  2. 2017Non-local Neural Networkscited by 2,290
  3. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  4. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  5. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  6. 2018Group Normalizationcited by 1,514
  7. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  8. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  9. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  10. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  11. 2021Variational Diffusion Modelscited by 1,145
  12. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  13. 2021Multi-Stage Progressive Image Restorationcited by 813
  14. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  15. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  16. 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 351
  17. 2016DehazeNet: An End-to-End System for Single Image Haze Removalcited by 313
  18. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
  19. 2022Perception Prioritized Training of Diffusion Modelscited by 301
  20. 2021How to Train Your Energy-Based Modelscited by 271
  21. 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 259
  22. 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
  23. 2019GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazingcited by 227
  24. 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
  25. 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
  26. 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
  27. 2017Image De-raining Using a Conditional Generative Adversarial Networkcited by 197
  28. 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
  29. 2019Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learningcited by 157
  30. 2016Clearing the Skies: A deep network architecture for single-image rain removalcited by 136
  31. 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
  32. 2019Single Image Deraining: From Model-Based to Data-Driven and Beyondcited by 77
  33. 2019Dual Residual Networks Leveraging the Potential of Paired Operations for Image Restorationcited by 73
  34. 2017Perceptual Adversarial Networks for Image-to-Image Transformationcited by 42
  35. 2020Conditional Variational Image Derainingcited by 22
  36. 2019Implicit Generation and Generalization in Energy-Based Modelscited by 21
  37. 2020Deep-Masking Generative Network: A Unified Framework for Background Restoration from Superimposed Imagescited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 6; 2023: 33; 2024: 74; 2025: 67; 2026: 35.

215 papers.

Sort:

By area:

  1. 2022Diffusion Models in Vision: A Surveycited by 1,008
  2. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  3. 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
  4. 2023Low-Light Image Enhancement with Wavelet-based Diffusion Modelscited by 126
  5. 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 108
  6. 2022ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removalcited by 102
  7. 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 98
  8. 2023Global Structure-Aware Diffusion Process for Low-Light Image Enhancementcited by 92
  9. 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
  10. 2023Refusion: Enabling Large-Size Realistic Image Restoration with Latent-Space Diffusion Modelscited by 86
  11. 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Modelcited by 73
  12. 2024Diffusion Models in Low-Level Vision: A Surveycited by 73
38 more
  1. 2024Restoring Images in Adverse Weather Conditions via Histogram Transformercited by 73
  2. 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 72
  3. 2024LightenDiffusion: Unsupervised Low-Light Image Enhancement with Latent-Retinex Diffusion Modelscited by 70
  4. 2023Residual Denoising Diffusion Modelscited by 68
  5. 2023GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditionscited by 62
  6. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
  7. 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
  8. 2024Diff-Plugin: Revitalizing Details for Diffusion-based Low-level Taskscited by 47
  9. 2023WaveDM: Wavelet-Based Diffusion Models for Image Restorationcited by 46
  10. 2023Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRIcited by 45
  11. 2023Patched Denoising Diffusion Models For High-Resolution Image Synthesiscited by 45
  12. 2025UniRestore: Unified Perceptual and Task-Oriented Image Restoration Model Using Diffusion Priorcited by 39
  13. 2022DeS3: Adaptive Attention-driven Self and Soft Shadow Removal using ViT Similaritycited by 37
  14. 2023Language-driven All-in-one Adverse Weather Removalcited by 36
  15. 2023Towards Unified Deep Image Deraining: A Survey and A New Benchmarkcited by 34
  16. 2024GoodDrag: Towards Good Practices for Drag Editing with Diffusion Modelscited by 33
  17. 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 32
  18. 2023CLE Diffusion: Controllable Light Enhancement Diffusion Modelcited by 30
  19. 2023Textual Prompt Guided Image Restorationcited by 27
  20. 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restorationcited by 26
  21. 2023Unsupervised Anomaly Detection in Medical Images Using Masked Diffusion Modelcited by 25
  22. 2024FlowSDF: Flow Matching for Medical Image Segmentation Using Distance Transformscited by 25
  23. 2024Learning A Physical-aware Diffusion Model Based on Transformer for Underwater Image Enhancementcited by 24
  24. 2024Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraintcited by 24
  25. 2024MWFormer: Multi-Weather Image Restoration Using Degradation-Aware Transformerscited by 24
  26. 2024NightHaze: Nighttime Image Dehazing via Self-Prior Learningcited by 22
  27. 2024AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoisingcited by 22
  28. 2025NTIRE 2025 Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Resultscited by 22
  29. 2023Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?cited by 21
  30. 2022ADIR: Adaptive Diffusion for Image Reconstructioncited by 20
  31. 2025UltraFusion: Ultra High Dynamic Imaging using Exposure Fusioncited by 20
  32. 2023Resfusion: Denoising Diffusion Probabilistic Models for Image Restoration Based on Prior Residual Noisecited by 19
  33. 2024NightRain: Nighttime Video Deraining via Adaptive-Rain-Removal and Adaptive-Correctioncited by 19
  34. 2024Low-light Image Enhancement via CLIP-Fourier Guided Wavelet Diffusioncited by 19
  35. 2024Seeing the Unseen: A Frequency Prompt Guided Transformer for Image Restorationcited by 18
  36. 2024Learning Image Priors through Patch-based Diffusion Models for Solving Inverse Problemscited by 18
  37. 2024AWRaCLe: All-Weather Image Restoration using Visual In-Context Learningcited by 18
  38. 2024LoRA-IR: Taming Low-Rank Experts for Efficient All-in-One Image Restorationcited by 18

50 most cited of 215 All 215 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Efficient and Training-Free Single-Image Diffusion Models
  2. 2024GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restoration
  3. 2023Restoration based Generative Models
  4. 2024Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration
  5. 2023A Unified Conditional Framework for Diffusion-based Image Restoration
  6. 2022AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models
  7. 2024Data-free Distillation with Degradation-prompt Diffusion for Multi-weather Image Restoration
  8. 2025When Color-Space Decoupling Meets Diffusion for Adverse-Weather Image Restoration