Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learning
Not on the map. Why?
Abstract (arXiv)
Most deraining works focus on rain streaks removal but they cannot deal adequately with heavy rain images. In heavy rain, streaks are strongly visible, dense rain accumulation or rain veiling effect significantly washes out the image, further scenes are relatively more blurry, etc. In this paper, we propose a novel method to address these problems. We put forth a 2-stage network: a physics-based backbone followed by a depth-guided GAN refinement. The first stage estimates the rain streaks, the transmission, and the atmospheric light governed by the underlying physics. To tease out these components more reliably, a guided filtering framework is used to decompose the image into its low- and high-frequency components. This filtering is guided by a rain-free residue image --- its content is used to set the passbands for the two channels in a spatially-variant manner so that the background details do not get mixed up with the rain-streaks. For the second stage, the refinement stage, we put forth a depth-guided GAN to recover the background details failed to be retrieved by the first stage, as well as correcting artefacts introduced by that stage. We have evaluated our method against the state of the art methods. Extensive experiments show that our method outperforms them on real rain image data, recovering visually clean images with good details.
Key facts. Cited by 157 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 25; 2023: 23; 2024: 33; 2025: 38; 2026: 22.
157 papers.
Sort:
By area:
- 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 244
- 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 109
- 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 92
- 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
- 2024Restoring Images in Adverse Weather Conditions via Histogram Transformercited by 73
- 2023GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditionscited by 62
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 60
- 2022Towards Robust Rain Removal Against Adversarial Attacks: A Comprehensive Benchmark Analysis and Beyondcited by 48
- 2021Zero-Shot Day-Night Domain Adaptation with a Physics Priorcited by 47
- 2023WaveDM: Wavelet-Based Diffusion Models for Image Restorationcited by 47
38 more
- 2023Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streakscited by 45
- 2025Degradation-Aware Feature Perturbation for All-in-One Image Restorationcited by 41
- 2022Toward Real-world Single Image Deraining: A New Benchmark and Beyondcited by 40
- 2023From Sky to the Ground: A Large-scale Benchmark and Simple Baseline Towards Real Rain Removalcited by 39
- 2021Closing the Loop: Joint Rain Generation and Removal via Disentangled Image Translationcited by 36
- 2023Language-driven All-in-one Adverse Weather Removalcited by 36
- 2023Towards Unified Deep Image Deraining: A Survey and A New Benchmarkcited by 34
- 2022Not Just Streaks: Towards Ground Truth for Single Image Derainingcited by 31
- 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructionscited by 31
- 2022Unsupervised Deraining: Where Contrastive Learning Meets Self-similaritycited by 30
- 2021CoMoGAN: continuous model-guided image-to-image translationcited by 27
- 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restorationcited by 26
- 2021Dual Attention-in-Attention Model for Joint Rain Streak and Raindrop Removalcited by 24
- 2024Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraintcited by 24
- 2024MWFormer: Multi-Weather Image Restoration Using Degradation-Aware Transformerscited by 24
- 2025NTIRE 2025 Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Resultscited by 22
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Datacited by 21
- 2022Prior Knowledge Guided Unsupervised Domain Adaptationcited by 20
- 2024NightRain: Nighttime Video Deraining via Adaptive-Rain-Removal and Adaptive-Correctioncited by 20
- 2025WeatherBench: A Real-World Benchmark Dataset for All-in-One Adverse Weather Image Restorationcited by 20
- 2021Beyond Monocular Deraining: Parallel Stereo Deraining Network Via Semantic Priorcited by 18
- 2024Multi-Expert Adaptive Selection: Task-Balancing for All-in-One Image Restorationcited by 18
- 2024LoRA-IR: Taming Low-Rank Experts for Efficient All-in-One Image Restorationcited by 18
- 2023Learning Distortion Invariant Representation for Image Restoration from A Causality Perspectivecited by 17
- 2025RestoreVAR: Visual Autoregressive Generation for All-in-One Image Restorationcited by 15
- 2023Networks are Slacking Off: Understanding Generalization Problem in Image Derainingcited by 14
- 2024Sharing Key Semantics in Transformer Makes Efficient Image Restorationcited by 14
- 2025Lumina-OmniLV: A Unified Multimodal Framework for General Low-Level Visioncited by 14
- 2026NTIRE 2026 The Second Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Resultscited by 14
- 2024Learning Truncated Causal History Model for Video Restorationcited by 13
- 2024All-in-one Weather-degraded Image Restoration via Adaptive Degradation-aware Self-prompting Modelcited by 13
- 2024GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restorationcited by 13
- 2021RCDNet: An Interpretable Rain Convolutional Dictionary Network for Single Image Derainingcited by 12
- 2022Unsupervised Image Deraining: Optimization Model Driven Deep CNNcited by 12
- 2022RCRN: Real-world Character Image Restoration Network via Skeleton Extractioncited by 12
- 2023Exploring the Application of Large-scale Pre-trained Models on Adverse Weather Removalcited by 12
- 2023Always Clear Days: Degradation Type and Severity Aware All-In-One Adverse Weather Removalcited by 12
- 2026ClearAIR: A Human-Visual-Perception-Inspired All-in-One Image Restorationcited by 12
50 most cited of 157 All 157 (JSON)
- 2026LLPR: Location-aware learning and physics-based reconstruction for raindrop removal from a single image25 Sep 2026
- 2026ICM: Intra-class Mixing for Domain Adaptation in Adverse Weather23 Sep 2026
- 2026Efficient All-in-One Weather Restoration using Spectral Harmonization2 Sep 2026
- 2026Uncertainty-Guided Adverse Weather Restoration via Gated Transformer Network2 Sep 2026
- 2026Beyond Uniform Restoration: Empowering All-in-One Restoration with Pixel-Level Multimodal Guidance10 Aug 2026
- 2026Degradation-Aware Prompt Learning with Cross-Modal Compensation for Adverse Weather Removal7 Aug 2026
- 2026Pixel Ignores, Superpixel Sees: Adverse Weather Image Restoration via Semantic-Center SSM3 Aug 2026
- 2026Cyclone: Diffusion Model for Cycle-Consistent Weather Editing from Unpaired Driving Data15 Jul 2026
- 2026CURE: Controllable Unified Image Restoration for Complex Degradations3 Jul 2026
- 2026FrozenDrive: Zero-Shot Text-Guided Driving Scene Generation and Data Augmentation with Parameter-Free Frozen Diffusion Model18 Jun 2026
- 2026DDTNet: Degradation Disentanglement and Transfer Network for Test-Time All-in-One De-weathering Adaptation15 Jun 2026
- 2026Geodesic Flow Matching on a Riemannian Degradation Manifold for Blind Image Restoration4 Jun 2026
38 more
- 2026Unifying Physically-Informed Weather Priors in A Single Model for Image Restoration Across Multiple Adverse Weather Conditions13 May 2026
- 2026Degradation-Aware Adaptive Context Gating for Unified Image Restoration2 May 2026
- 2026NTIRE 2026 The Second Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Results12 Apr 2026
- 2026WeatherRemover: All-in-one Adverse Weather Removal with Multi-scale Feature Map Compression8 Apr 2026
- 2026UENR-600K: A Large-Scale Physically Grounded Dataset for Nighttime Video Deraining6 Apr 2026
- 2026Spectral-Structured Diffusion for Single-Image Rain Removal10 Mar 2026
- 2026SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restoration6 Mar 2026
- 2026All-in-One Image Restoration via Causal-Deconfounding Wavelet-Disentangled Prompt Network4 Mar 2026
- 2026ClearAIR: A Human-Visual-Perception-Inspired All-in-One Image Restoration6 Jan 2026
- 2026All-in-One Video Restoration under Smoothly Evolving Unknown Weather Degradations2 Jan 2026
- 2025SemOD: Semantic Enabled Object Detection Network under Various Weather Conditions27 Nov 2025
- 2025VLM-Augmented Degradation Modeling for Image Restoration Under Adverse Weather Conditions21 Nov 2025
- 2025FAPE-IR: Frequency-Aware Planning and Execution Framework for All-in-One Image Restoration18 Nov 2025
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data16 Nov 2025
- 2025Real-World Adverse Weather Image Restoration via Dual-Level Reinforcement Learning with High-Quality Cold Start7 Nov 2025
- 2025Clear Roads, Clear Vision: Advancements in Multi-Weather Restoration for Smart Transportation10 Oct 2025
- 2025WeatherCycle: Unpaired Multi-Weather Restoration via Color Space Decoupled Cycle Learning27 Sep 2025
- 2025NDLPNet: A Location-Aware Nighttime Deraining Network and a Real-World Benchmark Dataset17 Sep 2025
- 2025WeatherBench: A Real-World Benchmark Dataset for All-in-One Adverse Weather Image Restoration15 Sep 2025
- 2025SNNSIR: A Simple Spiking Neural Network for Stereo Image Restoration17 Aug 2025
- 2025TAP: Parameter-efficient Task-Aware Prompting for Adverse Weather Removal11 Aug 2025
- 2025Robust Adverse Weather Removal via Spectral-based Spatial Grouping30 Jul 2025
- 2025Degradation-Agnostic Statistical Facial Feature Transformation for Blind Face Restoration in Adverse Weather Conditions10 Jul 2025
- 2025Reversing Flow for Image Restoration20 Jun 2025
- 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restoration20 Jun 2025
- 2025M2Restore: Mixture-of-Experts-based Mamba-CNN Fusion Framework for All-in-One Image Restoration9 Jun 2025
- 2025Towards Better De-raining Generalization via Rainy Characteristics Memorization and Replay3 Jun 2025
- 2025Boosting All-in-One Image Restoration via Self-Improved Privilege Learning30 May 2025
- 2025Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularization24 May 2025
- 2025RestoreVAR: Visual Autoregressive Generation for All-in-One Image Restoration23 May 2025
- 2025MODEM: A Morton-Order Degradation Estimation Mechanism for Adverse Weather Image Recovery23 May 2025
- 2025Clear Nights Ahead: Towards Multi-Weather Nighttime Image Restoration22 May 2025
- 2025Degradation-Aware Feature Perturbation for All-in-One Image Restoration19 May 2025
- 2025CMAWRNet: Multiple Adverse Weather Removal via a Unified Quaternion Neural Architecture3 May 2025
- 2025Any Image Restoration via Efficient Spatial-Frequency Degradation Adaptation19 Apr 2025
- 2025NTIRE 2025 Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Results17 Apr 2025
- 2025AdaQual-Diff: Diffusion-Based Image Restoration via Adaptive Quality Prompting17 Apr 2025
- 2025Beyond Degradation Redundancy: Contrastive Prompt Learning for All-in-One Image Restoration14 Apr 2025
50 newest of 157 All 157 (JSON)
- 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
- 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 109
- 2023WaveDM: Wavelet-Based Diffusion Models for Image Restorationcited by 47
- 2025RestoreVAR: Visual Autoregressive Generation for All-in-One Image Restorationcited by 15
- 2024All-in-one Weather-degraded Image Restoration via Adaptive Degradation-aware Self-prompting Modelcited by 13
- 2024GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restorationcited by 13
- 2026Cyclone: Diffusion Model for Cycle-Consistent Weather Editing from Unpaired Driving Datacited by 2
- 2024SemiDDM-Weather: A Semi-supervised Learning Framework for All-in-one Adverse Weather Removalcited by 1
- 2024Consistent Diffusion: Denoising Diffusion Model with Data-Consistent Training for Image Restorationcited by 1
- 2025DA2Diff: Exploring Degradation-aware Adaptive Diffusion Priors for All-in-One Weather Restorationcited by 1
- 2026FrozenDrive: Zero-Shot Text-Guided Driving Scene Generation and Data Augmentation with Parameter-Free Frozen Diffusion Modelcited by 1
- 2025RestoreGrad: Signal Restoration Using Conditional Denoising Diffusion Models with Jointly Learned Priorcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Cyclone: Diffusion Model for Cycle-Consistent Weather Editing from Unpaired Driving Data15 Jul 2026
- 2026FrozenDrive: Zero-Shot Text-Guided Driving Scene Generation and Data Augmentation with Parameter-Free Frozen Diffusion Model18 Jun 2026
- 2026Geodesic Flow Matching on a Riemannian Degradation Manifold for Blind Image Restoration4 Jun 2026
- 2025Degradation-Agnostic Statistical Facial Feature Transformation for Blind Face Restoration in Adverse Weather Conditions10 Jul 2025
- 2025RestoreVAR: Visual Autoregressive Generation for All-in-One Image Restoration23 May 2025
- 2025AdaQual-Diff: Diffusion-Based Image Restoration via Adaptive Quality Prompting17 Apr 2025
- 2025DA2Diff: Exploring Degradation-aware Adaptive Diffusion Priors for All-in-One Weather Restoration7 Apr 2025
- 2025RestoreGrad: Signal Restoration Using Conditional Denoising Diffusion Models with Jointly Learned Prior19 Feb 2025
- 2024Consistent Diffusion: Denoising Diffusion Model with Data-Consistent Training for Image Restoration17 Dec 2024
- 2024GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restoration26 Nov 2024
- 2024All-in-one Weather-degraded Image Restoration via Adaptive Degradation-aware Self-prompting Model12 Nov 2024
- 2024SemiDDM-Weather: A Semi-supervised Learning Framework for All-in-one Adverse Weather Removal29 Sep 2024
12 newest of 15 All 15 (JSON)
- 2023Language-driven All-in-one Adverse Weather Removalcited by 36
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Datacited by 21
- 2024LoRA-IR: Taming Low-Rank Experts for Efficient All-in-One Image Restorationcited by 18
- 2023WM-MoE: Weather-aware Multi-scale Mixture-of-Experts for Blind Adverse Weather Removalcited by 11
- 2025M2Restore: Mixture-of-Experts-based Mamba-CNN Fusion Framework for All-in-One Image Restorationcited by 7
- 2025FAPE-IR: Frequency-Aware Planning and Execution Framework for All-in-One Image Restorationcited by 4
- 2026SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restorationcited by 0
- 2026SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restoration6 Mar 2026
- 2025FAPE-IR: Frequency-Aware Planning and Execution Framework for All-in-One Image Restoration18 Nov 2025
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data16 Nov 2025
- 2025M2Restore: Mixture-of-Experts-based Mamba-CNN Fusion Framework for All-in-One Image Restoration9 Jun 2025
- 2024LoRA-IR: Taming Low-Rank Experts for Efficient All-in-One Image Restoration20 Oct 2024
- 2023Language-driven All-in-one Adverse Weather Removal3 Dec 2023
- 2023WM-MoE: Weather-aware Multi-scale Mixture-of-Experts for Blind Adverse Weather Removal24 Mar 2023
- 2022Removing Rain Streaks via Task Transfer Learningcited by 1
- 2022Removing Rain Streaks via Task Transfer Learning28 Aug 2022
- 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 244
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 92
- 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
- 2024Restoring Images in Adverse Weather Conditions via Histogram Transformercited by 73
- 2023GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditionscited by 62
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 60
- 2022Towards Robust Rain Removal Against Adversarial Attacks: A Comprehensive Benchmark Analysis and Beyondcited by 48
- 2021Zero-Shot Day-Night Domain Adaptation with a Physics Priorcited by 47
- 2023Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streakscited by 45
- 2025Degradation-Aware Feature Perturbation for All-in-One Image Restorationcited by 41
- 2022Toward Real-world Single Image Deraining: A New Benchmark and Beyondcited by 40
12 most cited of 130 All 130 (JSON)
- 2026LLPR: Location-aware learning and physics-based reconstruction for raindrop removal from a single image25 Sep 2026
- 2026ICM: Intra-class Mixing for Domain Adaptation in Adverse Weather23 Sep 2026
- 2026Efficient All-in-One Weather Restoration using Spectral Harmonization2 Sep 2026
- 2026Uncertainty-Guided Adverse Weather Restoration via Gated Transformer Network2 Sep 2026
- 2026Beyond Uniform Restoration: Empowering All-in-One Restoration with Pixel-Level Multimodal Guidance10 Aug 2026
- 2026Degradation-Aware Prompt Learning with Cross-Modal Compensation for Adverse Weather Removal7 Aug 2026
- 2026Pixel Ignores, Superpixel Sees: Adverse Weather Image Restoration via Semantic-Center SSM3 Aug 2026
- 2026CURE: Controllable Unified Image Restoration for Complex Degradations3 Jul 2026
- 2026DDTNet: Degradation Disentanglement and Transfer Network for Test-Time All-in-One De-weathering Adaptation15 Jun 2026
- 2026Unifying Physically-Informed Weather Priors in A Single Model for Image Restoration Across Multiple Adverse Weather Conditions13 May 2026
- 2026Degradation-Aware Adaptive Context Gating for Unified Image Restoration2 May 2026
- 2026NTIRE 2026 The Second Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Results12 Apr 2026
12 newest of 130 All 130 (JSON)