Clearing the Skies: A deep network architecture for single-image rain removal
Not on the map. Why?
Abstract (arXiv)
We introduce a deep network architecture called DerainNet for removing rain streaks from an image. Based on the deep convolutional neural network (CNN), we directly learn the mapping relationship between rainy and clean image detail layers from data. Because we do not possess the ground truth corresponding to real-world rainy images, we synthesize images with rain for training. In contrast to other common strategies that increase depth or breadth of the network, we use image processing domain knowledge to modify the objective function and improve deraining with a modestly-sized CNN. Specifically, we train our DerainNet on the detail (high-pass) layer rather than in the image domain. Though DerainNet is trained on synthetic data, we find that the learned network translates very effectively to real-world images for testing. Moreover, we augment the CNN framework with image enhancement to improve the visual results. Compared with state-of-the-art single image de-raining methods, our method has improved rain removal and much faster computation time after network training.
Key facts. Cited by 136 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 26; 2023: 28; 2024: 28; 2025: 18; 2026: 11.
136 papers.
Sort:
By area:
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
- 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
- 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
- 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
- 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networkscited by 77
- 2021On Efficient Transformer-Based Image Pre-training for Low-Level Visioncited by 64
- 2021Structure-Preserving Deraining with Residue Channel Prior Guidancecited by 63
38 more
- 2023GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditionscited by 62
- 2021Unpaired Deep Image Deraining Using Dual Contrastive Learningcited by 60
- 2024FreqMamba: Viewing Mamba from a Frequency Perspective for Image Derainingcited by 57
- 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 41
- 2022Toward Real-world Single Image Deraining: A New Benchmark and Beyondcited by 40
- 2024U-shaped Vision Mamba for Single Image Dehazingcited by 40
- 2021Closing the Loop: Joint Rain Generation and Removal via Disentangled Image Translationcited by 36
- 2025MB-TaylorFormer V2: Improved Multi-branch Linear Transformer Expanded by Taylor Formula for Image Restorationcited by 36
- 2023Towards Unified Deep Image Deraining: A Survey and A New Benchmarkcited by 34
- 2023KBNet: Kernel Basis Network for Image Restorationcited by 33
- 2021Robust Representation Learning with Feedback for Single Image Derainingcited by 32
- 2024FourierMamba: Fourier Learning Integration with State Space Models for Image Derainingcited by 32
- 2021Semi-Supervised Video Deraining with Dynamical Rain Generatorcited by 31
- 2022Not Just Streaks: Towards Ground Truth for Single Image Derainingcited by 31
- 2021Enhanced Spatio-Temporal Interaction Learning for Video Deraining: A Faster and Better Frameworkcited by 30
- 2022Unsupervised Deraining: Where Contrastive Learning Meets Self-similaritycited by 30
- 2023ScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural Renderingcited by 28
- 2022DRT: A Lightweight Single Image Deraining Recursive Transformercited by 26
- 2021Dual Attention-in-Attention Model for Joint Rain Streak and Raindrop Removalcited by 24
- 2024Restore Anything with Masks: Leveraging Mask Image Modeling for Blind All-in-One Image Restorationcited by 20
- 2021Beyond Monocular Deraining: Parallel Stereo Deraining Network Via Semantic Priorcited by 18
- 2022Multi-scale frequency separation network for image deblurringcited by 18
- 2022Magic ELF: Image Deraining Meets Association Learning and Transformercited by 17
- 2022Restoring Vision in Hazy Weather with Hierarchical Contrastive Learningcited by 17
- 2023Rotation Equivariant Proximal Operator for Deep Unfolding Methods in Image Restorationcited by 17
- 2023HQ-50K: A Large-scale, High-quality Dataset for Image Restorationcited by 15
- 2023Mixed Hierarchy Network for Image Restorationcited by 14
- 2023Networks are Slacking Off: Understanding Generalization Problem in Image Derainingcited by 14
- 2023Robustness of Segment Anything Model (SAM) for Autonomous Driving in Adverse Weather Conditionscited by 14
- 2021Efficient and Accurate Multi-scale Topological Network for Single Image Dehazingcited by 13
- 2022Snow Mask Guided Adaptive Residual Network for Image Snow Removalcited by 13
- 2021RCDNet: An Interpretable Rain Convolutional Dictionary Network for Single Image Derainingcited by 12
- 2025Channel Consistency Prior and Self-Reconstruction Strategy Based Unsupervised Image Derainingcited by 11
- 2025Intra and Inter Parser-Prompted Transformers for Effective Image Restorationcited by 10
- 2025EAMamba: Efficient All-Around Vision State Space Model for Image Restorationcited by 10
- 2022GTAV-NightRain: Photometric Realistic Large-scale Dataset for Night-time Rain Streak Removalcited by 9
- 2023Unsupervised Cumulative Domain Adaptation for Foggy Scene Optical Flowcited by 9
- 2023Dual Degradation Representation for Joint Deraining and Low-Light Enhancement in the Darkcited by 9
50 most cited of 136 All 136 (JSON)
- 2026Learning from Failure: Leveraging Unreliable Predictions in Semi-Supervised Real-World Adverse Weather Removal1 Oct 2026
- 2026DerainSplat: Feed-Forward Clean 3D Gaussian Splatting from Sparse Rainy Views3 Aug 2026
- 2026CogSENet: Blind Image Deblurring with Blur-Conditioned Semantic Routing and Explicit Frequency Fusion29 Jun 2026
- 2026SpaceDG: Benchmarking Spatial Intelligence under Visual Degradation21 May 2026
- 2026Aligning Network Equivariance with Data Symmetry: A Theoretical Framework and Adaptive Approach for Image Restoration13 May 2026
- 2026Edge-Efficient Image Restoration: Transformer Distillation into State-Space Models4 May 2026
- 2026Image-to-Image Translation Framework Embedded with Rotation Symmetry Priors14 Apr 2026
- 2026Cross-Scenario Deraining Adaptation with Unpaired Data: Superpixel Structural Priors and Multi-Stage Pseudo-Rain Synthesis23 Mar 2026
- 2026Spectral-Structured Diffusion for Single-Image Rain Removal10 Mar 2026
- 2026How far have we gone in Generative Image Restoration? A study on its capability, limitations and evaluation practices5 Mar 2026
- 2026EdgeLDR: Quaternion Low-Displacement Rank Neural Networks for Edge-Efficient Deep Learning8 Jan 2026
- 2025SD-PSFNet: Sequential and Dynamic Point Spread Function Network for Image Deraining22 Nov 2025
38 more
- 2025MdaIF: Robust One-Stop Multi-Degradation-Aware Image Fusion with Language-Driven Semantics16 Nov 2025
- 2025Unleashing the Potential of the Semantic Latent Space in Diffusion Models for Image Dehazing24 Sep 2025
- 2025RAM++: Robust Representation Learning via Adaptive Mask for All-in-One Image Restoration15 Sep 2025
- 2025Single Image Rain Streak Removal Using Harris Corner Loss and R-CBAM Network31 Jul 2025
- 2025EAMamba: Efficient All-Around Vision State Space Model for Image Restoration27 Jun 2025
- 2025Towards Better De-raining Generalization via Rainy Characteristics Memorization and Replay3 Jun 2025
- 2025CLIP-driven rain perception: Adaptive deraining with pattern-aware network routing and mask-guided cross-attention2 Jun 2025
- 2025A Regularization-Guided Equivariant Approach for Image Restoration26 May 2025
- 2025Semi-Supervised State-Space Model with Dynamic Stacking Filter for Real-World Video Deraining22 May 2025
- 2025Pseudo-Label Guided Real-World Image De-weathering: A Learning Framework with Imperfect Supervision14 Apr 2025
- 2025DSwinIR: Rethinking Window-based Attention for Image Restoration7 Apr 2025
- 2025Exploring Semantic Feature Discrimination for Perceptual Image Super-Resolution and Opinion-Unaware No-Reference Image Quality Assessment25 Mar 2025
- 2025Channel Consistency Prior and Self-Reconstruction Strategy Based Unsupervised Image Deraining24 Mar 2025
- 2025Intra and Inter Parser-Prompted Transformers for Effective Image Restoration18 Mar 2025
- 2025Prompt to Restore, Restore to Prompt: Cyclic Prompting for Universal Adverse Weather Removal12 Mar 2025
- 2025Revisiting the Generalization Problem of Low-level Vision Models Through the Lens of Image Deraining18 Feb 2025
- 2025MB-TaylorFormer V2: Improved Multi-branch Linear Transformer Expanded by Taylor Formula for Image Restoration8 Jan 2025
- 2024Enhancing autonomous vehicle safety in rain: a data-centric approach for clear vision29 Dec 2024
- 2024Leveraging Scene Geometry and Depth Information for Robust Image Deraining27 Dec 2024
- 2024Consistent Diffusion: Denoising Diffusion Model with Data-Consistent Training for Image Restoration17 Dec 2024
- 2024Joint multi-dimensional dynamic attention and transformer for general image restoration12 Nov 2024
- 2024End-to-end Inception-Unet based Generative Adversarial Networks for Snow and Rain Removals7 Nov 2024
- 2024An Intelligent Agentic System for Complex Image Restoration Problems23 Oct 2024
- 2024UIR-LoRA: Achieving Universal Image Restoration through Multiple Low-Rank Adaptation30 Sep 2024
- 2024Restore Anything with Masks: Leveraging Mask Image Modeling for Blind All-in-One Image Restoration28 Sep 2024
- 2024ReviveDiff: A Universal Diffusion Model for Restoring Images in Adverse Weather Conditions27 Sep 2024
- 2024Multi-Weather Image Restoration via Histogram-Based Transformer Feature Enhancement10 Sep 2024
- 2024Real-Time Multi-Scene Visibility Enhancement for Promoting Navigational Safety of Vessels Under Complex Weather Conditions2 Sep 2024
- 2024A Hybrid Transformer-Mamba Network for Single Image Deraining31 Aug 2024
- 2024A Preliminary Exploration Towards General Image Restoration27 Aug 2024
- 2024Re-boosting Self-Collaboration Parallel Prompt GAN for Unsupervised Image Restoration17 Aug 2024
- 2024OneRestore: A Universal Restoration Framework for Composite Degradation5 Jul 2024
- 2024DiffLoss: unleashing diffusion model as constraint for training image restoration network27 Jun 2024
- 2024MDeRainNet: An Efficient Macro-pixel Image Rain Removal Network15 Jun 2024
- 2024FourierMamba: Fourier Learning Integration with State Space Models for Image Deraining29 May 2024
- 2024Dual-Path Multi-Scale Transformer for High-Quality Image Deraining28 May 2024
- 2024AdaIR: Exploiting Underlying Similarities of Image Restoration Tasks with Adapters17 Apr 2024
- 2024FreqMamba: Viewing Mamba from a Frequency Perspective for Image Deraining15 Apr 2024
50 newest of 136 All 136 (JSON)
- 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
- 2025Unleashing the Potential of the Semantic Latent Space in Diffusion Models for Image Dehazingcited by 8
- 2024ReviveDiff: A Universal Diffusion Model for Restoring Images in Adverse Weather Conditionscited by 3
- 2024DiffLoss: unleashing diffusion model as constraint for training image restoration networkcited by 2
- 2024Consistent Diffusion: Denoising Diffusion Model with Data-Consistent Training for Image Restorationcited by 1
- 2025Unleashing the Potential of the Semantic Latent Space in Diffusion Models for Image Dehazing24 Sep 2025
- 2024Consistent Diffusion: Denoising Diffusion Model with Data-Consistent Training for Image Restoration17 Dec 2024
- 2024ReviveDiff: A Universal Diffusion Model for Restoring Images in Adverse Weather Conditions27 Sep 2024
- 2024DiffLoss: unleashing diffusion model as constraint for training image restoration network27 Jun 2024
- 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models29 Jul 2022
- 2024FreqMamba: Viewing Mamba from a Frequency Perspective for Image Derainingcited by 57
- 2024U-shaped Vision Mamba for Single Image Dehazingcited by 40
- 2024FourierMamba: Fourier Learning Integration with State Space Models for Image Derainingcited by 32
- 2025EAMamba: Efficient All-Around Vision State Space Model for Image Restorationcited by 10
- 2024A Hybrid Transformer-Mamba Network for Single Image Derainingcited by 6
- 2025EAMamba: Efficient All-Around Vision State Space Model for Image Restoration27 Jun 2025
- 2024A Hybrid Transformer-Mamba Network for Single Image Deraining31 Aug 2024
- 2024FourierMamba: Fourier Learning Integration with State Space Models for Image Deraining29 May 2024
- 2024FreqMamba: Viewing Mamba from a Frequency Perspective for Image Deraining15 Apr 2024
- 2024U-shaped Vision Mamba for Single Image Dehazing6 Feb 2024
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
- 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
- 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
- 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networkscited by 77
- 2021On Efficient Transformer-Based Image Pre-training for Low-Level Visioncited by 64
- 2021Structure-Preserving Deraining with Residue Channel Prior Guidancecited by 63
- 2023GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditionscited by 62
12 most cited of 123 All 123 (JSON)
- 2026Learning from Failure: Leveraging Unreliable Predictions in Semi-Supervised Real-World Adverse Weather Removal1 Oct 2026
- 2026DerainSplat: Feed-Forward Clean 3D Gaussian Splatting from Sparse Rainy Views3 Aug 2026
- 2026CogSENet: Blind Image Deblurring with Blur-Conditioned Semantic Routing and Explicit Frequency Fusion29 Jun 2026
- 2026Aligning Network Equivariance with Data Symmetry: A Theoretical Framework and Adaptive Approach for Image Restoration13 May 2026
- 2026Edge-Efficient Image Restoration: Transformer Distillation into State-Space Models4 May 2026
- 2026Image-to-Image Translation Framework Embedded with Rotation Symmetry Priors14 Apr 2026
- 2026Cross-Scenario Deraining Adaptation with Unpaired Data: Superpixel Structural Priors and Multi-Stage Pseudo-Rain Synthesis23 Mar 2026
- 2026Spectral-Structured Diffusion for Single-Image Rain Removal10 Mar 2026
- 2026How far have we gone in Generative Image Restoration? A study on its capability, limitations and evaluation practices5 Mar 2026
- 2026EdgeLDR: Quaternion Low-Displacement Rank Neural Networks for Edge-Efficient Deep Learning8 Jan 2026
- 2025SD-PSFNet: Sequential and Dynamic Point Spread Function Network for Image Deraining22 Nov 2025
- 2025RAM++: Robust Representation Learning via Adaptive Mask for All-in-One Image Restoration15 Sep 2025
12 newest of 123 All 123 (JSON)