Multi-Scale Progressive Fusion Network for Single Image Deraining
Not on the map. Why?
Abstract (arXiv)
Rain streaks in the air appear in various blurring degrees and resolutions due to different distances from their positions to the camera. Similar rain patterns are visible in a rain image as well as its multi-scale (or multi-resolution) versions, which makes it possible to exploit such complementary information for rain streak representation. In this work, we explore the multi-scale collaborative representation for rain streaks from the perspective of input image scales and hierarchical deep features in a unified framework, termed multi-scale progressive fusion network (MSPFN) for single image rain streak removal. For similar rain streaks at different positions, we employ recurrent calculation to capture the global texture, thus allowing to explore the complementary and redundant information at the spatial dimension to characterize target rain streaks. Besides, we construct multi-scale pyramid structure, and further introduce the attention mechanism to guide the fine fusion of this correlated information from different scales. This multi-scale progressive fusion strategy not only promotes the cooperative representation, but also boosts the end-to-end training. Our proposed method is extensively evaluated on several benchmark datasets and achieves state-of-the-art results. Moreover, we conduct experiments on joint deraining, detection, and segmentation tasks, and inspire a new research direction of vision task-driven image deraining. The source code is available at urlhttps://github.com/kuihua/MSPFN.
Key facts. Cited by 259 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 30; 2023: 48; 2024: 73; 2025: 57; 2026: 27.
259 papers.
Sort:
By area:
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
- 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
- 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
- 2023PromptIR: Prompting for All-in-One Blind Image Restorationcited by 113
- 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 108
- 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 98
- 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
38 more
- 2021Intriguing Findings of Frequency Selection for Image Deblurringcited by 80
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networkscited by 77
- 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Modelcited by 73
- 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 72
- 2023Residual Denoising Diffusion Modelscited by 68
- 2021Structure-Preserving Deraining with Residue Channel Prior Guidancecited by 63
- 2023GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditionscited by 62
- 2021Unpaired Deep Image Deraining Using Dual Contrastive Learningcited by 60
- 2021Semantic-Guided Zero-Shot Learning for Low-Light Image/Video Enhancementcited by 60
- 2024Perceive-IR: Learning to Perceive Degradation Better for All-in-One Image Restorationcited by 60
- 2024FreqMamba: Viewing Mamba from a Frequency Perspective for Image Derainingcited by 57
- 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
- 2024Bidirectional Multi-Scale Implicit Neural Representations for Image Derainingcited by 54
- 2022Towards Robust Rain Removal Against Adversarial Attacks: A Comprehensive Benchmark Analysis and Beyondcited by 48
- 2023Neural Degradation Representation Learning for All-In-One Image Restorationcited by 46
- 2023Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streakscited by 45
- 2022Toward Real-world Single Image Deraining: A New Benchmark and Beyondcited by 40
- 2024U-shaped Vision Mamba for Single Image Dehazingcited by 40
- 2023From Sky to the Ground: A Large-scale Benchmark and Simple Baseline Towards Real Rain Removalcited by 39
- 2025Degradation-Aware Feature Perturbation for All-in-One Image Restorationcited by 39
- 2024FoundIR: Unleashing Million-scale Training Data to Advance Foundation Models for Image Restorationcited by 37
- 2025Vision-Language Gradient Descent-driven All-in-One Deep Unfolding Networkscited by 37
- 2023Improving Image Restoration through Removing Degradations in Textual Representationscited by 36
- 2025MB-TaylorFormer V2: Improved Multi-branch Linear Transformer Expanded by Taylor Formula for Image Restorationcited by 36
- 2021Image Inpainting by End-to-End Cascaded Refinement with Mask Awarenesscited by 35
- 2023Towards Unified Deep Image Deraining: A Survey and A New Benchmarkcited by 34
- 2023KBNet: Kernel Basis Network for Image Restorationcited by 33
- 2021Robust Representation Learning with Feedback for Single Image Derainingcited by 32
- 2024FourierMamba: Fourier Learning Integration with State Space Models for Image Derainingcited by 32
- 2021Semi-Supervised Video Deraining with Dynamical Rain Generatorcited by 31
- 2022Not Just Streaks: Towards Ground Truth for Single Image Derainingcited by 31
- 2022Unsupervised Deraining: Where Contrastive Learning Meets Self-similaritycited by 30
- 2024Efficient Visual State Space Model for Image Deblurringcited by 27
- 2025Directing Mamba to Complex Textures: An Efficient Texture-Aware State Space Model for Image Restorationcited by 27
- 2022DRT: A Lightweight Single Image Deraining Recursive Transformercited by 26
- 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restorationcited by 26
- 2023Tracker Meets Night: A Transformer Enhancer for UAV Trackingcited by 23
- 2023Prompt-based Ingredient-Oriented All-in-One Image Restorationcited by 22
50 most cited of 259 All 259 (JSON)
- 2026Learning from Failure: Leveraging Unreliable Predictions in Semi-Supervised Real-World Adverse Weather Removal1 Oct 2026
- 2026Uncertainty-Guided Adverse Weather Restoration via Gated Transformer Network2 Sep 2026
- 2026P-PatchDiff: Progressive Patch Diffusion Models for Low-light Image Enhancement1 Sep 2026
- 2026DPC-Net: Dual-Prior Collaborative Network for All-in-One Image Restoration20 Aug 2026
- 2026QuReC: All-in-One Image Restoration with Query-Specific Guidance and Local-Global Response Calibration16 Jul 2026
- 2026CogSENet: Blind Image Deblurring with Blur-Conditioned Semantic Routing and Explicit Frequency Fusion29 Jun 2026
- 2026LogicIR: Logic Gate Networks for Image Restoration25 Jun 2026
- 2026DDTNet: Degradation Disentanglement and Transfer Network for Test-Time All-in-One De-weathering Adaptation15 Jun 2026
- 2026Beyond Model Size: Probing the Gaps in Visual in-Context Learning by Training a Tiny Model9 Jun 2026
- 2026Unifying Physically-Informed Weather Priors in A Single Model for Image Restoration Across Multiple Adverse Weather Conditions13 May 2026
- 2026Leveraging Multimodal Large Language Models for All-in-One Image Restoration via a Mixture of Frequency Experts12 May 2026
- 2026Edge-Efficient Image Restoration: Transformer Distillation into State-Space Models4 May 2026
38 more
- 2026Degradation-Aware Adaptive Context Gating for Unified Image Restoration2 May 2026
- 2026Unpaired Image Deraining Using Reward-Guided Self-Reinforcement Strategy1 May 2026
- 2026From Zero to Detail: A Progressive Spectral Decoupling Paradigm for UHD Image Restoration with New Benchmark17 Apr 2026
- 2026LoViF 2026 The First Challenge on Weather Removal in Videos12 Apr 2026
- 2026NTIRE 2026 The Second Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Results12 Apr 2026
- 2026UENR-600K: A Large-Scale Physically Grounded Dataset for Nighttime Video Deraining6 Apr 2026
- 2026Unified Restoration-Perception Learning: Maritime Infrared-Visible Image Fusion and Segmentation30 Mar 2026
- 2026M2IR: Proactive All-in-One Image Restoration via Mamba-style Modulation and Mixture-of-Experts16 Mar 2026
- 2026Spectral-Structured Diffusion for Single-Image Rain Removal10 Mar 2026
- 2026SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restoration6 Mar 2026
- 2026UniRain: Unified Image Deraining with RAG-based Dataset Distillation and Multi-objective Reweighted Optimization4 Mar 2026
- 2026Unifying Heterogeneous Degradations: Uncertainty-Aware Diffusion Bridge Model for All-in-One Image Restoration29 Jan 2026
- 2026From Physical Degradation Models to Task-Aware All-in-One Image Restoration15 Jan 2026
- 2026Edit2Restore:Few-Shot Image Restoration via Parameter-Efficient Adaptation of Pre-trained Editing Models6 Jan 2026
- 2026ClearAIR: A Human-Visual-Perception-Inspired All-in-One Image Restoration6 Jan 2026
- 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancement7 Dec 2025
- 2025Traffic Image Restoration under Adverse Weather via Frequency-Aware Mamba3 Dec 2025
- 2025Exploring the Potentials of Spiking Neural Networks for Image Deraining1 Dec 2025
- 2025IRPO: Boosting Image Restoration via Post-training GRPO30 Nov 2025
- 2025T2T-VICL: Cross-Task Visual In-Context Learning via Implicit Text-Driven VLMs20 Nov 2025
- 2025Semantics and Content Matter: Towards Multi-Prior Hierarchical Mamba for Image Deraining17 Nov 2025
- 2025Seeing Through the Rain: Resolving High-Frequency Conflicts in Deraining and Super-Resolution via Diffusion Guidance16 Nov 2025
- 2025Physically Interpretable Multi-Degradation Image Restoration via Deep Unfolding and Explainable Convolution13 Nov 2025
- 2025Rethinking Rainy 3D Scene Reconstruction via Perspective Transforming and Brightness Tuning10 Nov 2025
- 2025Learning to Restore Multi-Degraded Images via Ingredient Decoupling and Task-Aware Path Adaptation7 Nov 2025
- 2025Residual Diffusion Bridge Model for Image Restoration27 Oct 2025
- 2025Rethinking Nighttime Image Deraining via Learnable Color Space Transformation20 Oct 2025
- 2025WaMaIR: Image Restoration via Multiscale Wavelet Convolutions and Mamba-based Channel Modeling with Texture Enhancement19 Oct 2025
- 2025Pruning Overparameterized Multi-Task Networks for Degraded Web Image Restoration16 Oct 2025
- 2025Clear Roads, Clear Vision: Advancements in Multi-Weather Restoration for Smart Transportation10 Oct 2025
- 2025DeRainMamba: A Frequency-Aware State Space Model with Detail Enhancement for Image Deraining8 Oct 2025
- 2025Personalized Vision via Visual In-Context Learning29 Sep 2025
- 2025Degradation-Aware All-in-One Image Restoration via Latent Prior Encoding22 Sep 2025
- 2025NDLPNet: A Location-Aware Nighttime Deraining Network and a Real-World Benchmark Dataset17 Sep 2025
- 2025WeatherBench: A Real-World Benchmark Dataset for All-in-One Adverse Weather Image Restoration15 Sep 2025
- 2025Single Image Rain Streak Removal Using Harris Corner Loss and R-CBAM Network31 Jul 2025
- 2025DiNAT-IR: Exploring Dilated Neighborhood Attention for High-Quality Image Restoration23 Jul 2025
- 2025Exploring Scalable Unified Modeling for General Low-Level Vision20 Jul 2025
50 newest of 259 All 259 (JSON)
- 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
- 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 98
- 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Modelcited by 73
- 2023Residual Denoising Diffusion Modelscited by 68
- 2024Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restorationcited by 15
- 2024All-in-one Weather-degraded Image Restoration via Adaptive Degradation-aware Self-prompting Modelcited by 13
- 2024Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restorationcited by 9
- 2025DGSolver: Diffusion Generalist Solver with Universal Posterior Sampling for Image Restorationcited by 5
- 2024Training-Free Large Model Priors for Multiple-in-One Image Restorationcited by 4
- 2024ReviveDiff: A Universal Diffusion Model for Restoring Images in Adverse Weather Conditionscited by 3
- 2024Data-free Distillation with Degradation-prompt Diffusion for Multi-weather Image Restorationcited by 2
- 2023Learning A Coarse-to-Fine Diffusion Transformer for Image Restorationcited by 1
12 most cited of 15 All 15 (JSON)
- 2026P-PatchDiff: Progressive Patch Diffusion Models for Low-light Image Enhancement1 Sep 2026
- 2025DGSolver: Diffusion Generalist Solver with Universal Posterior Sampling for Image Restoration30 Apr 2025
- 2024Consistent Diffusion: Denoising Diffusion Model with Data-Consistent Training for Image Restoration17 Dec 2024
- 2024All-in-one Weather-degraded Image Restoration via Adaptive Degradation-aware Self-prompting Model12 Nov 2024
- 2024ReviveDiff: A Universal Diffusion Model for Restoring Images in Adverse Weather Conditions27 Sep 2024
- 2024Data-free Distillation with Degradation-prompt Diffusion for Multi-weather Image Restoration5 Sep 2024
- 2024Training-Free Large Model Priors for Multiple-in-One Image Restoration18 Jul 2024
- 2024Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restoration4 Jul 2024
- 2024Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration26 Jun 2024
- 2024Joint Conditional Diffusion Model for Image Restoration with Mixed Degradations11 Apr 2024
- 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model17 Mar 2024
- 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion16 Oct 2023
12 newest of 15 All 15 (JSON)
- 2024FreqMamba: Viewing Mamba from a Frequency Perspective for Image Derainingcited by 57
- 2024U-shaped Vision Mamba for Single Image Dehazingcited by 40
- 2024FourierMamba: Fourier Learning Integration with State Space Models for Image Derainingcited by 32
- 2025Directing Mamba to Complex Textures: An Efficient Texture-Aware State Space Model for Image Restorationcited by 27
- 2025EAMamba: Efficient All-Around Vision State Space Model for Image Restorationcited by 10
- 2024A Hybrid Transformer-Mamba Network for Single Image Derainingcited by 6
- 2025An Efficient and Mixed Heterogeneous Model for Image Restorationcited by 4
- 2024Mamba-UIE: Enhancing Underwater Images with Physical Model Constraintcited by 3
- 2025WaMaIR: Image Restoration via Multiscale Wavelet Convolutions and Mamba-based Channel Modeling with Texture Enhancementcited by 0
- 2025Semantics and Content Matter: Towards Multi-Prior Hierarchical Mamba for Image Derainingcited by 0
- 2025Traffic Image Restoration under Adverse Weather via Frequency-Aware Mambacited by 0
- 2025Traffic Image Restoration under Adverse Weather via Frequency-Aware Mamba3 Dec 2025
- 2025Semantics and Content Matter: Towards Multi-Prior Hierarchical Mamba for Image Deraining17 Nov 2025
- 2025WaMaIR: Image Restoration via Multiscale Wavelet Convolutions and Mamba-based Channel Modeling with Texture Enhancement19 Oct 2025
- 2025EAMamba: Efficient All-Around Vision State Space Model for Image Restoration27 Jun 2025
- 2025An Efficient and Mixed Heterogeneous Model for Image Restoration15 Apr 2025
- 2025Directing Mamba to Complex Textures: An Efficient Texture-Aware State Space Model for Image Restoration27 Jan 2025
- 2024A Hybrid Transformer-Mamba Network for Single Image Deraining31 Aug 2024
- 2024Mamba-UIE: Enhancing Underwater Images with Physical Model Constraint27 Jul 2024
- 2024FourierMamba: Fourier Learning Integration with State Space Models for Image Deraining29 May 2024
- 2024FreqMamba: Viewing Mamba from a Frequency Perspective for Image Deraining15 Apr 2024
- 2024U-shaped Vision Mamba for Single Image Dehazing6 Feb 2024
- 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 72
- 2023WM-MoE: Weather-aware Multi-scale Mixture-of-Experts for Blind Adverse Weather Removalcited by 11
- 2026UniRain: Unified Image Deraining with RAG-based Dataset Distillation and Multi-objective Reweighted Optimizationcited by 2
- 2026SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restorationcited by 0
- 2026M2IR: Proactive All-in-One Image Restoration via Mamba-style Modulation and Mixture-of-Expertscited by 0
- 2026M2IR: Proactive All-in-One Image Restoration via Mamba-style Modulation and Mixture-of-Experts16 Mar 2026
- 2026SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restoration6 Mar 2026
- 2026UniRain: Unified Image Deraining with RAG-based Dataset Distillation and Multi-objective Reweighted Optimization4 Mar 2026
- 2024Complexity Experts are Task-Discriminative Learners for Any Image Restoration27 Nov 2024
- 2023WM-MoE: Weather-aware Multi-scale Mixture-of-Experts for Blind Adverse Weather Removal24 Mar 2023
- 2024Towards Real-World Adverse Weather Image Restoration: Enhancing Clearness and Semantics with Vision-Language Modelscited by 10
- 2024LLMRA: Multi-modal Large Language Model based Restoration Assistantcited by 8
- 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancementcited by 5
- 2026Leveraging Multimodal Large Language Models for All-in-One Image Restoration via a Mixture of Frequency Expertscited by 0
- 2026Leveraging Multimodal Large Language Models for All-in-One Image Restoration via a Mixture of Frequency Experts12 May 2026
- 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancement7 Dec 2025
- 2024Towards Real-World Adverse Weather Image Restoration: Enhancing Clearness and Semantics with Vision-Language Models3 Sep 2024
- 2024LLMRA: Multi-modal Large Language Model based Restoration Assistant21 Jan 2024
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
- 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
- 2023PromptIR: Prompting for All-in-One Blind Image Restorationcited by 113
- 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 108
- 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
- 2021Intriguing Findings of Frequency Selection for Image Deblurringcited by 80
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networkscited by 77
12 most cited of 223 All 223 (JSON)
- 2026Learning from Failure: Leveraging Unreliable Predictions in Semi-Supervised Real-World Adverse Weather Removal1 Oct 2026
- 2026Uncertainty-Guided Adverse Weather Restoration via Gated Transformer Network2 Sep 2026
- 2026DPC-Net: Dual-Prior Collaborative Network for All-in-One Image Restoration20 Aug 2026
- 2026QuReC: All-in-One Image Restoration with Query-Specific Guidance and Local-Global Response Calibration16 Jul 2026
- 2026CogSENet: Blind Image Deblurring with Blur-Conditioned Semantic Routing and Explicit Frequency Fusion29 Jun 2026
- 2026LogicIR: Logic Gate Networks for Image Restoration25 Jun 2026
- 2026DDTNet: Degradation Disentanglement and Transfer Network for Test-Time All-in-One De-weathering Adaptation15 Jun 2026
- 2026Beyond Model Size: Probing the Gaps in Visual in-Context Learning by Training a Tiny Model9 Jun 2026
- 2026Unifying Physically-Informed Weather Priors in A Single Model for Image Restoration Across Multiple Adverse Weather Conditions13 May 2026
- 2026Edge-Efficient Image Restoration: Transformer Distillation into State-Space Models4 May 2026
- 2026Degradation-Aware Adaptive Context Gating for Unified Image Restoration2 May 2026
- 2026Unpaired Image Deraining Using Reward-Guided Self-Reinforcement Strategy1 May 2026
12 newest of 223 All 223 (JSON)