UniRain: Unified Image Deraining with RAG-based Dataset Distillation and Multi-objective Reweighted Optimization
On the map: Mixture-of-experts → Vision mixture-of-experts
Abstract (arXiv)
Despite significant progress has been made in image deraining, we note that most existing methods are often developed for only specific types of rain degradation and fail to generalize across diverse real-world rainy scenes. How to effectively model different rain degradations within a universal framework is important for real-world image deraining. In this paper, we propose UniRain, an effective unified image deraining framework capable of restoring images degraded by rain streak and raindrop under both daytime and nighttime conditions. To better enhance unified model generalization, we construct an intelligent retrieval augmented generation (RAG)-based dataset distillation pipeline that selects high-quality training samples from all public deraining datasets for better mixed training. Furthermore, we incorporate a simple yet effective multi-objective reweighted optimization strategy into the asymmetric mixture-of-experts (MoE) architecture to facilitate consistent performance and improve robustness across diverse scenes. Extensive experiments show that our framework performs favorably against the state-of-the-art models on our proposed benchmarks and multiple public datasets.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Vision mixture-of-experts, one of 12 directions in Mixture-of-experts. Builds on 41 of its 56 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
41 of 56 references.
References · 41
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2019Introduction to Multi-Armed Banditscited by 481
- 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 375
29 more
- 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 352
- 2019Progressive Image Deraining Networks: A Better and Simpler Baselinecited by 272
- 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 260
- 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 244
- 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 205
- 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
- 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
- 2020A Model-driven Deep Neural Network for Single Image Rain Removalcited by 125
- 2024Restoring Images in Adverse Weather Conditions via Histogram Transformercited by 73
- 2024Bidirectional Multi-Scale Implicit Neural Representations for Image Derainingcited by 54
- 2024MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understandingcited by 48
- 2022Toward Real-world Single Image Deraining: A New Benchmark and Beyondcited by 40
- 2023From Sky to the Ground: A Large-scale Benchmark and Simple Baseline Towards Real Rain Removalcited by 39
- 2024FoundIR: Unleashing Million-scale Training Data to Advance Foundation Models for Image Restorationcited by 39
- 2022Semi-Parametric Neural Image Synthesiscited by 37
- 2023Towards Unified Deep Image Deraining: A Survey and A New Benchmarkcited by 34
- 2022Not Just Streaks: Towards Ground Truth for Single Image Derainingcited by 31
- 2025WeatherBench: A Real-World Benchmark Dataset for All-in-One Adverse Weather Image Restorationcited by 20
- 2024Phidias: A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusioncited by 19
- 2024Learning A Spiking Neural Network for Efficient Image Derainingcited by 16
- 2024UAV-Rain1k: A Benchmark for Raindrop Removal from UAV Aerial Imagerycited by 15
- 2024ReFIR: Grounding Large Restoration Models with Retrieval Augmentationcited by 15
- 2024CoBa: Convergence Balancer for Multitask Finetuning of Large Language Modelscited by 13
- 2023Perception-Distortion Balanced Super-Resolution: A Multi-Objective Optimization Perspectivecited by 11
- 2022GTAV-NightRain: Photometric Realistic Large-scale Dataset for Night-time Rain Streak Removalcited by 9
- 2023Video Waterdrop Removal via Spatio-Temporal Fusion in Driving Scenescited by 7
- 2025Rethinking Nighttime Image Deraining via Learnable Color Space Transformationcited by 5
- 2025Rethinking Rainy 3D Scene Reconstruction via Perspective Transforming and Brightness Tuningcited by 4
- 2024RISSOLE: Parameter-efficient Diffusion Models via Block-wise Generation and Retrieval-Guidancecited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025PRISM: Progressive Rain removal with Integrated State-space Modeling
- 2023Rethinking Real-world Image Deraining via An Unpaired Degradation-Conditioned Diffusion Model
- 2022Removing Rain Streaks via Task Transfer Learning
- 2024NightRain: Nighttime Video Deraining via Adaptive-Rain-Removal and Adaptive-Correction
- 2023Towards General and Fast Video Derain via Knowledge Distillation
- 2024Image Deraining via Self-supervised Reinforcement Learning
- 2025Zero-Shot Video Deraining with Video Diffusion Models
- 2025Semi-Supervised State-Space Model with Dynamic Stacking Filter for Real-World Video Deraining