# Enhanced Spatio-Temporal Interaction Learning for Video Deraining: A Faster and Better Framework

arXiv: https://arxiv.org/abs/2103.12318 · HTML: https://mlsanity.com/paper/2103.12318/

## Key facts

- Cited by 30 papers in the map (data through 14 Oct 2026).
- Builds on 16 of its 46 references that are in the map.
- First posted on arXiv 23 Mar 2021.

## Builds on (most cited first, 16 of 16)

- [Densely Connected Convolutional Networks](https://mlsanity.com/paper/1608.06993/) (2016)
- [Residual Dense Network for Image Super-Resolution](https://mlsanity.com/paper/1802.08797/) (2018)
- [Deep Joint Rain Detection and Removal from a Single Image](https://mlsanity.com/paper/1609.07769/) (2016)
- [Density-aware Single Image De-raining using a Multi-stream Dense Network](https://mlsanity.com/paper/1802.07412/) (2018)
- [Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining](https://mlsanity.com/paper/1807.05698/) (2018)
- [Attentive Generative Adversarial Network for Raindrop Removal from a Single Image](https://mlsanity.com/paper/1711.10098/) (2017)
- [Image De-raining Using a Conditional Generative Adversarial Network](https://mlsanity.com/paper/1701.05957/) (2017)
- [Spatial Attentive Single-Image Deraining with a High Quality Real Rain Dataset](https://mlsanity.com/paper/1904.01538/) (2019)
- [Clearing the Skies: A deep network architecture for single-image rain removal](https://mlsanity.com/paper/1609.02087/) (2016)
- [Single Image Deraining: A Comprehensive Benchmark Analysis](https://mlsanity.com/paper/1903.08558/) (2019)
- [Robust Video Content Alignment and Compensation for Rain Removal in a CNN Framework](https://mlsanity.com/paper/1803.10433/) (2018)
- [Semi-Supervised Video Deraining with Dynamical Rain Generator](https://mlsanity.com/paper/2103.07939/) (2021)
- [FastDeRain: A Novel Video Rain Streak Removal Method Using Directional Gradient Priors](https://mlsanity.com/paper/1803.07487/) (2018)
- [Rethinking Image Deraining via Rain Streaks and Vapors](https://mlsanity.com/paper/2008.00823/) (2020)
- [Predicting Video Saliency with Object-to-Motion CNN and Two-layer Convolutional LSTM](https://mlsanity.com/paper/1709.06316/) (2017)
- [DRD-Net: Detail-recovery Image Deraining via Context Aggregation Networks](https://mlsanity.com/paper/1908.10267/) (2019)

## Built on by (most cited first, 30 of 30)

- [MB-TaylorFormer: Multi-branch Efficient Transformer Expanded by Taylor Formula for Image Dehazing](https://mlsanity.com/paper/2308.14036/) (2023)
- [RainMamba: Enhanced Locality Learning with State Space Models for Video Deraining](https://mlsanity.com/paper/2407.21773/) (2024)
- [Learning A Physical-aware Diffusion Model Based on Transformer for Underwater Image Enhancement](https://mlsanity.com/paper/2403.01497/) (2024)
- [NightRain: Nighttime Video Deraining via Adaptive-Rain-Removal and Adaptive-Correction](https://mlsanity.com/paper/2401.00729/) (2024)
- [Low-light Image Enhancement via CLIP-Fourier Guided Wavelet Diffusion](https://mlsanity.com/paper/2401.03788/) (2024)
- [Highly Efficient 3D Human Pose Tracking from Events with Spiking Spatiotemporal Transformer](https://mlsanity.com/paper/2303.09681/) (2023)
- [RainyScape: Unsupervised Rainy Scene Reconstruction using Decoupled Neural Rendering](https://mlsanity.com/paper/2404.11401/) (2024)
- [CFMW: Cross-modality Fusion Mamba for Robust Object Detection under Adverse Weather](https://mlsanity.com/paper/2404.16302/) (2024)
- [Visual and Textual Prompts in VLLMs for Enhancing Emotion Recognition](https://mlsanity.com/paper/2504.17224/) (2025)
- [M2Restore: Mixture-of-Experts-based Mamba-CNN Fusion Framework for All-in-One Image Restoration](https://mlsanity.com/paper/2506.07814/) (2025)
- [EGVD: Event-Guided Video Deraining](https://mlsanity.com/paper/2309.17239/) (2023)
- [Cross-Consistent Deep Unfolding Network for Adaptive All-In-One Video Restoration](https://mlsanity.com/paper/2309.01627/) (2023)
- [Rethinking Rainy 3D Scene Reconstruction via Perspective Transforming and Brightness Tuning](https://mlsanity.com/paper/2511.06734/) (2025)
- [ASF-Net: Robust Video Deraining via Temporal Alignment and Online Adaptive Learning](https://mlsanity.com/paper/2309.00956/) (2023)
- [DPMambaIR: All-in-One Image Restoration via Degradation-Aware Prompt State Space Model](https://mlsanity.com/paper/2504.17732/) (2025)
- [A Lightweight and Effective Image Tampering Localization Network with Vision Mamba](https://mlsanity.com/paper/2502.09941/) (2025)
- [All-in-One Image Restoration via Causal-Deconfounding Wavelet-Disentangled Prompt Network](https://mlsanity.com/paper/2603.03839/) (2026)
- [Task-Guided Prompting for Unified Remote Sensing Image Restoration](https://mlsanity.com/paper/2604.02742/) (2026)
- [CoRE-UIR: Prior-guided common and residual experts for efficient all-in-one remote sensing image restoration](https://mlsanity.com/paper/2607.27898/) (2026)
- [Removing Multiple Hybrid Adverse Weather in Video via a Unified Model](https://mlsanity.com/paper/2503.06200/) (2025)
- [SpikeDerain: Unveiling Clear Videos from Rainy Sequences Using Color Spike Streams](https://mlsanity.com/paper/2503.20315/) (2025)
- [HiRQA: Hierarchical Ranking and Quality Alignment for Opinion-Unaware Image Quality Assessment](https://mlsanity.com/paper/2508.15130/) (2025)
- [Clear Roads, Clear Vision: Advancements in Multi-Weather Restoration for Smart Transportation](https://mlsanity.com/paper/2510.09228/) (2025)
- [UENR-600K: A Large-Scale Physically Grounded Dataset for Nighttime Video Deraining](https://mlsanity.com/paper/2604.04402/) (2026)
- [MDeRainNet: An Efficient Macro-pixel Image Rain Removal Network](https://mlsanity.com/paper/2406.10652/) (2024)
- [RainDancer: RGB-Event Video Deraining with Rain-Oriented Spiking Dynamics](https://mlsanity.com/paper/2607.13802/) (2026)
- [Revisiting the Current Frame: Physical-Trace-Guided Network Output Correction for Video Restoration](https://mlsanity.com/paper/2608.09342/) (2026)
- [StereoDiffuer: Diffusion-based Progressive Geometry Modeling with Saliency Attention Perception for Stereo Matching](https://mlsanity.com/paper/2608.21710/) (2026)
- [S3VD: Semantic-Guidance Spatio-Temporal Scanning for Video Deraining](https://mlsanity.com/paper/2609.21322/) (2026)
- [FluidRain: Incompressible Rain Flow as an Attention Bias for Loop-in-Loop Video Deraining](https://mlsanity.com/paper/2609.29006/) (2026)

## Abstract (arXiv)

Video deraining is an important task in computer vision as the unwanted rain hampers the visibility of videos and deteriorates the robustness of most outdoor vision systems. Despite the significant success which has been achieved for video deraining recently, two major challenges remain: 1) how to exploit the vast information among continuous frames to extract powerful spatio-temporal features across both the spatial and temporal domains, and 2) how to restore high-quality derained videos with a high-speed approach. In this paper, we present a new end-to-end video deraining framework, named Enhanced Spatio-Temporal Interaction Network (ESTINet), which considerably boosts current state-of-the-art video deraining quality and speed. The ESTINet takes the advantage of deep residual networks and convolutional long short-term memory, which can capture the spatial features and temporal correlations among continuing frames at the cost of very little computational source. Extensive experiments on three public datasets show that the proposed ESTINet can achieve faster speed than the competitors, while maintaining better performance than the state-of-the-art methods.