Exploiting Regional Information Transformer for Single Image Deraining
Not on the map. Why?
Abstract (arXiv)
Transformer-based Single Image Deraining (SID) methods have achieved remarkable success, primarily attributed to their robust capability in capturing long-range interactions. However, we've noticed that current methods handle rain-affected and unaffected regions concurrently, overlooking the disparities between these areas, resulting in confusion between rain streaks and background parts, and inabilities to obtain effective interactions, ultimately resulting in suboptimal deraining outcomes. To address the above issue, we introduce the Region Transformer (Regformer), a novel SID method that underlines the importance of independently processing rain-affected and unaffected regions while considering their combined impact for high-quality image reconstruction. The crux of our method is the innovative Region Transformer Block (RTB), which integrates a Region Masked Attention (RMA) mechanism and a Mixed Gate Forward Block (MGFB). Our RTB is used for attention selection of rain-affected and unaffected regions and local modeling of mixed scales. The RMA generates attention maps tailored to these two regions and their interactions, enabling our model to capture comprehensive features essential for rain removal. To better recover high-frequency textures and capture more local details, we develop the MGFB as a compensation module to complete local mixed scale modeling. Extensive experiments demonstrate that our model reaches state-of-the-art performance, significantly improving the image deraining quality. Our code and trained models are publicly available.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 73 references that are in the map. First posted on arXiv 25 Feb 2024.
Builds on
31 of 73 references.
References · 31
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2020A Survey on Visual Transformercited by 653
- 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 351
- 2021DeepViT: Towards Deeper Vision Transformercited by 288
- 2019Progressive Image Deraining Networks: A Better and Simpler Baselinecited by 271
19 more
- 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 259
- 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
- 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
- 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
- 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
- 2017Image De-raining Using a Conditional Generative Adversarial Networkcited by 197
- 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
- 2020A Model-driven Deep Neural Network for Single Image Rain Removalcited by 125
- 2019Single Image Deraining: From Model-Based to Data-Driven and Beyondcited by 77
- 2018Lightweight Pyramid Networks for Image Derainingcited by 64
- 2021Structure-Preserving Deraining with Residue Channel Prior Guidancecited by 63
- 2020Computing Systems for Autonomous Driving: State-of-the-Art and Challengescited by 47
- 2023OvarNet: Towards Open-vocabulary Object Attribute Recognitioncited by 43
- 2018Physics-Based Generative Adversarial Models for Image Restoration and Beyondcited by 37
- 2023Towards Unified Deep Image Deraining: A Survey and A New Benchmarkcited by 34
- 2023How can objects help action recognition?cited by 21
- 2022Magic ELF: Image Deraining Meets Association Learning and Transformercited by 17
- 2022Feature-Aligned Video Raindrop Removal with Temporal Constraintscited by 7
Built on by
Not cited yet.