Cross Paradigm Representation and Alignment Transformer for Image Deraining
Not on the map. Why?
Abstract (arXiv)
Transformer-based networks have achieved strong performance in low-level vision tasks like image deraining by utilizing spatial or channel-wise self-attention. However, irregular rain patterns and complex geometric overlaps challenge single-paradigm architectures, necessitating a unified framework to integrate complementary global-local and spatial-channel representations. To address this, we propose a novel Cross Paradigm Representation and Alignment Transformer (CPRAformer). Its core idea is the hierarchical representation and alignment, leveraging the strengths of both paradigms (spatial-channel and global-local) to aid image reconstruction. It bridges the gap within and between paradigms, aligning and coordinating them to enable deep interaction and fusion of features. Specifically, we use two types of self-attention in the Transformer blocks: sparse prompt channel self-attention (SPC-SA) and spatial pixel refinement self-attention (SPR-SA). SPC-SA enhances global channel dependencies through dynamic sparsity, while SPR-SA focuses on spatial rain distribution and fine-grained texture recovery. To address the feature misalignment and knowledge differences between them, we introduce the Adaptive Alignment Frequency Module (AAFM), which aligns and interacts with features in a two-stage progressive manner, enabling adaptive guidance and complementarity. This reduces the information gap within and between paradigms. Through this unified cross-paradigm dynamic interaction framework, we achieve the extraction of the most valuable interactive fusion information from the two paradigms. Extensive experiments demonstrate that our model achieves state-of-the-art performance on eight benchmark datasets and further validates CPRAformer's robustness in other image restoration tasks and downstream applications.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 70 references that are in the map. First posted on arXiv 23 Apr 2025.
Builds on
35 of 70 references.
References · 35
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2017Benchmarking Single Image Dehazing and Beyondcited by 447
- 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 352
- 2019FFA-Net: Feature Fusion Attention Network for Single Image Dehazingcited by 307
- 2019Progressive Image Deraining Networks: A Better and Simpler Baselinecited by 272
- 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 260
- 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
23 more
- 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 244
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 237
- 2020Multi-Scale Boosted Dehazing Network with Dense Feature Fusioncited by 230
- 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
- 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 205
- 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
- 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
- 2022Learning Enriched Features for Fast Image Restoration and Enhancementcited by 150
- 2022Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practicecited by 136
- 2023MB-TaylorFormer: Multi-branch Efficient Transformer Expanded by Taylor Formula for Image Dehazingcited by 81
- 2019Single Image Deraining: From Model-Based to Data-Driven and Beyondcited by 77
- 2024Restoring Images in Adverse Weather Conditions via Histogram Transformercited by 73
- 2021From Synthetic to Real: Image Dehazing Collaborating with Unlabeled Real Datacited by 68
- 2021Structure-Preserving Deraining with Residue Channel Prior Guidancecited by 63
- 2023TransNeXt: Robust Foveal Visual Perception for Vision Transformerscited by 61
- 2024Bidirectional Multi-Scale Implicit Neural Representations for Image Derainingcited by 54
- 2022Towards Robust Rain Removal Against Adversarial Attacks: A Comprehensive Benchmark Analysis and Beyondcited by 48
- 2020DCSFN: Deep Cross-scale Fusion Network for Single Image Rain Removalcited by 44
- 2022DRT: A Lightweight Single Image Deraining Recursive Transformercited by 26
- 2023MixDehazeNet : Mix Structure Block For Image Dehazing Networkcited by 18
- 2022Single UHD Image Dehazing via Interpretable Pyramid Networkcited by 13
- 2022LKD-Net: Large Kernel Convolution Network for Single Image Dehazingcited by 13
- 2022Rethinking Performance Gains in Image Dehazing Networkscited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.