Empowering Image Recovery_ A Multi-Attention Approach
Not on the map. Why?
Abstract (arXiv)
We propose Diverse Restormer (DART), a novel image restoration method that effectively integrates information from various sources (long sequences, local and global regions, feature dimensions, and positional dimensions) to address restoration challenges. While Transformer models have demonstrated excellent performance in image restoration due to their self-attention mechanism, they face limitations in complex scenarios. Leveraging recent advancements in Transformers and various attention mechanisms, our method utilizes customized attention mechanisms to enhance overall performance. DART, our novel network architecture, employs windowed attention to mimic the selective focusing mechanism of human eyes. By dynamically adjusting receptive fields, it optimally captures the fundamental features crucial for image resolution reconstruction. Efficiency and performance balance are achieved through the LongIR attention mechanism for long sequence image restoration. Integration of attention mechanisms across feature and positional dimensions further enhances the recovery of fine details. Evaluation across five restoration tasks consistently positions DART at the forefront. Upon acceptance, we commit to providing publicly accessible code and models to ensure reproducibility and facilitate further research.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 53 of its 79 references that are in the map. First posted on arXiv 6 Apr 2024.
Builds on
53 of 79 references.
References · 53
- 2017Attention Is All You Needcited by 60,361
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
- 2020Pre-Trained Image Processing Transformercited by 893
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
- 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 470
38 more
- 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 367
- 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 362
- 2018Scale-recurrent Network for Deep Image Deblurringcited by 333
- 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 329
- 2021Rethinking Coarse-to-Fine Approach in Single Image Deblurringcited by 326
- 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 312
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 302
- 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
- 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
- 2019Residual Non-local Attention Networks for Image Restorationcited by 236
- 2020CycleISP: Real Image Restoration via Improved Data Synthesiscited by 213
- 2017Benchmarking Denoising Algorithms with Real Photographscited by 209
- 2019Deep Stacked Hierarchical Multi-patch Network for Image Deblurringcited by 206
- 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
- 2020Deblurring by Realistic Blurringcited by 188
- 2018Residual Dense Network for Image Restorationcited by 181
- 2019Real Image Denoising with Feature Attentioncited by 176
- 2020Human-Aware Motion Deblurringcited by 175
- 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
- 2022Stripformer: Strip Transformer for Fast Image Deblurringcited by 140
- 2020Defocus Deblurring Using Dual-Pixel Datacited by 139
- 2020Interpreting Super-Resolution Networks with Local Attribution Mapscited by 136
- 2019Deep Learning on Image Denoising: An overviewcited by 128
- 2020Spatially-Attentive Patch-Hierarchical Network for Adaptive Motion Deblurringcited by 119
- 2019Multi-Temporal Recurrent Neural Networks For Progressive Non-Uniform Single Image Deblurring With Incremental Temporal Trainingcited by 112
- 2020Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generationcited by 101
- 2020Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalizationcited by 92
- 2019A Deep Journey into Super-resolution: A surveycited by 86
- 2021Iterative Filter Adaptive Network for Single Image Defocus Deblurringcited by 86
- 2019Single Image Deraining: A Comprehensive Benchmark Analysiscited by 84
- 2021Spatially-Adaptive Image Restoration using Distortion-Guided Networkscited by 77
- 2019Dual Residual Networks Leveraging the Potential of Paired Operations for Image Restorationcited by 73
- 2020Spatial-Adaptive Network for Single Image Denoisingcited by 64
- 2021Burst Image Restoration and Enhancementcited by 64
- 2021On Efficient Transformer-Based Image Pre-training for Low-Level Visioncited by 64
- 2019Densely Residual Laplacian Super-Resolutioncited by 57
- 2021Single Image Defocus Deblurring Using Kernel-Sharing Parallel Atrous Convolutionscited by 54
- 2021NTIRE 2021 Challenge on Image Deblurringcited by 50
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025MatIR: A Hybrid Mamba-Transformer Image Restoration Model30 Jan 2025