Restorer: Removing Multi-Degradation with All-Axis Attention and Prompt Guidance
Not on the map. Why?
Abstract (arXiv)
There are many excellent solutions in image restoration.However, most methods require on training separate models to restore images with different types of degradation.Although existing all-in-one models effectively address multiple types of degradation simultaneously, their performance in real-world scenarios is still constrained by the task confusion problem.In this work, we attempt to address this issue by introducing Restorer, a novel Transformer-based all-in-one image restoration model.To effectively address the complex degradation present in real-world images, we propose All-Axis Attention (AAA), a mechanism that simultaneously models long-range dependencies across both spatial and channel dimensions, capturing potential correlations along all axes.Additionally, we introduce textual prompts in Restorer to incorporate explicit task priors, enabling the removal of specific degradation types based on user instructions. By iterating over these prompts, Restorer can handle composite degradation in real-world scenarios without requiring additional training.Based on these designs, Restorer with one set of parameters demonstrates state-of-the-art performance in multiple image restoration tasks compared to existing all-in-one and even single-task models.Additionally, Restorer is efficient during inference, suggesting the potential in real-world applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 80 references that are in the map. First posted on arXiv 18 Jun 2024.
Builds on
52 of 80 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016Layer Normalizationcited by 5,669
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
- 2020Pre-Trained Image Processing Transformercited by 893
38 more
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 723
- 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 722
- 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
- 2017Benchmarking Single Image Dehazing and Beyondcited by 447
- 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 367
- 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 362
- 2019Kindling the Darkness: A Practical Low-light Image Enhancercited by 355
- 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 352
- 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 318
- 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 312
- 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
- 2019FFA-Net: Feature Fusion Attention Network for Single Image Dehazingcited by 307
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 302
- 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
- 2019Progressive Image Deraining Networks: A Better and Simpler Baselinecited by 272
- 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 260
- 2020Multi-Scale Boosted Dehazing Network with Dense Feature Fusioncited by 230
- 2019Deep Stacked Hierarchical Multi-patch Network for Image Deblurringcited by 206
- 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
- 2020Deblurring by Realistic Blurringcited by 188
- 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
- 2020A Model-driven Deep Neural Network for Single Image Rain Removalcited by 125
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 121
- 2019Variational Denoising Network: Toward Blind Noise Modeling and Removalcited by 117
- 2019Multi-Temporal Recurrent Neural Networks For Progressive Non-Uniform Single Image Deblurring With Incremental Temporal Trainingcited by 112
- 2020Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generationcited by 101
- 2020Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalizationcited by 92
- 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
- 2022Unsupervised Night Image Enhancement: When Layer Decomposition Meets Light-Effects Suppressioncited by 73
- 2020Spatial-Adaptive Network for Single Image Denoisingcited by 64
- 2021NTIRE 2021 Challenge on Image Deblurringcited by 50
- 2023Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restorationcited by 50
- 2022Vision Transformer with Super Token Samplingcited by 44
- 2020EfficientDeRain: Learning Pixel-wise Dilation Filtering for High-Efficiency Single-Image Derainingcited by 39
- 2021Closing the Loop: Joint Rain Generation and Removal via Disentangled Image Translationcited by 36
- 2022MSSNet: Multi-Scale-Stage Network for Single Image Deblurringcited by 31
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.