mlsanityData to 14 Oct 2026

Restorer: Removing Multi-Degradation with All-Axis Attention and Prompt Guidance

arXiv 2406.12587 ↗First posted 18 Jun 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

There are many excellent solutions in image restoration.However, most methods require on training separate models to restore images with different types of degradation.Although existing all-in-one models effectively address multiple types of degradation simultaneously, their performance in real-world scenarios is still constrained by the task confusion problem.In this work, we attempt to address this issue by introducing Restorer, a novel Transformer-based all-in-one image restoration model.To effectively address the complex degradation present in real-world images, we propose All-Axis Attention (AAA), a mechanism that simultaneously models long-range dependencies across both spatial and channel dimensions, capturing potential correlations along all axes.Additionally, we introduce textual prompts in Restorer to incorporate explicit task priors, enabling the removal of specific degradation types based on user instructions. By iterating over these prompts, Restorer can handle composite degradation in real-world scenarios without requiring additional training.Based on these designs, Restorer with one set of parameters demonstrates state-of-the-art performance in multiple image restoration tasks compared to existing all-in-one and even single-task models.Additionally, Restorer is efficient during inference, suggesting the potential in real-world applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 80 references that are in the map. First posted on arXiv 18 Jun 2024.

Builds on

52 of 80 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  6. 2016Layer Normalizationcited by 5,669
  7. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  8. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  9. 2019Language Models as Knowledge Bases?cited by 1,936
  10. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  11. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  12. 2020Pre-Trained Image Processing Transformercited by 893
38 more
  1. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  2. 2021Multi-Stage Progressive Image Restorationcited by 816
  3. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 723
  4. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 722
  5. 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
  6. 2017Benchmarking Single Image Dehazing and Beyondcited by 447
  7. 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 367
  8. 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 362
  9. 2019Kindling the Darkness: A Practical Low-light Image Enhancercited by 355
  10. 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 352
  11. 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 318
  12. 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 312
  13. 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
  14. 2019FFA-Net: Feature Fusion Attention Network for Single Image Dehazingcited by 307
  15. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 302
  16. 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
  17. 2019Progressive Image Deraining Networks: A Better and Simpler Baselinecited by 272
  18. 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 260
  19. 2020Multi-Scale Boosted Dehazing Network with Dense Feature Fusioncited by 230
  20. 2019Deep Stacked Hierarchical Multi-patch Network for Image Deblurringcited by 206
  21. 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
  22. 2020Deblurring by Realistic Blurringcited by 188
  23. 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
  24. 2020A Model-driven Deep Neural Network for Single Image Rain Removalcited by 125
  25. 2022Deep Generalized Unfolding Networks for Image Restorationcited by 121
  26. 2019Variational Denoising Network: Toward Blind Noise Modeling and Removalcited by 117
  27. 2019Multi-Temporal Recurrent Neural Networks For Progressive Non-Uniform Single Image Deblurring With Incremental Temporal Trainingcited by 112
  28. 2020Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generationcited by 101
  29. 2020Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalizationcited by 92
  30. 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
  31. 2022Unsupervised Night Image Enhancement: When Layer Decomposition Meets Light-Effects Suppressioncited by 73
  32. 2020Spatial-Adaptive Network for Single Image Denoisingcited by 64
  33. 2021NTIRE 2021 Challenge on Image Deblurringcited by 50
  34. 2023Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restorationcited by 50
  35. 2022Vision Transformer with Super Token Samplingcited by 44
  36. 2020EfficientDeRain: Learning Pixel-wise Dilation Filtering for High-Efficiency Single-Image Derainingcited by 39
  37. 2021Closing the Loop: Joint Rain Generation and Removal via Disentangled Image Translationcited by 36
  38. 2022MSSNet: Multi-Scale-Stage Network for Single Image Deblurringcited by 31

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.