mlsanityData to 7 Oct 2026

GRIDS: Grouped Multiple-Degradation Restoration with Image Degradation Similarity

arXiv 2407.12273 ↗First posted 17 Jul 2024cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

Traditional single-task image restoration methods excel in handling specific degradation types but struggle with multiple degradations. To address this limitation, we propose Grouped Restoration with Image Degradation Similarity (GRIDS), a novel approach that harmonizes the competing objectives inherent in multiple-degradation restoration. We first introduce a quantitative method for assessing relationships between image degradations using statistical modeling of deep degradation representations. This analysis facilitates the strategic grouping of similar tasks, enhancing both the efficiency and effectiveness of the restoration process. Based on the degradation similarity, GRIDS divides restoration tasks into one of the optimal groups, where tasks within the same group are highly correlated. For instance, GRIDS effectively groups 11 degradation types into 4 cohesive groups. Trained models within each group show significant improvements, with an average improvement of 0.09dB over single-task upper bound models and 2.24dB over the mix-training baseline model. GRIDS incorporates an adaptive model selection mechanism for inference, automatically selecting the appropriate grouped-training model based on the input degradation. This mechanism is particularly useful for real-world scenarios with unknown degradations as it does not rely on explicit degradation classification modules. Furthermore, our method can predict model generalization ability without the need for network inference, providing valuable insights for practitioners.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 43 of its 57 references that are in the map. First posted on arXiv 17 Jul 2024.

Builds on

43 of 57 references.

References · 43

  1. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  2. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  3. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  4. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  5. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  6. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  7. 2020Gradient Surgery for Multi-Task Learningcited by 1,210
  8. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  9. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  10. 2017A Survey on Multi-Task Learningcited by 838
  11. 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
  12. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
31 more
  1. 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
  2. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  3. 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
  4. 2016Cross-stitch Networks for Multi-task Learningcited by 466
  5. 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 441
  6. 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
  7. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
  8. 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 367
  9. 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 361
  10. 2018Scale-recurrent Network for Deep Image Deblurringcited by 332
  11. 2021Efficiently Identifying Task Groupings for Multi-Task Learningcited by 218
  12. 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
  13. 2016UberNet: Training a `Universal' Convolutional Neural Network for Low-, Mid-, and High-Level Vision using Diverse Datasets and Limited Memorycited by 200
  14. 2020Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropoutcited by 199
  15. 2020Deblurring by Realistic Blurringcited by 187
  16. 2021Unsupervised Degradation Representation Learning for Blind Super-Resolutioncited by 177
  17. 2019RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolutioncited by 145
  18. 2018NDDR-CNN: Layerwise Feature Fusing in Multi-Task CNNs by Neural Discriminative Dimensionality Reductioncited by 127
  19. 2023PromptIR: Prompting for All-in-One Blind Image Restorationcited by 113
  20. 2018Image Inpainting via Generative Multi-column Convolutional Neural Networkscited by 81
  21. 2023ProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restorationcited by 77
  22. 2023Masked Image Training for Generalizable Deep Image Denoisingcited by 57
  23. 2023Recon: Reducing Conflicting Gradients from the Root for Multi-Task Learningcited by 50
  24. 2019Stochastic Filter Groups for Multi-Task CNNs: Learning Specialist and Generalist Convolution Kernelscited by 42
  25. 2022Learning Degradation Representations for Image Deblurringcited by 35
  26. 2023Unifying Image Processing as Visual Prompting Question Answeringcited by 29
  27. 2022A Closer Look at Blind Super-Resolution: Degradation Models, Baselines, and Performance Upper Boundscited by 22
  28. 2023All-in-one Multi-degradation Image Restoration Network via Hierarchical Degradation Representationcited by 21
  29. 2021Discovering Distinctive "Semantics" in Super-Resolution Networkscited by 20
  30. 2022Evaluating the Generalization Ability of Super-Resolution Networkscited by 18
  31. 2021Variational Multi-Task Learning with Gumbel-Softmax Priorscited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 5; 2026: 3.

12 papers.