mlsanityData to 7 Oct 2026

Learning Correction Errors via Frequency-Self Attention for Blind Image Super-Resolution

arXiv 2403.07390 ↗First posted 12 Mar 2024eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Previous approaches for blind image super-resolution (SR) have relied on degradation estimation to restore high-resolution (HR) images from their low-resolution (LR) counterparts. However, accurate degradation estimation poses significant challenges. The SR model's incompatibility with degradation estimation methods, particularly the Correction Filter, may significantly impair performance as a result of correction errors. In this paper, we introduce a novel blind SR approach that focuses on Learning Correction Errors (LCE). Our method employs a lightweight Corrector to obtain a corrected low-resolution (CLR) image. Subsequently, within an SR network, we jointly optimize SR performance by utilizing both the original LR image and the frequency learning of the CLR image. Additionally, we propose a new Frequency-Self Attention block (FSAB) that enhances the global information utilization ability of Transformer. This block integrates both self-attention and frequency spatial attention mechanisms. Extensive ablation and comparison experiments conducted across various settings demonstrate the superiority of our method in terms of visual quality and accuracy. Our approach effectively addresses the challenges associated with degradation estimation and correction errors, paving the way for more accurate blind image SR.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 44 of its 66 references that are in the map. First posted on arXiv 12 Mar 2024.

Builds on

44 of 66 references.

References · 44

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2016Densely Connected Convolutional Networkscited by 6,691
  6. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  7. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  8. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  9. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  10. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  11. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  12. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
32 more
  1. 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
  2. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
  3. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  4. 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
  5. 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
  6. 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 326
  7. 2017"Zero-Shot" Super-Resolution using Deep Internal Learningcited by 285
  8. 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
  9. 2021Global Filter Networks for Image Classificationcited by 257
  10. 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
  11. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
  12. 2017Learning a Single Convolutional Super-Resolution Network for Multiple Degradationscited by 227
  13. 2018Deep Back-Projection Networks For Super-Resolutioncited by 224
  14. 2022VRT: A Video Restoration Transformercited by 219
  15. 2022UniFormer: Unifying Convolution and Self-attention for Visual Recognitioncited by 206
  16. 2019Blind Super-Resolution With Iterative Kernel Correctioncited by 203
  17. 2021Unsupervised Degradation Representation Learning for Blind Super-Resolutioncited by 177
  18. 2019Blind Super-Resolution Kernel Estimation using an Internal-GANcited by 175
  19. 2020Unfolding the Alternating Optimization for Blind Super Resolutioncited by 129
  20. 2021Video Super-Resolution Transformercited by 120
  21. 2020Meta-Transfer Learning for Zero-Shot Super-Resolutioncited by 116
  22. 2021Blind Image Super-Resolution: A Survey and Beyondcited by 93
  23. 2021Flow-based Kernel Prior with Application to Blind Super-Resolutioncited by 74
  24. 2021On Efficient Transformer-Based Image Pre-training for Low-Level Visioncited by 64
  25. 2021Mutual Affine Network for Spatially Variant Kernel Estimation in Blind Image Super-Resolutioncited by 52
  26. 2022Deep Constrained Least Squares for Blind Image Super-Resolutioncited by 47
  27. 2022Deep Frequency Filtering for Domain Generalizationcited by 41
  28. 2020KOALAnet: Blind Super-Resolution using Kernel-Oriented Adaptive Local Adjustmentcited by 37
  29. 2019Correction Filter for Single Image Super-Resolution: Robustifying Off-the-Shelf Deep Super-Resolverscited by 35
  30. 2022Knowledge Distillation based Degradation Estimation for Blind Super-Resolutioncited by 28
  31. 2021End-to-end Alternating Optimization for Blind Super Resolutioncited by 17
  32. 2023SwinFSR: Stereo Image Super-Resolution using SwinIR and Frequency Domain Knowledgecited by 10

Built on by

Not cited yet.