mlsanityData to 14 Oct 2026

Efficient and Explicit Modelling of Image Hierarchies for Image Restoration

arXiv 2303.00748 ↗First posted 1 Mar 2023cs.CVcited by 145

Not on the map. Why?

Abstract (arXiv)

The aim of this paper is to propose a mechanism to efficiently and explicitly model image hierarchies in the global, regional, and local range for image restoration. To achieve that, we start by analyzing two important properties of natural images including cross-scale similarity and anisotropic image features. Inspired by that, we propose the anchored stripe self-attention which achieves a good balance between the space and time complexity of self-attention and the modelling capacity beyond the regional range. Then we propose a new network architecture dubbed GRL to explicitly model image hierarchies in the Global, Regional, and Local range via anchored stripe self-attention, window self-attention, and channel attention enhanced convolution. Finally, the proposed network is applied to 7 image restoration types, covering both real and synthetic settings. The proposed method sets the new state-of-the-art for several of those. Code will be available at https://github.com/ofsoundof/GRL-Image-Restoration.git.

Key facts. Cited by 145 papers in the map (data through 14 Oct 2026). Builds on 66 of its 97 references that are in the map. First posted on arXiv 1 Mar 2023.

Builds on

66 of 97 references.

References · 66

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2020End-to-End Object Detection with Transformerscited by 7,414
  6. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  7. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  8. 2017Non-local Neural Networkscited by 2,293
  9. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  10. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  11. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  12. 2020Reformer: The Efficient Transformercited by 1,668
38 more
  1. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  2. 2020Rethinking Attention with Performerscited by 1,601
  3. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
  4. 2019Generating Long Sequences with Sparse Transformerscited by 1,546
  5. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  6. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  7. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
  8. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
  9. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  10. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
  11. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
  12. 2020Pre-Trained Image Processing Transformercited by 893
  13. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  14. 2021Multi-Stage Progressive Image Restorationcited by 816
  15. 2018Residual Dense Network for Image Super-Resolutioncited by 799
  16. 2018Image Transformercited by 772
  17. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
  18. 2019Stand-Alone Self-Attention in Vision Modelscited by 542
  19. 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 510
  20. 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 470
  21. 2017Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolutioncited by 453
  22. 2022Activating More Pixels in Image Super-Resolution Transformercited by 438
  23. 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 371
  24. 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 367
  25. 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 362
  26. 2018Scale-recurrent Network for Deep Image Deblurringcited by 333
  27. 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 329
  28. 2021Rethinking Coarse-to-Fine Approach in Single Image Deblurringcited by 326
  29. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 302
  30. 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
  31. 2019Residual Non-local Attention Networks for Image Restorationcited by 236
  32. 2021LocalViT: Analyzing Locality in Vision Transformerscited by 228
  33. 2018Deep Back-Projection Networks For Super-Resolutioncited by 225
  34. 2019Deep Stacked Hierarchical Multi-patch Network for Image Deblurringcited by 206
  35. 2020Deblurring by Realistic Blurringcited by 188
  36. 2018Multi-level Wavelet-CNN for Image Restorationcited by 184
  37. 2020Human-Aware Motion Deblurringcited by 175
  38. 2018Non-Local Recurrent Network for Image Restorationcited by 160

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 18; 2024: 67; 2025: 48; 2026: 12.

145 papers.

Sort:

By area:

  1. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
  2. 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 111
  3. 2024MambaIRv2: Attentive State Space Restorationcited by 94
  4. 2023Agent Attention: On the Integration of Softmax and Linear Attentioncited by 90
  5. 2023HAT: Hybrid Attention Transformer for Image Restorationcited by 66
  6. 2024Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionarycited by 64
  7. 2024Perceive-IR: Learning to Perceive Degradation Better for All-in-One Image Restorationcited by 62
  8. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 60
  9. 2024The Ninth NTIRE 2024 Efficient Super-Resolution Challenge Reportcited by 57
  10. 2024LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentationcited by 54
  11. 2024U-DiTs: Downsample Tokens in U-Shaped Diffusion Transformerscited by 54
  12. 2024Frequency-Assisted Mamba for Remote Sensing Image Super-Resolutioncited by 48
38 more
  1. 2024Lightweight Adaptive Feature De-drifting for Compressed Image Classificationcited by 46
  2. 2024NTIRE 2024 Challenge on Image Super-Resolution (x4): Methods and Resultscited by 40
  3. 2024Efficient Real-world Image Super-Resolution Via Adaptive Directional Gradient Convolutioncited by 37
  4. 2023Language-driven All-in-one Adverse Weather Removalcited by 36
  5. 2023Recursive Generalization Transformer for Image Super-Resolutioncited by 29
  6. 2024Transfer CLIP for Generalizable Image Denoisingcited by 29
  7. 2024Efficient Visual State Space Model for Image Deblurringcited by 29
  8. 2025Uncertainty-guided Perturbation for Image Super-Resolution Diffusion Modelcited by 29
  9. 2025Progressive Focused Transformer for Single Image Super-Resolutioncited by 25
  10. 2023Efficient Multi-scale Network with Learnable Discrete Wavelet Transform for Blind Motion Deblurringcited by 24
  11. 2024Efficient Diffusion Transformer with Step-wise Dynamic Attention Mediatorscited by 24
  12. 2025From Zero to Detail: Deconstructing Ultra-High-Definition Image Restoration from Progressive Spectral Perspectivecited by 23
  13. 2024Motion-adaptive Separable Collaborative Filters for Blind Motion Deblurringcited by 20
  14. 2024Efficient Face Super-Resolution via Wavelet-based Feature Enhancement Networkcited by 18
  15. 2024LoRA-IR: Taming Low-Rank Experts for Efficient All-in-One Image Restorationcited by 18
  16. 2025Hybrid Agents for Image Restorationcited by 17
  17. 2023Hybrid Spectral Denoising Transformer with Guided Attentioncited by 16
  18. 2024CascadedGaze: Efficiency in Global Context Extraction for Image Restorationcited by 16
  19. 2024APISR: Anime Production Inspired Real-World Anime Super-Resolutioncited by 16
  20. 2025Consistency Trajectory Matching for One-Step Generative Super-Resolutioncited by 16
  21. 2024A Dynamic Kernel Prior Model for Unsupervised Blind Image Super-Resolutioncited by 15
  22. 2024Sharing Key Semantics in Transformer Makes Efficient Image Restorationcited by 14
  23. 2023Minimalist and High-Quality Panoramic Imaging with PSF-aware Transformerscited by 13
  24. 2024Transforming Image Super-Resolution: A ConvFormer-based Efficient Approachcited by 13
  25. 2024A Unified Framework for Microscopy Defocus Deblur with Multi-Pyramid Transformer and Contrastive Learningcited by 13
  26. 2023Lookup Table meets Local Laplacian Filter: Pyramid Reconstruction Network for Tone Mappingcited by 12
  27. 2023Always Clear Days: Degradation Type and Severity Aware All-In-One Adverse Weather Removalcited by 12
  28. 2023LDP: Language-driven Dual-Pixel Image Defocus Deblurring Networkcited by 11
  29. 2025Bokehlicious: Photorealistic Bokeh Rendering with Controllable Aperturescited by 11
  30. 2024Instruct-IPT: All-in-One Image Processing Transformer via Weight Modulationcited by 9
  31. 2024Predicting the Original Appearance of Damaged Historical Documentscited by 9
  32. 2025DeblurDiff: Real-World Image Deblurring with Generative Diffusion Modelscited by 8
  33. 2025RGB-to-Polarization Estimation: A New Task and Benchmark Studycited by 8
  34. 2025Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularizationcited by 8
  35. 2023VCISR: Blind Single Image Super-Resolution with Video Compression Synthetic Datacited by 7
  36. 2024IPT-V2: Efficient Image Processing Transformer using Hierarchical Attentionscited by 7
  37. 2024Exploring the Low-Pass Filtering Behavior in Image Super-Resolutioncited by 7
  38. 2025DSwinIR: Rethinking Window-based Attention for Image Restorationcited by 7

50 most cited of 145 All 145 (JSON)