mlsanityData to 7 Oct 2026

Image Super-Resolution using Efficient Striped Window Transformer

arXiv 2301.09869 ↗First posted 24 Jan 2023cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Transformers have achieved remarkable results in single-image super-resolution (SR). However, the challenge of balancing model performance and complexity has hindered their application in lightweight SR (LSR). To tackle this challenge, we propose an efficient striped window transformer (ESWT). We revisit the normalization layer in the transformer and design a concise and efficient transformer structure to build the ESWT. Furthermore, we introduce a striped window mechanism to model long-term dependencies more efficiently. To fully exploit the potential of the ESWT, we propose a novel flexible window training strategy that can improve the performance of the ESWT without additional cost. Extensive experiments show that ESWT outperforms state-of-the-art LSR transformers, and achieves a better trade-off between model performance and complexity. The ESWT requires fewer parameters, incurs faster inference, smaller FLOPs, and less memory consumption, making it a promising solution for LSR.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 33 of its 48 references that are in the map. First posted on arXiv 24 Jan 2023.

Builds on

33 of 48 references.

References · 33

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  5. 2016Layer Normalizationcited by 5,579
  6. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  8. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  9. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  10. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  11. 2020On Layer Normalization in the Transformer Architecturecited by 906
  12. 2020Pre-Trained Image Processing Transformercited by 891
21 more
  1. 2021Going deeper with Image Transformerscited by 759
  2. 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 717
  3. 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 526
  4. 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
  5. 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 326
  6. 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
  7. 2020Do Wide and Deep Networks Learn the Same Things? Uncovering How Neural Network Representations Vary with Width and Depthcited by 241
  8. 2019Lightweight Image Super-Resolution with Information Multi-distillation Networkcited by 227
  9. 2022DeepNet: Scaling Transformers to 1,000 Layerscited by 176
  10. 2022Efficient Long-Range Attention Network for Image Super-resolutioncited by 151
  11. 2021Transformer for Single Image Super-Resolutioncited by 150
  12. 2020Interpreting Super-Resolution Networks with Local Attribution Mapscited by 136
  13. 2020Residual Feature Distillation Network for Lightweight Image Super-Resolutioncited by 122
  14. 2020Rethinking Bias-Variance Trade-off for Generalization of Neural Networkscited by 107
  15. 2021LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyondcited by 88
  16. 2021On Efficient Transformer-Based Image Pre-training for Low-Level Visioncited by 64
  17. 2022Residual Local Feature Network for Efficient Super-Resolutioncited by 53
  18. 2022Revisiting RCAN: Improved Training for Image Super-Resolutioncited by 32
  19. 2021Feature Distillation Interaction Weighting Network for Lightweight Image Super-Resolutioncited by 29
  20. 2022Lightweight Bimodal Network for Single-Image Super-Resolution via Symmetric CNN and Recursive Transformercited by 22
  21. 2022Image Super-resolution with An Enhanced Group Convolutional Neural Networkcited by 7

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.