Image Super-Resolution Reconstruction Network based on Enhanced Swin Transformer via Alternating Aggregation of Local-Global Features
Not on the map. Why?
Abstract (arXiv)
The Swin Transformer image super-resolution (SR) reconstruction network primarily depends on the long-range relationship of the window and shifted window attention to explore features. However, this approach focuses only on global features, ignoring local ones, and considers only spatial interactions, disregarding channel and spatial-channel feature interactions, limiting its nonlinear mapping capability. Therefore, this study proposes an enhanced Swin Transformer network (ESTN) that alternately aggregates local and global features. During local feature aggregation, shift convolution facilitates the interaction between local spatial and channel information. During global feature aggregation, a block sparse global perception module is introduced, wherein spatial information is reorganized and the recombined features are then processed by a dense layer to achieve global perception. Additionally, multiscale self-attention and low-parameter residual channel attention modules are introduced to aggregate information across different scales. Finally, the effectiveness of ESTN on five public datasets and a local attribution map (LAM) are analyzed. Experimental results demonstrate that the proposed ESTN achieves higher average PSNR, surpassing SRCNN, ELAN-light, SwinIR-light, and SMFANER+ models by 2.17dB, 0.13dB, 0.12dB, and 0.1dB, respectively, with LAM further confirming its larger receptive field. ESTN delivers improved quality of SR images. The source code can be found at https://github.com/huangyuming2021/ESTN.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 61 references that are in the map. First posted on arXiv 30 Dec 2023.
Builds on
36 of 61 references.
References · 36
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2016Layer Normalizationcited by 5,669
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
24 more
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
- 2020Pre-Trained Image Processing Transformercited by 893
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 438
- 2021Pay Attention to MLPscited by 368
- 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 329
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 302
- 2018Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Networkcited by 264
- 2019Lightweight Image Super-Resolution with Information Multi-distillation Networkcited by 227
- 2022Efficient Long-Range Attention Network for Image Super-resolutioncited by 151
- 2021Transformer for Single Image Super-Resolutioncited by 150
- 2020Interpreting Super-Resolution Networks with Local Attribution Mapscited by 136
- 2023Dual Aggregation Transformer for Image Super-Resolutioncited by 124
- 2017Shift: A Zero FLOP, Zero Parameter Alternative to Spatial Convolutionscited by 93
- 2021LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyondcited by 88
- 2022N-Gram in Swin Transformers for Efficient Lightweight Image Super-Resolutioncited by 46
- 2023DIPNet: Efficiency Distillation and Iterative Pruning for Image Super-Resolutioncited by 19
- 2022Cross-receptive Focused Inference Network for Lightweight Image Super-Resolutioncited by 16
- 2020Low-Cost Implementation of Bilinear and Bicubic Image Interpolation for Real-Time Image Super-Resolutioncited by 11
Built on by
Not cited yet.