Self-Calibrated Efficient Transformer for Lightweight Super-Resolution
Not on the map. Why?
Abstract (arXiv)
Recently, deep learning has been successfully applied to the single-image super-resolution (SISR) with remarkable performance. However, most existing methods focus on building a more complex network with a large number of layers, which can entail heavy computational costs and memory storage. To address this problem, we present a lightweight Self-Calibrated Efficient Transformer (SCET) network to solve this problem. The architecture of SCET mainly consists of the self-calibrated module and efficient transformer block, where the self-calibrated module adopts the pixel attention mechanism to extract image features effectively. To further exploit the contextual information from features, we employ an efficient transformer to help the network obtain similar features over long distances and thus recover sufficient texture details. We provide comprehensive results on different settings of the overall network. Our proposed method achieves more remarkable performance than baseline methods. The source code and pre-trained models are available at https://github.com/AlexZou14/SCET.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 37 of its 51 references that are in the map. First posted on arXiv 19 Apr 2022.
Builds on
37 of 51 references.
References · 37
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2017Non-local Neural Networkscited by 2,290
- 2016Identity Mappings in Deep Residual Networkscited by 1,960
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
25 more
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2020Pre-Trained Image Processing Transformercited by 891
- 2017Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolutioncited by 452
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
- 2016Accelerating the Super-Resolution Convolutional Neural Networkcited by 393
- 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 346
- 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 326
- 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
- 2018Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Networkcited by 263
- 2017MemNet: A Persistent Memory Network for Image Restorationcited by 244
- 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
- 2021LocalViT: Analyzing Locality in Vision Transformerscited by 228
- 2017Learning a Single Convolutional Super-Resolution Network for Multiple Degradationscited by 227
- 2019Lightweight Image Super-Resolution with Information Multi-distillation Networkcited by 227
- 2020Residual Feature Distillation Network for Lightweight Image Super-Resolutioncited by 122
- 2018Fast and Accurate Single Image Super-Resolution via Information Distillation Networkcited by 121
- 2020Efficient Image Super-Resolution Using Pixel Attentioncited by 87
- 2019Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Searchcited by 66
- 2020AIM 2020 Challenge on Efficient Super-Resolution: Methods and Resultscited by 36
- 2019Multi-Objective Reinforced Evolution in Mobile Neural Architecture Searchcited by 24
- 2020Lightweight Single-Image Super-Resolution Network with Attentive Auxiliary Feature Learningcited by 8
- 2018Learning to Deblur Images with Exemplarscited by 1
Built on by
Citing papers per year: 2023: 8; 2024: 9; 2025: 2; 2026: 1.
20 papers.
Sort:
By area:
- 2024Wave-Mamba: Wavelet State Space Model for Ultra-High-Definition Low-Light Image Enhancementcited by 48
- 2024NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Resultscited by 26
- 2024Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learningcited by 19
- 2024VersaT2I: Improving Text-to-Image Models with Versatile Rewardcited by 17
- 2023Revisiting Distillation for Continual Learning on Visual Question Localized-Answering in Robotic Surgerycited by 15
- 2023Double Domain Guided Real-Time Low-Light Image Enhancement for Ultra-High-Definition Transportation Surveillancecited by 12
- 2023DEHRFormer: Real-time Transformer for Depth Estimation and Haze Removal from Varicolored Haze Scenescited by 9
- 2024MIPI 2024 Challenge on Demosaic for HybridEVS Camera: Methods and Resultscited by 6
- 2024Channel-Partitioned Windowed Attention And Frequency Learning for Single Image Super-Resolutioncited by 5
- 2023Multi-Depth Branch Network for Efficient Image Super-Resolutioncited by 4
- 2024Enhancing Efficiency in Vision Transformer Networks: Design Techniques and Insightscited by 4
- 2023Image super-resolution via dynamic networkcited by 2
8 more
- 2023A residual dense vision transformer for medical image super-resolution with segmentation-based perceptual loss fine-tuningcited by 1
- 2024Physics-enhanced Neural Operator for Simulating Turbulent Transportcited by 1
- 2025NTIRE 2025 Challenge on Low Light Image Enhancement: Methods and Resultscited by 1
- 2023Reconstructing Turbulent Flows Using Physics-Aware Spatio-Temporal Dynamics and Test-Time Refinementcited by 0
- 2023Learning Exhaustive Correlation for Spectral Super-Resolution: Where Spatial-Spectral Attention Meets Linear Dependencecited by 0
- 2024Modeling Continuous Spatial-temporal Dynamics of Turbulent Flow with Test-time Refinementcited by 0
- 2025BrainPuzzle: Hybrid Physics and Data-Driven Reconstruction for Transcranial Ultrasound Tomographycited by 0
- 2026SP-MoMamba: Superpixel-driven Mixture of State Space Experts for Efficient Image Super-Resolutioncited by 0
- 2026SP-MoMamba: Superpixel-driven Mixture of State Space Experts for Efficient Image Super-Resolution25 May 2026
- 2025BrainPuzzle: Hybrid Physics and Data-Driven Reconstruction for Transcranial Ultrasound Tomography22 Oct 2025
- 2025NTIRE 2025 Challenge on Low Light Image Enhancement: Methods and Results15 Oct 2025
- 2024Modeling Continuous Spatial-temporal Dynamics of Turbulent Flow with Test-time Refinement27 Dec 2024
- 2024Wave-Mamba: Wavelet State Space Model for Ultra-High-Definition Low-Light Image Enhancement2 Aug 2024
- 2024Channel-Partitioned Windowed Attention And Frequency Learning for Single Image Super-Resolution23 Jul 2024
- 2024Physics-enhanced Neural Operator for Simulating Turbulent Transport31 May 2024
- 2024MIPI 2024 Challenge on Demosaic for HybridEVS Camera: Methods and Results8 May 2024
- 2024NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Results22 Apr 2024
- 2024Enhancing Efficiency in Vision Transformer Networks: Design Techniques and Insights28 Mar 2024
- 2024VersaT2I: Improving Text-to-Image Models with Versatile Reward27 Mar 2024
- 2024Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning5 Mar 2024
8 more
- 2023Learning Exhaustive Correlation for Spectral Super-Resolution: Where Spatial-Spectral Attention Meets Linear Dependence20 Dec 2023
- 2023Image super-resolution via dynamic network16 Oct 2023
- 2023Multi-Depth Branch Network for Efficient Image Super-Resolution29 Sep 2023
- 2023Double Domain Guided Real-Time Low-Light Image Enhancement for Ultra-High-Definition Transportation Surveillance15 Sep 2023
- 2023Revisiting Distillation for Continual Learning on Visual Question Localized-Answering in Robotic Surgery22 Jul 2023
- 2023Reconstructing Turbulent Flows Using Physics-Aware Spatio-Temporal Dynamics and Test-Time Refinement24 Apr 2023
- 2023DEHRFormer: Real-time Transformer for Depth Estimation and Haze Removal from Varicolored Haze Scenes13 Mar 2023
- 2023A residual dense vision transformer for medical image super-resolution with segmentation-based perceptual loss fine-tuning22 Feb 2023
- 2024NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Resultscited by 26
- 2024Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learningcited by 19
- 2024VersaT2I: Improving Text-to-Image Models with Versatile Rewardcited by 17
- 2023Revisiting Distillation for Continual Learning on Visual Question Localized-Answering in Robotic Surgerycited by 15
- 2023Double Domain Guided Real-Time Low-Light Image Enhancement for Ultra-High-Definition Transportation Surveillancecited by 12
- 2023DEHRFormer: Real-time Transformer for Depth Estimation and Haze Removal from Varicolored Haze Scenescited by 9
- 2024MIPI 2024 Challenge on Demosaic for HybridEVS Camera: Methods and Resultscited by 6
- 2024Channel-Partitioned Windowed Attention And Frequency Learning for Single Image Super-Resolutioncited by 5
- 2023Multi-Depth Branch Network for Efficient Image Super-Resolutioncited by 4
- 2024Enhancing Efficiency in Vision Transformer Networks: Design Techniques and Insightscited by 4
- 2023Image super-resolution via dynamic networkcited by 2
- 2023A residual dense vision transformer for medical image super-resolution with segmentation-based perceptual loss fine-tuningcited by 1
12 most cited of 19 All 19 (JSON)
- 2026SP-MoMamba: Superpixel-driven Mixture of State Space Experts for Efficient Image Super-Resolution25 May 2026
- 2025BrainPuzzle: Hybrid Physics and Data-Driven Reconstruction for Transcranial Ultrasound Tomography22 Oct 2025
- 2025NTIRE 2025 Challenge on Low Light Image Enhancement: Methods and Results15 Oct 2025
- 2024Modeling Continuous Spatial-temporal Dynamics of Turbulent Flow with Test-time Refinement27 Dec 2024
- 2024Channel-Partitioned Windowed Attention And Frequency Learning for Single Image Super-Resolution23 Jul 2024
- 2024Physics-enhanced Neural Operator for Simulating Turbulent Transport31 May 2024
- 2024MIPI 2024 Challenge on Demosaic for HybridEVS Camera: Methods and Results8 May 2024
- 2024NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Results22 Apr 2024
- 2024Enhancing Efficiency in Vision Transformer Networks: Design Techniques and Insights28 Mar 2024
- 2024VersaT2I: Improving Text-to-Image Models with Versatile Reward27 Mar 2024
- 2024Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning5 Mar 2024
- 2023Learning Exhaustive Correlation for Spectral Super-Resolution: Where Spatial-Spectral Attention Meets Linear Dependence20 Dec 2023
12 newest of 19 All 19 (JSON)