mlsanityData to 7 Oct 2026

Self-Calibrated Efficient Transformer for Lightweight Super-Resolution

arXiv 2204.08913 ↗First posted 19 Apr 2022cs.CVcited by 20

Not on the map. Why?

Abstract (arXiv)

Recently, deep learning has been successfully applied to the single-image super-resolution (SISR) with remarkable performance. However, most existing methods focus on building a more complex network with a large number of layers, which can entail heavy computational costs and memory storage. To address this problem, we present a lightweight Self-Calibrated Efficient Transformer (SCET) network to solve this problem. The architecture of SCET mainly consists of the self-calibrated module and efficient transformer block, where the self-calibrated module adopts the pixel attention mechanism to extract image features effectively. To further exploit the contextual information from features, we employ an efficient transformer to help the network obtain similar features over long distances and thus recover sufficient texture details. We provide comprehensive results on different settings of the overall network. Our proposed method achieves more remarkable performance than baseline methods. The source code and pre-trained models are available at https://github.com/AlexZou14/SCET.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 37 of its 51 references that are in the map. First posted on arXiv 19 Apr 2022.

Builds on

37 of 51 references.

References · 37

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020End-to-End Object Detection with Transformerscited by 7,384
  4. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  5. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  6. 2017Non-local Neural Networkscited by 2,290
  7. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  8. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  9. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  10. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  11. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  12. 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
25 more
  1. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  2. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  3. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
  4. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
  5. 2020Pre-Trained Image Processing Transformercited by 891
  6. 2017Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolutioncited by 452
  7. 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
  8. 2016Accelerating the Super-Resolution Convolutional Neural Networkcited by 393
  9. 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 346
  10. 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 326
  11. 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
  12. 2018Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Networkcited by 263
  13. 2017MemNet: A Persistent Memory Network for Image Restorationcited by 244
  14. 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
  15. 2021LocalViT: Analyzing Locality in Vision Transformerscited by 228
  16. 2017Learning a Single Convolutional Super-Resolution Network for Multiple Degradationscited by 227
  17. 2019Lightweight Image Super-Resolution with Information Multi-distillation Networkcited by 227
  18. 2020Residual Feature Distillation Network for Lightweight Image Super-Resolutioncited by 122
  19. 2018Fast and Accurate Single Image Super-Resolution via Information Distillation Networkcited by 121
  20. 2020Efficient Image Super-Resolution Using Pixel Attentioncited by 87
  21. 2019Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Searchcited by 66
  22. 2020AIM 2020 Challenge on Efficient Super-Resolution: Methods and Resultscited by 36
  23. 2019Multi-Objective Reinforced Evolution in Mobile Neural Architecture Searchcited by 24
  24. 2020Lightweight Single-Image Super-Resolution Network with Attentive Auxiliary Feature Learningcited by 8
  25. 2018Learning to Deblur Images with Exemplarscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 8; 2024: 9; 2025: 2; 2026: 1.

20 papers.

Sort:

By area:

  1. 2024Wave-Mamba: Wavelet State Space Model for Ultra-High-Definition Low-Light Image Enhancementcited by 48
  2. 2024NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Resultscited by 26
  3. 2024Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learningcited by 19
  4. 2024VersaT2I: Improving Text-to-Image Models with Versatile Rewardcited by 17
  5. 2023Revisiting Distillation for Continual Learning on Visual Question Localized-Answering in Robotic Surgerycited by 15
  6. 2023Double Domain Guided Real-Time Low-Light Image Enhancement for Ultra-High-Definition Transportation Surveillancecited by 12
  7. 2023DEHRFormer: Real-time Transformer for Depth Estimation and Haze Removal from Varicolored Haze Scenescited by 9
  8. 2024MIPI 2024 Challenge on Demosaic for HybridEVS Camera: Methods and Resultscited by 6
  9. 2024Channel-Partitioned Windowed Attention And Frequency Learning for Single Image Super-Resolutioncited by 5
  10. 2023Multi-Depth Branch Network for Efficient Image Super-Resolutioncited by 4
  11. 2024Enhancing Efficiency in Vision Transformer Networks: Design Techniques and Insightscited by 4
  12. 2023Image super-resolution via dynamic networkcited by 2
8 more
  1. 2023A residual dense vision transformer for medical image super-resolution with segmentation-based perceptual loss fine-tuningcited by 1
  2. 2024Physics-enhanced Neural Operator for Simulating Turbulent Transportcited by 1
  3. 2025NTIRE 2025 Challenge on Low Light Image Enhancement: Methods and Resultscited by 1
  4. 2023Reconstructing Turbulent Flows Using Physics-Aware Spatio-Temporal Dynamics and Test-Time Refinementcited by 0
  5. 2023Learning Exhaustive Correlation for Spectral Super-Resolution: Where Spatial-Spectral Attention Meets Linear Dependencecited by 0
  6. 2024Modeling Continuous Spatial-temporal Dynamics of Turbulent Flow with Test-time Refinementcited by 0
  7. 2025BrainPuzzle: Hybrid Physics and Data-Driven Reconstruction for Transcranial Ultrasound Tomographycited by 0
  8. 2026SP-MoMamba: Superpixel-driven Mixture of State Space Experts for Efficient Image Super-Resolutioncited by 0