From Local Windows to Adaptive Candidates via Individualized Exploratory: Rethinking Attention for Image Super-Resolution
Not on the map. Why?
Abstract (arXiv)
Single Image Super-Resolution (SISR) is a fundamental computer vision task that aims to reconstruct a high-resolution (HR) image from a low-resolution (LR) input. Transformer-based methods have achieved remarkable performance by modeling long-range dependencies in degraded images. However, their feature-intensive attention computation incurs high computational cost. To improve efficiency, most existing approaches partition images into fixed groups and restrict attention within each group. Such group-wise attention overlooks the inherent asymmetry in token similarities, thereby failing to enable flexible and token-adaptive attention computation. To address this limitation, we propose the Individualized Exploratory Transformer (IET), which introduces a novel Individualized Exploratory Attention (IEA) mechanism that allows each token to adaptively select its own content-aware and independent attention candidates. This token-adaptive and asymmetric design enables more precise information aggregation while maintaining computational efficiency. Extensive experiments on standard SR benchmarks demonstrate that IET achieves state-of-the-art performance under comparable computational complexity.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
30 of 49 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2017Non-local Neural Networkscited by 2,290
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
18 more
- 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
- 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 526
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
- 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 326
- 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
- 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
- 2018Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Networkcited by 263
- 2019Lightweight Image Super-Resolution with Information Multi-distillation Networkcited by 227
- 2022Efficient Long-Range Attention Network for Image Super-resolutioncited by 151
- 2022Cross Aggregation Transformer for Image Restorationcited by 92
- 2024MambaIRv2: Attentive State Space Restorationcited by 90
- 2021LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyondcited by 88
- 2022Accurate Image Restoration with Attention Retractable Transformercited by 85
- 2024Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionarycited by 63
- 2023Omni Aggregation Networks for Lightweight Image Super-Resolutioncited by 62
- 2022N-Gram in Swin Transformers for Efficient Lightweight Image Super-Resolutioncited by 46
- 2025Progressive Focused Transformer for Single Image Super-Resolutioncited by 25
- 2025CATANet: Efficient Content-Aware Token Aggregation for Lightweight Image Super-Resolutioncited by 15
Built on by
Citing papers per year: 2026: 1.
1 paper.