Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionary
Not on the map. Why?
Abstract (arXiv)
Single Image Super-Resolution is a classic computer vision problem that involves estimating high-resolution (HR) images from low-resolution (LR) ones. Although deep neural networks (DNNs), especially Transformers for super-resolution, have seen significant advancements in recent years, challenges still remain, particularly in limited receptive field caused by window-based self-attention. To address these issues, we introduce a group of auxiliary Adaptive Token Dictionary to SR Transformer and establish an ATD-SR method. The introduced token dictionary could learn prior information from training data and adapt the learned prior to specific testing image through an adaptive refinement step. The refinement strategy could not only provide global information to all input tokens but also group image tokens into categories. Based on category partitions, we further propose a category-based self-attention mechanism designed to leverage distant but similar tokens for enhancing input features. The experimental results show that our method achieves the best performance on various single image super-resolution benchmarks.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). Builds on 27 of its 48 references that are in the map. First posted on arXiv 16 Jan 2024.
Builds on
27 of 48 references.
References · 27
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2017Non-local Neural Networkscited by 2,290
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
15 more
- 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
- 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 326
- 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
- 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
- 2018Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Networkcited by 263
- 2019Lightweight Image Super-Resolution with Information Multi-distillation Networkcited by 227
- 2022Efficient Long-Range Attention Network for Image Super-resolutioncited by 151
- 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
- 2022Cross Aggregation Transformer for Image Restorationcited by 92
- 2021LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyondcited by 88
- 2022Accurate Image Restoration with Attention Retractable Transformercited by 85
- 2022Swin2SR: SwinV2 Transformer for Compressed Image Super-Resolution and Restorationcited by 72
- 2023Omni Aggregation Networks for Lightweight Image Super-Resolutioncited by 62
- 2022N-Gram in Swin Transformers for Efficient Lightweight Image Super-Resolutioncited by 46
Built on by
Citing papers per year: 2024: 13; 2025: 29; 2026: 21.
63 papers.
Sort:
By area:
- 2024MambaIRv2: Attentive State Space Restorationcited by 90
- 2024Frequency-Assisted Mamba for Remote Sensing Image Super-Resolutioncited by 47
- 2025Uncertainty-guided Perturbation for Image Super-Resolution Diffusion Modelcited by 29
- 2025Learned Image Compression with Dictionary-based Entropy Modelcited by 29
- 2025Progressive Focused Transformer for Single Image Super-Resolutioncited by 25
- 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Groundingcited by 21
- 2025Generalized and Efficient 2D Gaussian Splatting for Arbitrary-scale Super-Resolutioncited by 21
- 2024Hi-Mamba: Hierarchical Mamba for Efficient Image Super-Resolutioncited by 16
- 2025CATANet: Efficient Content-Aware Token Aggregation for Lightweight Image Super-Resolutioncited by 15
- 2025Consistency Trajectory Matching for One-Step Generative Super-Resolutioncited by 15
- 2024Sharing Key Semantics in Transformer Makes Efficient Image Restorationcited by 14
- 2024IRSRMamba: Infrared Image Super-Resolution via Mamba-based Wavelet Transform Feature Modulation Modelcited by 12
38 more
- 2025NTIRE 2025 Challenge on Image Super-Resolution (x4): Methods and Resultscited by 12
- 2025NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: KwaiSR Dataset and Studycited by 11
- 2025Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularizationcited by 8
- 2025DSwinIR: Rethinking Window-based Attention for Image Restorationcited by 7
- 2025Emulating Self-attention with Convolution for Efficient Image Super-Resolutioncited by 5
- 2025Content-Aware Mamba for Learned Image Compressioncited by 5
- 2025VQualA 2025 Challenge on Image Super-Resolution Generated Content Quality Assessment: Methods and Resultscited by 5
- 2024Generative AI in Vision: A Survey on Models, Metrics and Applicationscited by 4
- 2025Q-MambaIR: Accurate Quantized Mamba for Efficient Image Restorationcited by 4
- 2025RAW Image Reconstruction from RGB on Smartphones. NTIRE 2025 Challenge Reportcited by 4
- 2025PromptSR: Cascade Prompting for Lightweight Image Super-Resolutioncited by 4
- 2025Seeing Through the Rain: Resolving High-Frequency Conflicts in Deraining and Super-Resolution via Diffusion Guidancecited by 4
- 2024LIPT: Latency-aware Image Processing Transformercited by 3
- 2024ControlSR: Taming Diffusion Models for Consistent Real-World Image Super Resolutioncited by 3
- 2025Towards Blind Bitstream-corrupted Video Recovery via a Visual Foundation Model-driven Frameworkcited by 3
- 2025Texture Vector-Quantization and Reconstruction Aware Prediction for Generative Super-Resolutioncited by 3
- 2026ATD: Improved Transformer with Adaptive Token Dictionary for Image Restorationcited by 3
- 2024Sparse Reconstruction of Optical Doppler Tomography with Alternative State Space Model and Attentioncited by 2
- 2025DP2O-SR: Direct Perceptual Preference Optimization for Real-World Image Super-Resolutioncited by 2
- 2026SAT: Selective Aggregation Transformer for Image Super-Resolutioncited by 2
- 2024Implicit Grid Convolution for Multi-Scale Image Super-Resolutioncited by 1
- 2024FIPER: Factorized Features for Robust Image Super-Resolution and Compressioncited by 1
- 2025Any Image Restoration via Efficient Spatial-Frequency Degradation Adaptationcited by 1
- 2025Structural Similarity-Inspired Unfolding for Lightweight Image Super-Resolutioncited by 1
- 2025GPSMamba: A Global Phase and Spectral Prompt-guided Mamba for Infrared Image Super-Resolutioncited by 1
- 2025OmniScaleSR: Unleashing Scale-Controlled Diffusion Prior for Faithful and Realistic Arbitrary-Scale Image Super-Resolutioncited by 1
- 2026From Local Windows to Adaptive Candidates via Individualized Exploratory: Rethinking Attention for Image Super-Resolutioncited by 1
- 2026Rank-Factorized Implicit Neural Bias: Scaling Super-Resolution Transformer with FlashAttentioncited by 1
- 2026Beyond Visual Fidelity: Benchmarking Super-Resolution Models for Large-Scale Remote Sensing Imagery via Downstream Task Integrationcited by 1
- 2024Sewer Image Super-Resolution with Depth Priors and Its Lightweight Networkcited by 0
- 2025Tackling Ill-posedness of Reversible Image Conversion with Well-posed Invertible Networkcited by 0
- 2025Pure-Pass: Fine-Grained, Adaptive Masking for Dynamic Token-Mixing Routing in Lightweight Image Super-Resolutioncited by 0
- 2025HSNet: Heterogeneous Subgraph Network for Single Image Super-resolutioncited by 0
- 2025DeepRFTv2: Kernel-level Learning for Image Deblurringcited by 0
- 2025HIMOSA: Efficient Remote Sensing Image Super-Resolution with Hierarchical Mixture of Sparse Attentioncited by 0
- 2026ASBA: A-line State Space Model and B-line Attention for Sparse Optical Doppler Tomography Reconstructioncited by 0
- 2026RPT-SR: Regional Prior attention Transformer for infrared image Super-Resolutioncited by 0
- 2026UCAN: Unified Convolutional Attention Network for Expansive Receptive Fields in Lightweight Super-Resolutioncited by 0
50 most cited of 63 All 63 (JSON)
- 2026SFMformer: A Spatial-Frequency Modulation Transformer for Lightweight Image Super-Resolution18 Aug 2026
- 2026Decoupling Cross-Modality Manifold Discrepancy: Leveraging Visible Diffusion Priors for Infrared Super-Resolution23 Jul 2026
- 2026CUST: Clustered Unit-level Similarity Transformer for Lightweight Image Super-Resolution13 Jul 2026
- 2026Perceiving Better Moments: Cover Frame Reselection and Enhancement for Live Photos with the Live2K Dataset5 Jul 2026
- 2026Resonant Brane Splatting for Arbitrary-Scale Super-Resolution28 Jun 2026
- 2026Adaptive Densification for High-Fidelity and Efficient Sparse Gaussian Splatting in Arbitrary-Scale Super-Resolution28 Jun 2026
- 2026Linear Recurrent Unit with Semantic Modulation for Image Super-Resolution18 Jun 2026
- 2026FoA-SR: Faithful or Aesthetic? Profile-Aware Preference Optimization for Real-World Image Super-Resolution9 Jun 2026
- 2026SR-Ground: Image Quality Grounding for Super-Resolved Content20 May 2026
- 2026You Only Landmark Once: Lightweight U-Net Face Super Resolution with YOLO-World Landmark Heatmaps13 May 2026
- 2026OP4KSR: One-Step Patch-Free 4K Super-Resolution with Periodic Artifact Suppression13 May 2026
- 2026Beyond Visual Fidelity: Benchmarking Super-Resolution Models for Large-Scale Remote Sensing Imagery via Downstream Task Integration1 May 2026
38 more
- 2026Degradation-Robust Fusion: An Efficient Degradation-Aware Diffusion Framework for Multimodal Image Fusion in Arbitrary Degradation Scenarios10 Apr 2026
- 2026SAT: Selective Aggregation Transformer for Image Super-Resolution9 Apr 2026
- 2026Dictionary-based Pathology Mining with Hard-instance-assisted Classifier Debiasing for Genetic Biomarker Prediction from WSIs26 Mar 2026
- 2026UCAN: Unified Convolutional Attention Network for Expansive Receptive Fields in Lightweight Super-Resolution12 Mar 2026
- 2026Rank-Factorized Implicit Neural Bias: Scaling Super-Resolution Transformer with FlashAttention6 Mar 2026
- 2026ATD: Improved Transformer with Adaptive Token Dictionary for Image Restoration3 Mar 2026
- 2026RPT-SR: Regional Prior attention Transformer for infrared image Super-Resolution17 Feb 2026
- 2026ASBA: A-line State Space Model and B-line Attention for Sparse Optical Doppler Tomography Reconstruction20 Jan 2026
- 2026From Local Windows to Adaptive Candidates via Individualized Exploratory: Rethinking Attention for Image Super-Resolution13 Jan 2026
- 2025OmniScaleSR: Unleashing Scale-Controlled Diffusion Prior for Faithful and Realistic Arbitrary-Scale Image Super-Resolution4 Dec 2025
- 2025HIMOSA: Efficient Remote Sensing Image Super-Resolution with Hierarchical Mixture of Sparse Attention29 Nov 2025
- 2025DeepRFTv2: Kernel-level Learning for Image Deblurring26 Nov 2025
- 2025Seeing Through the Rain: Resolving High-Frequency Conflicts in Deraining and Super-Resolution via Diffusion Guidance16 Nov 2025
- 2025DP2O-SR: Direct Perceptual Preference Optimization for Real-World Image Super-Resolution21 Oct 2025
- 2025HSNet: Heterogeneous Subgraph Network for Single Image Super-resolution8 Oct 2025
- 2025Pure-Pass: Fine-Grained, Adaptive Masking for Dynamic Token-Mixing Routing in Lightweight Image Super-Resolution2 Oct 2025
- 2025Texture Vector-Quantization and Reconstruction Aware Prediction for Generative Super-Resolution28 Sep 2025
- 2025VQualA 2025 Challenge on Image Super-Resolution Generated Content Quality Assessment: Methods and Results8 Sep 2025
- 2025Content-Aware Mamba for Learned Image Compression4 Aug 2025
- 2025Tackling Ill-posedness of Reversible Image Conversion with Well-posed Invertible Network4 Aug 2025
- 2025Towards Blind Bitstream-corrupted Video Recovery via a Visual Foundation Model-driven Framework30 Jul 2025
- 2025GPSMamba: A Global Phase and Spectral Prompt-guided Mamba for Infrared Image Super-Resolution25 Jul 2025
- 2025PromptSR: Cascade Prompting for Lightweight Image Super-Resolution5 Jul 2025
- 2025Structural Similarity-Inspired Unfolding for Lightweight Image Super-Resolution13 Jun 2025
- 2025RAW Image Reconstruction from RGB on Smartphones. NTIRE 2025 Challenge Report2 Jun 2025
- 2025Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularization24 May 2025
- 2025NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: KwaiSR Dataset and Study21 Apr 2025
- 2025NTIRE 2025 Challenge on Image Super-Resolution (x4): Methods and Results20 Apr 2025
- 2025Any Image Restoration via Efficient Spatial-Frequency Degradation Adaptation19 Apr 2025
- 2025DSwinIR: Rethinking Window-based Attention for Image Restoration7 Apr 2025
- 2025Learned Image Compression with Dictionary-based Entropy Model1 Apr 2025
- 2025Q-MambaIR: Accurate Quantized Mamba for Efficient Image Restoration27 Mar 2025
- 2025Consistency Trajectory Matching for One-Step Generative Super-Resolution26 Mar 2025
- 2025Progressive Focused Transformer for Single Image Super-Resolution26 Mar 2025
- 2025Uncertainty-guided Perturbation for Image Super-Resolution Diffusion Model24 Mar 2025
- 2025CATANet: Efficient Content-Aware Token Aggregation for Lightweight Image Super-Resolution10 Mar 2025
- 2025Emulating Self-attention with Convolution for Efficient Image Super-Resolution9 Mar 2025
- 2025Generalized and Efficient 2D Gaussian Splatting for Arbitrary-scale Super-Resolution12 Jan 2025
50 newest of 63 All 63 (JSON)
- 2024MambaIRv2: Attentive State Space Restorationcited by 90
- 2024Frequency-Assisted Mamba for Remote Sensing Image Super-Resolutioncited by 47
- 2024Hi-Mamba: Hierarchical Mamba for Efficient Image Super-Resolutioncited by 16
- 2024IRSRMamba: Infrared Image Super-Resolution via Mamba-based Wavelet Transform Feature Modulation Modelcited by 12
- 2025Content-Aware Mamba for Learned Image Compressioncited by 5
- 2025Q-MambaIR: Accurate Quantized Mamba for Efficient Image Restorationcited by 4
- 2025GPSMamba: A Global Phase and Spectral Prompt-guided Mamba for Infrared Image Super-Resolutioncited by 1
- 2025Content-Aware Mamba for Learned Image Compression4 Aug 2025
- 2025GPSMamba: A Global Phase and Spectral Prompt-guided Mamba for Infrared Image Super-Resolution25 Jul 2025
- 2025Q-MambaIR: Accurate Quantized Mamba for Efficient Image Restoration27 Mar 2025
- 2024MambaIRv2: Attentive State Space Restoration22 Nov 2024
- 2024Hi-Mamba: Hierarchical Mamba for Efficient Image Super-Resolution14 Oct 2024
- 2024IRSRMamba: Infrared Image Super-Resolution via Mamba-based Wavelet Transform Feature Modulation Model16 May 2024
- 2024Frequency-Assisted Mamba for Remote Sensing Image Super-Resolution8 May 2024
- 2025Uncertainty-guided Perturbation for Image Super-Resolution Diffusion Modelcited by 29
- 2024Generative AI in Vision: A Survey on Models, Metrics and Applicationscited by 4
- 2024ControlSR: Taming Diffusion Models for Consistent Real-World Image Super Resolutioncited by 3
- 2025DP2O-SR: Direct Perceptual Preference Optimization for Real-World Image Super-Resolutioncited by 2
- 2025OmniScaleSR: Unleashing Scale-Controlled Diffusion Prior for Faithful and Realistic Arbitrary-Scale Image Super-Resolutioncited by 1
- 2026Decoupling Cross-Modality Manifold Discrepancy: Leveraging Visible Diffusion Priors for Infrared Super-Resolutioncited by 0
- 2026Decoupling Cross-Modality Manifold Discrepancy: Leveraging Visible Diffusion Priors for Infrared Super-Resolution23 Jul 2026
- 2025OmniScaleSR: Unleashing Scale-Controlled Diffusion Prior for Faithful and Realistic Arbitrary-Scale Image Super-Resolution4 Dec 2025
- 2025DP2O-SR: Direct Perceptual Preference Optimization for Real-World Image Super-Resolution21 Oct 2025
- 2025Uncertainty-guided Perturbation for Image Super-Resolution Diffusion Model24 Mar 2025
- 2024ControlSR: Taming Diffusion Models for Consistent Real-World Image Super Resolution18 Oct 2024
- 2024Generative AI in Vision: A Survey on Models, Metrics and Applications26 Feb 2024
- 2025Learned Image Compression with Dictionary-based Entropy Modelcited by 29
- 2025Progressive Focused Transformer for Single Image Super-Resolutioncited by 25
- 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Groundingcited by 21
- 2025Generalized and Efficient 2D Gaussian Splatting for Arbitrary-scale Super-Resolutioncited by 21
- 2025CATANet: Efficient Content-Aware Token Aggregation for Lightweight Image Super-Resolutioncited by 15
- 2025Consistency Trajectory Matching for One-Step Generative Super-Resolutioncited by 15
- 2024Sharing Key Semantics in Transformer Makes Efficient Image Restorationcited by 14
- 2025NTIRE 2025 Challenge on Image Super-Resolution (x4): Methods and Resultscited by 12
- 2025NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: KwaiSR Dataset and Studycited by 11
- 2025Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularizationcited by 8
- 2025DSwinIR: Rethinking Window-based Attention for Image Restorationcited by 7
- 2025Emulating Self-attention with Convolution for Efficient Image Super-Resolutioncited by 5
12 most cited of 49 All 49 (JSON)
- 2026SFMformer: A Spatial-Frequency Modulation Transformer for Lightweight Image Super-Resolution18 Aug 2026
- 2026CUST: Clustered Unit-level Similarity Transformer for Lightweight Image Super-Resolution13 Jul 2026
- 2026Perceiving Better Moments: Cover Frame Reselection and Enhancement for Live Photos with the Live2K Dataset5 Jul 2026
- 2026Resonant Brane Splatting for Arbitrary-Scale Super-Resolution28 Jun 2026
- 2026Adaptive Densification for High-Fidelity and Efficient Sparse Gaussian Splatting in Arbitrary-Scale Super-Resolution28 Jun 2026
- 2026Linear Recurrent Unit with Semantic Modulation for Image Super-Resolution18 Jun 2026
- 2026FoA-SR: Faithful or Aesthetic? Profile-Aware Preference Optimization for Real-World Image Super-Resolution9 Jun 2026
- 2026SR-Ground: Image Quality Grounding for Super-Resolved Content20 May 2026
- 2026You Only Landmark Once: Lightweight U-Net Face Super Resolution with YOLO-World Landmark Heatmaps13 May 2026
- 2026OP4KSR: One-Step Patch-Free 4K Super-Resolution with Periodic Artifact Suppression13 May 2026
- 2026Beyond Visual Fidelity: Benchmarking Super-Resolution Models for Large-Scale Remote Sensing Imagery via Downstream Task Integration1 May 2026
- 2026Degradation-Robust Fusion: An Efficient Degradation-Aware Diffusion Framework for Multimodal Image Fusion in Arbitrary Degradation Scenarios10 Apr 2026
12 newest of 49 All 49 (JSON)