Learning Texture Transformer Network for Image Super-Resolution
Not on the map. Why?
Cited by 23 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We study on image super-resolution (SR), which aims to recover realistic textures from a low-resolution (LR) image. Recent progress has been made by taking high-resolution images as references (Ref), so that relevant textures can be transferred to LR images. However, existing SR approaches neglect to use attention mechanisms to transfer high-resolution (HR) textures from Ref images, which limits these approaches in challenging cases. In this paper, we propose a novel Texture Transformer Network for Image Super-Resolution (TTSR), in which the LR and Ref images are formulated as queries and keys in a transformer, respectively. TTSR consists of four closely-related modules optimized for image generation tasks, including a learnable texture extractor by DNN, a relevance embedding module, a hard-attention module for texture transfer, and a soft-attention module for texture synthesis. Such a design encourages joint feature learning across LR and Ref images, in which deep feature correspondences can be discovered by attention, and thus accurate texture features can be transferred. The proposed texture transformer can be further stacked in a cross-scale way, which enables texture recovery from different levels (e.g., from 1x to 4x magnification). Extensive experiments show that TTSR achieves significant improvements over state-of-the-art approaches on both quantitative and qualitative evaluations.
Key facts. Cited by 346 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 86; 2022: 89; 2023: 65; 2024: 48; 2025: 33; 2026: 25.
346 papers.
Sort:
By area:
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
- 2021Transformers in Vision: A Surveycited by 1,009
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 549
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
- 2021VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Textcited by 427
- 2021Remote Sensing Image Change Detection with Transformerscited by 305
- 2021TransVG: End-to-End Visual Grounding with Transformerscited by 269
- 2021Incorporating Convolution Designs into Visual Transformerscited by 248
38 more
- 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 225
- 2021Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encodingcited by 207
- 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
- 2021Chasing Sparsity in Vision Transformers: An End-to-End Explorationcited by 181
- 2021SPViT: Enabling Faster Vision Transformers via Soft Token Pruningcited by 165
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
- 2021Transformer for Single Image Super-Resolutioncited by 150
- 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstructioncited by 150
- 2021Efficient Self-supervised Vision Transformers for Representation Learningcited by 149
- 2021All Tokens Matter: Token Labeling for Training Better Vision Transformerscited by 144
- 2022Stripformer: Strip Transformer for Fast Image Deblurringcited by 139
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
- 2021End-to-End Dense Video Captioning with Parallel Decodingcited by 133
- 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 122
- 2021Video Super-Resolution Transformercited by 120
- 2023PromptIR: Prompting for All-in-One Blind Image Restorationcited by 113
- 2022Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priorscited by 98
- 2022M3ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-designcited by 97
- 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersamplingcited by 95
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
- 2022RestoreFormer: High-Quality Blind Face Restoration from Undegraded Key-Value Pairscited by 85
- 2022Accurate Image Restoration with Attention Retractable Transformercited by 85
- 2021MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-Resolutioncited by 79
- 2022Unified Visual Transformer Compressioncited by 79
- 2022High-resolution Iterative Feedback Network for Camouflaged Object Detectioncited by 78
- 2021Progressively Normalized Self-Attention Network for Video Polyp Segmentationcited by 75
- 2022Improving Vision Transformers by Revisiting High-frequency Componentscited by 75
- 2021M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformerscited by 74
- 2021HiFT: Hierarchical Feature Transformer for Aerial Trackingcited by 72
- 2022Any-resolution Training for High-resolution Image Synthesiscited by 72
- 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 72
- 2022Rethinking Alignment in Video Super-Resolution Transformerscited by 71
- 2021Robust Reference-based Super-Resolution via C2-Matchingcited by 68
- 2023CoSeR: Bridging Image and Language for Cognitive Super-Resolutioncited by 66
- 2022Learning Trajectory-Aware Transformer for Video Super-Resolutioncited by 61
- 2021Task Transformer Network for Joint MRI Reconstruction and Super-Resolutioncited by 58
- 2022Where in the World is this Image? Transformer-based Geo-localization in the Wildcited by 58
- 2024Zero-Reference Low-Light Enhancement via Physical Quadruple Priorscited by 58
50 most cited of 346 All 346 (JSON)
- 2026Beyond Lip Sync: Reference-Grounded Oral Refinement for Audio-Driven Portrait Animation29 Sep 2026
- 2026Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision28 Sep 2026
- 2026CEM-TUDASR: Computationally efficient multi-modality transformer based unsupervised domain adaptive super-resolution approach10 Sep 2026
- 2026UnCapsTSR: An Unsupervised Transformer-based Image Super-Resolution Approach for Capsule Endoscopy Images2 Sep 2026
- 2026GraftSR: Grafting Authentic Textures for Real-World Image Super-Resolution via Identical-Instance Guidance26 Aug 2026
- 2026Ultra-High-Definition Restoration Transformers with Correlation Matching Transformation18 Aug 2026
- 2026PixelSR: Efficient Screen Content Super-Resolution via Pixel Classification1 Aug 2026
- 2026MicroZoom: Structure-Preserving Detail Synthesis at Extreme Scale27 Jul 2026
- 2026Reference-Based Face Super-Resolution Using the Spatial Transformer13 Jul 2026
- 2026Perceiving Better Moments: Cover Frame Reselection and Enhancement for Live Photos with the Live2K Dataset5 Jul 2026
- 2026GarmentZoom: Generating Zoomable Images from Garment Listings28 Jun 2026
- 2026WaveDINO: Learning-Based Atmospheric Correction of Unwrapped InSAR Interferograms Validated by GNSS: Results at Laguna del Maule and Campi Flegrei Volcanoes15 Jun 2026
38 more
- 2026Learning to Balance: Decoupled Siamese Diffusion Transformer for Reference-Based Remote Sensing Image Super-Resolution18 May 2026
- 2026Leveraging Multimodal Large Language Models for All-in-One Image Restoration via a Mixture of Frequency Experts12 May 2026
- 2026Beyond Visual Fidelity: Benchmarking Super-Resolution Models for Large-Scale Remote Sensing Imagery via Downstream Task Integration1 May 2026
- 2026MetaSR: Content-Adaptive Metadata Orchestration for Generative Super-Resolution29 Apr 2026
- 2026Hierarchical Vision Transformer Enhanced by Graph Convolutional Network for Image Classification18 Apr 2026
- 2026LiveMoments: Reselected Key Photo Restoration in Live Photos via Reference-guided Diffusion14 Apr 2026
- 2026Language-Free Generative Editing from One Visual Example26 Mar 2026
- 2026BluRef: Unsupervised Image Deblurring with Dense-Matching References15 Mar 2026
- 2026All-in-One Image Restoration via Causal-Deconfounding Wavelet-Disentangled Prompt Network4 Mar 2026
- 2026Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modeling2 Feb 2026
- 2026REMAC: Reference-Based Martian Asymmetrical Image Compression26 Jan 2026
- 2026Multi-Image Super Resolution Framework for Detection and Analysis of Plant Roots9 Jan 2026
- 2026RefSR-Adv: Adversarial Attack on Reference-based Image Super-Resolution Models3 Jan 2026
- 2025Segmentation-Aware Latent Diffusion for Satellite Image Super-Resolution: Enabling Smallholder Farm Boundary Delineation18 Nov 2025
- 2025SRSplat: Feed-Forward Super-Resolution Gaussian Splatting from Sparse Multi-View Images15 Nov 2025
- 2025Exploring Object-Aware Attention Guided Frame Association for RGB-D SLAM30 Oct 2025
- 2025BrainPuzzle: Hybrid Physics and Data-Driven Reconstruction for Transcranial Ultrasound Tomography22 Oct 2025
- 2025CharDiff-LP: A Diffusion Model with Character-Level Guidance for License Plate Image Restoration20 Oct 2025
- 20253D Reconstruction from Transient Measurements with Time-Resolved Transformer10 Oct 2025
- 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospects19 Sep 2025
- 2025Images in Motion?: A First Look into Video Leakage in Collaborative Deep Learning11 Sep 2025
- 2025ISALux: Illumination and Segmentation Aware Transformer Employing Mixture of Experts for Low Light Image Enhancement25 Aug 2025
- 2025Ultra-High-Definition Reference-Based Landmark Image Super-Resolution with Generative Diffusion Prior14 Aug 2025
- 2025RASR: Retrieval-Augmented Super Resolution for Practical Reference-based Image Restoration13 Aug 2025
- 2025ModalFormer: Multimodal Transformer for Low-Light Image Enhancement27 Jul 2025
- 2025Blind Super Resolution with Reference Images and Implicit Degradation Representation18 Jul 2025
- 2025Controllable Reference Guided Diffusion with Local Global Fusion for Real World Remote Sensing Image Super Resolution30 Jun 2025
- 2025TDiR: Transformer based Diffusion for Image Restoration Tasks25 Jun 2025
- 2025PR-DETR: Injecting Position and Relation Prior for Dense Video Captioning19 Jun 2025
- 2025Structural Similarity-Inspired Unfolding for Lightweight Image Super-Resolution13 Jun 2025
- 2025MambaVSR: Content-Aware Scanning State Space Model for Video Super-Resolution13 Jun 2025
- 2025DM3Net: Dual-Camera Super-Resolution via Domain Modulation and Multi-scale Matching8 Jun 2025
- 2025PAN-Crafter: Learning Modality-Consistent Alignment for PAN-Sharpening29 May 2025
- 2025Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularization24 May 2025
- 2025BadSR: Stealthy Label Backdoor Attacks on Image Super-Resolution21 May 2025
- 2025Degradation-Aware Feature Perturbation for All-in-One Image Restoration19 May 2025
- 2025Any Image Restoration via Efficient Spatial-Frequency Degradation Adaptation19 Apr 2025
- 2025TTRD3: Texture Transfer Residual Denoising Dual Diffusion Model for Remote Sensing Image Super-Resolution17 Apr 2025
50 newest of 346 All 346 (JSON)
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
- 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generationcited by 225
- 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstructioncited by 150
- 2023WaveDM: Wavelet-Based Diffusion Models for Image Restorationcited by 46
- 2024Building Bridges across Spatial and Temporal Resolutions: Reference-Based Super-Resolution via Change Priors and Conditional Diffusion Modelcited by 20
- 2024PiRD: Physics-informed Residual Diffusion for Flow Field Reconstructioncited by 10
- 2023Learning Profitable NFT Image Diffusions via Multiple Visual-Policy Guided Reinforcement Learningcited by 7
- 2024Diffusion-Promoted HDR Video Reconstructioncited by 6
- 2024Mamba-ST: State Space Model for Efficient Style Transfercited by 5
- 2024Latent Diffusion, Implicit Amplification: Efficient Continuous-Scale Super-Resolution for Remote Sensing Imagescited by 5
- 2026Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modelingcited by 5
- 2024Training-Free Large Model Priors for Multiple-in-One Image Restorationcited by 4
12 most cited of 23 All 23 (JSON)
- 2026Learning to Balance: Decoupled Siamese Diffusion Transformer for Reference-Based Remote Sensing Image Super-Resolution18 May 2026
- 2026LiveMoments: Reselected Key Photo Restoration in Live Photos via Reference-guided Diffusion14 Apr 2026
- 2026Language-Free Generative Editing from One Visual Example26 Mar 2026
- 2026Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modeling2 Feb 2026
- 2025Segmentation-Aware Latent Diffusion for Satellite Image Super-Resolution: Enabling Smallholder Farm Boundary Delineation18 Nov 2025
- 2025CharDiff-LP: A Diffusion Model with Character-Level Guidance for License Plate Image Restoration20 Oct 2025
- 2025Ultra-High-Definition Reference-Based Landmark Image Super-Resolution with Generative Diffusion Prior14 Aug 2025
- 2025Controllable Reference Guided Diffusion with Local Global Fusion for Real World Remote Sensing Image Super Resolution30 Jun 2025
- 2025TDiR: Transformer based Diffusion for Image Restoration Tasks25 Jun 2025
- 2025TTRD3: Texture Transfer Residual Denoising Dual Diffusion Model for Remote Sensing Image Super-Resolution17 Apr 2025
- 2024Consistent Diffusion: Denoising Diffusion Model with Data-Consistent Training for Image Restoration17 Dec 2024
- 2024Latent Diffusion, Implicit Amplification: Efficient Continuous-Scale Super-Resolution for Remote Sensing Images30 Oct 2024
12 newest of 23 All 23 (JSON)
- 2022M3ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-designcited by 97
- 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 72
- 2025Structural Similarity-Inspired Unfolding for Lightweight Image Super-Resolutioncited by 1
- 2025ISALux: Illumination and Segmentation Aware Transformer Employing Mixture of Experts for Low Light Image Enhancementcited by 0
- 2025ISALux: Illumination and Segmentation Aware Transformer Employing Mixture of Experts for Low Light Image Enhancement25 Aug 2025
- 2025Structural Similarity-Inspired Unfolding for Lightweight Image Super-Resolution13 Jun 2025
- 2024Complexity Experts are Task-Discriminative Learners for Any Image Restoration27 Nov 2024
- 2022M3ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design26 Oct 2022
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
- 2021Transformers in Vision: A Surveycited by 1,009
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 549
- 2021VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Textcited by 427
- 2021Remote Sensing Image Change Detection with Transformerscited by 305
- 2021TransVG: End-to-End Visual Grounding with Transformerscited by 269
- 2021Incorporating Convolution Designs into Visual Transformerscited by 248
- 2021Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encodingcited by 207
12 most cited of 314 All 314 (JSON)
- 2026Beyond Lip Sync: Reference-Grounded Oral Refinement for Audio-Driven Portrait Animation29 Sep 2026
- 2026Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision28 Sep 2026
- 2026CEM-TUDASR: Computationally efficient multi-modality transformer based unsupervised domain adaptive super-resolution approach10 Sep 2026
- 2026UnCapsTSR: An Unsupervised Transformer-based Image Super-Resolution Approach for Capsule Endoscopy Images2 Sep 2026
- 2026GraftSR: Grafting Authentic Textures for Real-World Image Super-Resolution via Identical-Instance Guidance26 Aug 2026
- 2026Ultra-High-Definition Restoration Transformers with Correlation Matching Transformation18 Aug 2026
- 2026PixelSR: Efficient Screen Content Super-Resolution via Pixel Classification1 Aug 2026
- 2026MicroZoom: Structure-Preserving Detail Synthesis at Extreme Scale27 Jul 2026
- 2026Reference-Based Face Super-Resolution Using the Spatial Transformer13 Jul 2026
- 2026Perceiving Better Moments: Cover Frame Reselection and Enhancement for Live Photos with the Live2K Dataset5 Jul 2026
- 2026GarmentZoom: Generating Zoomable Images from Garment Listings28 Jun 2026
- 2026WaveDINO: Learning-Based Atmospheric Correction of Unwrapped InSAR Interferograms Validated by GNSS: Results at Laguna del Maule and Campi Flegrei Volcanoes15 Jun 2026
12 newest of 314 All 314 (JSON)