HST: Hierarchical Swin Transformer for Compressed Image Super-resolution
Not on the map. Why?
Abstract (arXiv)
Compressed Image Super-resolution has achieved great attention in recent years, where images are degraded with compression artifacts and low-resolution artifacts. Since the complex hybrid distortions, it is hard to restore the distorted image with the simple cooperation of super-resolution and compression artifacts removing. In this paper, we take a step forward to propose the Hierarchical Swin Transformer (HST) network to restore the low-resolution compressed image, which jointly captures the hierarchical feature representations and enhances each-scale representation with Swin transformer, respectively. Moreover, we find that the pretraining with Super-resolution (SR) task is vital in compressed image super-resolution. To explore the effects of different SR pretraining, we take the commonly-used SR tasks (e.g., bicubic and different real super-resolution simulations) as our pretraining tasks, and reveal that SR plays an irreplaceable role in the compressed image super-resolution. With the cooperation of HST and pre-training, our HST achieves the fifth place in AIM 2022 challenge on the low-quality compressed image super-resolution track, with the PSNR of 23.51dB. Extensive experiments and ablation studies have validated the effectiveness of our proposed methods. The code and models are available at https://github.com/USTC-IMCL/HST-for-Compressed-Image-SR.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 41 of its 60 references that are in the map. First posted on arXiv 21 Aug 2022.
Builds on
41 of 60 references.
References · 41
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2020Pre-Trained Image Processing Transformercited by 893
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
- 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 329
29 more
- 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 246
- 2018The relativistic discriminator: a key element missing from standard GANcited by 238
- 2019Blind Super-Resolution With Iterative Kernel Correctioncited by 203
- 2021Unsupervised Degradation Representation Learning for Blind Super-Resolutioncited by 177
- 2019Blind Super-Resolution Kernel Estimation using an Internal-GANcited by 175
- 2019Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolutioncited by 140
- 2015Compression Artifacts Reduction by a Deep Convolutional Networkcited by 136
- 2021Flow-based Kernel Prior with Application to Blind Super-Resolutioncited by 74
- 2019Multi-level Wavelet Convolutional Neural Networkscited by 59
- 2022Deep Constrained Least Squares for Blind Image Super-Resolutioncited by 47
- 2016CAS-CNN: A Deep Convolutional Neural Network for Image Compression Artifact Suppressioncited by 33
- 2020Learned Block-based Hybrid Image Compressioncited by 30
- 2021COMISR: Compression-Informed Video Super-Resolutioncited by 26
- 2021Task-driven Semantic Coding via Reinforcement Learningcited by 25
- 2022AnimeSR: Learning Real-World Super-Resolution Models for Animation Videoscited by 23
- 2016D3: Deep Dual-Domain Based Fast Restoration of JPEG-Compressed Imagescited by 22
- 2020Learning Disentangled Feature Representation for Hybrid-distorted Image Restorationcited by 21
- 2018DMCNN: Dual-Domain Multi-Scale Convolutional Neural Network for Compression Artifacts Removalcited by 20
- 2020AIM 2020 Challenge on Real Image Super-Resolution: Methods and Resultscited by 17
- 2020LIRA: Lifelong Image Restoration from Unknown Blended Distortionscited by 15
- 2020Learning Omni-frequency Region-adaptive Representations for Real Image Super-Resolutioncited by 15
- 2022SwinIQA: Learned Swin Distance for Compressed Image Quality Assessmentcited by 14
- 2016Compression Artifacts Removal Using Convolutional Neural Networkscited by 13
- 2020Multi-scale Grouped Dense Network for VVC Intra Codingcited by 10
- 2020FAN: Frequency Aggregation Network for Real Image Super-resolutioncited by 10
- 2021Feature Statistics Mixing Regularization for Generative Adversarial Networkscited by 9
- 2022RTN: Reinforced Transformer Network for Coronary CT Angiography Vessel-level Image Quality Assessmentcited by 8
- 2022Progressive Training of A Two-Stage Framework for Video Restorationcited by 7
Built on by
Citing papers per year: 2022: 3; 2023: 4; 2024: 8; 2025: 4; 2026: 1.
20 papers.
Sort:
By area:
- 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 109
- 2024SeD: Semantic-Aware Discriminator for Image Super-Resolutioncited by 26
- 2025NTIRE 2025 Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Resultscited by 22
- 2022AIM 2022 Challenge on Super-Resolution of Compressed Image and Video: Dataset, Methods and Resultscited by 20
- 2024PromptCIR: Blind Compressed Image Restoration with Prompt Learningcited by 20
- 2023Learning Distortion Invariant Representation for Image Restoration from A Causality Perspectivecited by 17
- 2024MambaCSR: Dual-Interleaved Scanning for Compressed Image Super-Resolution With SSMscited by 14
- 2025NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: Methods and Resultscited by 14
- 2026NTIRE 2026 The Second Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Resultscited by 14
- 2024CFAT: Unleashing TriangularWindows for Image Super-resolutioncited by 11
- 2024A Review of Transformer-Based Models for Computer Vision Tasks: Capturing Global Context and Spatial Relationshipscited by 11
- 2025NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: KwaiSR Dataset and Studycited by 11
8 more
- 2024UCIP: A Universal Framework for Compressed Image Super-Resolution using Dynamic Promptcited by 8
- 2024JDEC: JPEG Decoding via Enhanced Continuous Cosine Coefficientscited by 7
- 2024Event Camera Demosaicing via Swin Transformer and Pixel-focus Losscited by 3
- 2022Semantic-aware Message Broadcasting for Efficient Unsupervised Domain Adaptationcited by 2
- 2023SAMPLING: Scene-adaptive Hierarchical Multiplane Images Representation for Novel View Synthesis from a Single Imagecited by 2
- 2022Learned Lossless JPEG Transcoding via Joint Lossy and Residual Compressioncited by 0
- 2023Revolutionizing Space Health (Swin-FSR): Advancing Super-Resolution of Fundus Images for SANS Visual Assessment Technologycited by 0
- 2025BrainPuzzle: Hybrid Physics and Data-Driven Reconstruction for Transcranial Ultrasound Tomographycited by 0
- 2026NTIRE 2026 The Second Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Results12 Apr 2026
- 2025BrainPuzzle: Hybrid Physics and Data-Driven Reconstruction for Transcranial Ultrasound Tomography22 Oct 2025
- 2025NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: KwaiSR Dataset and Study21 Apr 2025
- 2025NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: Methods and Results17 Apr 2025
- 2025NTIRE 2025 Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Results17 Apr 2025
- 2024A Review of Transformer-Based Models for Computer Vision Tasks: Capturing Global Context and Spatial Relationships27 Aug 2024
- 2024MambaCSR: Dual-Interleaved Scanning for Compressed Image Super-Resolution With SSMs21 Aug 2024
- 2024UCIP: A Universal Framework for Compressed Image Super-Resolution using Dynamic Prompt18 Jul 2024
- 2024PromptCIR: Blind Compressed Image Restoration with Prompt Learning26 Apr 2024
- 2024JDEC: JPEG Decoding via Enhanced Continuous Cosine Coefficients3 Apr 2024
- 2024Event Camera Demosaicing via Swin Transformer and Pixel-focus Loss3 Apr 2024
- 2024CFAT: Unleashing TriangularWindows for Image Super-resolution24 Mar 2024
8 more
- 2024SeD: Semantic-Aware Discriminator for Image Super-Resolution29 Feb 2024
- 2023SAMPLING: Scene-adaptive Hierarchical Multiplane Images Representation for Novel View Synthesis from a Single Image12 Sep 2023
- 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Survey18 Aug 2023
- 2023Revolutionizing Space Health (Swin-FSR): Advancing Super-Resolution of Fundus Images for SANS Visual Assessment Technology11 Aug 2023
- 2023Learning Distortion Invariant Representation for Image Restoration from A Causality Perspective13 Mar 2023
- 2022Semantic-aware Message Broadcasting for Efficient Unsupervised Domain Adaptation6 Dec 2022
- 2022Learned Lossless JPEG Transcoding via Joint Lossy and Residual Compression24 Aug 2022
- 2022AIM 2022 Challenge on Super-Resolution of Compressed Image and Video: Dataset, Methods and Results23 Aug 2022
- 2024SeD: Semantic-Aware Discriminator for Image Super-Resolutioncited by 26
- 2025NTIRE 2025 Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Resultscited by 22
- 2022AIM 2022 Challenge on Super-Resolution of Compressed Image and Video: Dataset, Methods and Resultscited by 20
- 2024PromptCIR: Blind Compressed Image Restoration with Prompt Learningcited by 20
- 2023Learning Distortion Invariant Representation for Image Restoration from A Causality Perspectivecited by 17
- 2025NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: Methods and Resultscited by 14
- 2026NTIRE 2026 The Second Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Resultscited by 14
- 2024CFAT: Unleashing TriangularWindows for Image Super-resolutioncited by 11
- 2024A Review of Transformer-Based Models for Computer Vision Tasks: Capturing Global Context and Spatial Relationshipscited by 11
- 2025NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: KwaiSR Dataset and Studycited by 11
- 2024UCIP: A Universal Framework for Compressed Image Super-Resolution using Dynamic Promptcited by 8
- 2024JDEC: JPEG Decoding via Enhanced Continuous Cosine Coefficientscited by 7
12 most cited of 18 All 18 (JSON)
- 2026NTIRE 2026 The Second Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Results12 Apr 2026
- 2025BrainPuzzle: Hybrid Physics and Data-Driven Reconstruction for Transcranial Ultrasound Tomography22 Oct 2025
- 2025NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: KwaiSR Dataset and Study21 Apr 2025
- 2025NTIRE 2025 Challenge on Short-form UGC Video Quality Assessment and Enhancement: Methods and Results17 Apr 2025
- 2025NTIRE 2025 Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Results17 Apr 2025
- 2024A Review of Transformer-Based Models for Computer Vision Tasks: Capturing Global Context and Spatial Relationships27 Aug 2024
- 2024UCIP: A Universal Framework for Compressed Image Super-Resolution using Dynamic Prompt18 Jul 2024
- 2024PromptCIR: Blind Compressed Image Restoration with Prompt Learning26 Apr 2024
- 2024JDEC: JPEG Decoding via Enhanced Continuous Cosine Coefficients3 Apr 2024
- 2024Event Camera Demosaicing via Swin Transformer and Pixel-focus Loss3 Apr 2024
- 2024CFAT: Unleashing TriangularWindows for Image Super-resolution24 Mar 2024
- 2024SeD: Semantic-Aware Discriminator for Image Super-Resolution29 Feb 2024
12 newest of 18 All 18 (JSON)