Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning
Not on the map. Why?
Abstract (arXiv)
For image super-resolution (SR), bridging the gap between the performance on synthetic datasets and real-world degradation scenarios remains a challenge. This work introduces a novel "Low-Res Leads the Way" (LWay) training framework, merging Supervised Pre-training with Self-supervised Learning to enhance the adaptability of SR models to real-world images. Our approach utilizes a low-resolution (LR) reconstruction network to extract degradation embeddings from LR images, merging them with super-resolved outputs for LR reconstruction. Leveraging unseen LR images for self-supervised learning guides the model to adapt its modeling space to the target domain, facilitating fine-tuning of SR models without requiring paired high-resolution (HR) images. The integration of Discrete Wavelet Transform (DWT) further refines the focus on high-frequency details. Extensive evaluations show that our method significantly improves the generalization and detail restoration capabilities of SR models on unseen real-world datasets, outperforming existing methods. Our training regime is universally compatible, requiring no network architecture modifications, making it a practical solution for real-world SR applications.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 49 of its 59 references that are in the map. First posted on arXiv 5 Mar 2024.
Builds on
49 of 59 references.
References · 49
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2017Deep Image Priorcited by 1,097
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
37 more
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
- 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
- 2017"Zero-Shot" Super-Resolution using Deep Internal Learningcited by 285
- 2018Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Networkcited by 263
- 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Priorcited by 255
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
- 2019Residual Non-local Attention Networks for Image Restorationcited by 236
- 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 177
- 2019Blind Super-Resolution Kernel Estimation using an Internal-GANcited by 175
- 2018Unsupervised Image Super-Resolution using Cycle-in-Cycle Generative Adversarial Networkscited by 133
- 2023Dual Aggregation Transformer for Image Super-Resolutioncited by 124
- 2020Meta-Transfer Learning for Zero-Shot Super-Resolutioncited by 116
- 2019Frequency Separation for Real-World Super-Resolutioncited by 115
- 2022Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priorscited by 98
- 2022Efficient and Degradation-Adaptive Network for Real-World Image Super-Resolutioncited by 96
- 2018To learn image super-resolution, use a GAN to learn how to do image degradation firstcited by 94
- 2021Blind Image Super-Resolution: A Survey and Beyondcited by 93
- 2021LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyondcited by 88
- 2020Unsupervised Real-world Image Super Resolution via Domain-distance Aware Trainingcited by 83
- 2020Unpaired Image Super-Resolution using Pseudo-Supervisioncited by 67
- 2023CoSeR: Bridging Image and Language for Cognitive Super-Resolutioncited by 66
- 2021On Efficient Transformer-Based Image Pre-training for Low-Level Visioncited by 64
- 2023Masked Image Training for Generalizable Deep Image Denoisingcited by 57
- 2022Blueprint Separable Residual Network for Efficient Image Super-Resolutioncited by 44
- 2021Best-Buddy GANs for Highly Detailed Image Super-Resolutioncited by 30
- 2023Recursive Generalization Transformer for Image Super-Resolutioncited by 28
- 2020Image Quality Assessment for Perceptual Image Restoration: A New Dataset, Benchmark and Metriccited by 26
- 2023Crafting Training Degradation Distribution for the Accuracy-Generalization Trade-off in Real-World Super-Resolutioncited by 21
- 2021Attention in Attention Network for Image Super-Resolutioncited by 20
- 2022Self-Calibrated Efficient Transformer for Lightweight Super-Resolutioncited by 20
- 2022Efficient Image Super-Resolution using Vast-Receptive-Field Attentioncited by 16
- 2019Enforcing Perceptual Consistency on Generative Adversarial Networks by Using the Normalised Laplacian Pyramid Distancecited by 6
- 2023ICF-SRSR: Invertible scale-Conditional Function for Self-Supervised Real-world Single Image Super-Resolutioncited by 4
Built on by
Citing papers per year: 2024: 7; 2025: 9; 2026: 3.
19 papers.
Sort:
By area:
- 2024Towards Realistic Data Generation for Real-World Super-Resolutioncited by 56
- 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 41
- 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 41
- 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
- 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 32
- 2024Beyond Pixels: Text Enhances Generalization in Real-World Image Restorationcited by 17
- 2025The Power of Context: How Multimodality Improves Image Super-Resolutioncited by 15
- 2025Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesiscited by 13
- 2025PocketSR: The Super-Resolution Expert in Your Pocket Mobilescited by 8
- 2025Hallucination Score: Towards Mitigating Hallucinations in Generative Image Super-Resolutioncited by 5
- 2025Revisiting the Generalization Problem of Low-level Vision Models Through the Lens of Image Derainingcited by 4
- 2025Position: Agentic Systems Constitute a Key Component of Next-Generation Intelligent Image Processingcited by 3
7 more
- 2024FashionR2R: Texture-preserving Rendered-to-Real Image Translation with Diffusion Modelscited by 1
- 2024High-Resolution Be Aware! Improving the Self-Supervised Real-World Super-Resolutioncited by 0
- 2024Image Quality Assessment: Enhancing Perceptual Exploration and Interpretation with Collaborative Feature Refinement and Hausdorff distancecited by 0
- 2025Computational TIRF enables optical sectioning beyond the evanescent field for widefield fluorescence microscopycited by 0
- 2026Enhanced Self-Supervised Multi-Image Super-Resolution for Camera Array Imagescited by 0
- 2026D2R2OSR: Degradation-Disentangled Representation for Real-World Omnidirectional Image Super-Resolutioncited by 0
- 2026HazeSpikeMamba: Coupling Spiking-Inspired and State-Space Features for Self-Supervised Real-World Dehazingcited by 0
- 2026HazeSpikeMamba: Coupling Spiking-Inspired and State-Space Features for Self-Supervised Real-World Dehazing7 Aug 2026
- 2026D2R2OSR: Degradation-Disentangled Representation for Real-World Omnidirectional Image Super-Resolution28 Jun 2026
- 2026Enhanced Self-Supervised Multi-Image Super-Resolution for Camera Array Images8 Apr 2026
- 2025Computational TIRF enables optical sectioning beyond the evanescent field for widefield fluorescence microscopy10 Nov 2025
- 2025PocketSR: The Super-Resolution Expert in Your Pocket Mobiles3 Oct 2025
- 2025Hallucination Score: Towards Mitigating Hallucinations in Generative Image Super-Resolution18 Jul 2025
- 2025Position: Agentic Systems Constitute a Key Component of Next-Generation Intelligent Image Processing21 May 2025
- 2025Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesis20 Apr 2025
- 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restoration5 Apr 2025
- 2025POSTA: A Go-to Framework for Customized Artistic Poster Generation19 Mar 2025
- 2025The Power of Context: How Multimodality Improves Image Super-Resolution18 Mar 2025
- 2025Revisiting the Generalization Problem of Low-level Vision Models Through the Lens of Image Deraining18 Feb 2025
7 more
- 2024Image Quality Assessment: Enhancing Perceptual Exploration and Interpretation with Collaborative Feature Refinement and Hausdorff distance20 Dec 2024
- 2024Beyond Pixels: Text Enhances Generalization in Real-World Image Restoration1 Dec 2024
- 2024High-Resolution Be Aware! Improving the Self-Supervised Real-World Super-Resolution25 Nov 2024
- 2024An Intelligent Agentic System for Complex Image Restoration Problems23 Oct 2024
- 2024FashionR2R: Texture-preserving Rendered-to-Real Image Translation with Diffusion Models18 Oct 2024
- 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models25 Jul 2024
- 2024Towards Realistic Data Generation for Real-World Super-Resolution11 Jun 2024
- 2024Towards Realistic Data Generation for Real-World Super-Resolutioncited by 56
- 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
- 2024Beyond Pixels: Text Enhances Generalization in Real-World Image Restorationcited by 17
- 2025The Power of Context: How Multimodality Improves Image Super-Resolutioncited by 15
- 2025Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesiscited by 13
- 2025PocketSR: The Super-Resolution Expert in Your Pocket Mobilescited by 8
- 2025Hallucination Score: Towards Mitigating Hallucinations in Generative Image Super-Resolutioncited by 5
- 2025Revisiting the Generalization Problem of Low-level Vision Models Through the Lens of Image Derainingcited by 4
- 2024High-Resolution Be Aware! Improving the Self-Supervised Real-World Super-Resolutioncited by 0
- 2024Image Quality Assessment: Enhancing Perceptual Exploration and Interpretation with Collaborative Feature Refinement and Hausdorff distancecited by 0
- 2025Computational TIRF enables optical sectioning beyond the evanescent field for widefield fluorescence microscopycited by 0
- 2026Enhanced Self-Supervised Multi-Image Super-Resolution for Camera Array Imagescited by 0
12 most cited of 14 All 14 (JSON)
- 2026HazeSpikeMamba: Coupling Spiking-Inspired and State-Space Features for Self-Supervised Real-World Dehazing7 Aug 2026
- 2026D2R2OSR: Degradation-Disentangled Representation for Real-World Omnidirectional Image Super-Resolution28 Jun 2026
- 2026Enhanced Self-Supervised Multi-Image Super-Resolution for Camera Array Images8 Apr 2026
- 2025Computational TIRF enables optical sectioning beyond the evanescent field for widefield fluorescence microscopy10 Nov 2025
- 2025PocketSR: The Super-Resolution Expert in Your Pocket Mobiles3 Oct 2025
- 2025Hallucination Score: Towards Mitigating Hallucinations in Generative Image Super-Resolution18 Jul 2025
- 2025Turbo2K: Towards Ultra-Efficient and High-Quality 2K Video Synthesis20 Apr 2025
- 2025POSTA: A Go-to Framework for Customized Artistic Poster Generation19 Mar 2025
- 2025The Power of Context: How Multimodality Improves Image Super-Resolution18 Mar 2025
- 2025Revisiting the Generalization Problem of Low-level Vision Models Through the Lens of Image Deraining18 Feb 2025
- 2024Image Quality Assessment: Enhancing Perceptual Exploration and Interpretation with Collaborative Feature Refinement and Hausdorff distance20 Dec 2024
- 2024Beyond Pixels: Text Enhances Generalization in Real-World Image Restoration1 Dec 2024
12 newest of 14 All 14 (JSON)