Pairwise Distance Distillation for Unsupervised Real-World Image Super-Resolution
Not on the map. Why?
Abstract (arXiv)
Standard single-image super-resolution creates paired training data from high-resolution images through fixed downsampling kernels. However, real-world super-resolution (RWSR) faces unknown degradations in the low-resolution inputs, all the while lacking paired training data. Existing methods approach this problem by learning blind general models through complex synthetic augmentations on training inputs; they sacrifice the performance on specific degradation for broader generalization to many possible ones. We address the unsupervised RWSR for a targeted real-world degradation. We study from a distillation perspective and introduce a novel pairwise distance distillation framework. Through our framework, a model specialized in synthetic degradation adapts to target real-world degradations by distilling intra- and inter-model distances across the specialized model and an auxiliary generalized model. Experiments on diverse datasets demonstrate that our method significantly enhances fidelity and perceptual quality, surpassing state-of-the-art approaches in RWSR. The source code is available at https://github.com/Yuehan717/PDD.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 37 of its 50 references that are in the map. First posted on arXiv 10 Jul 2024.
Builds on
37 of 50 references.
References · 37
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
25 more
- 2019Blind Super-Resolution With Iterative Kernel Correctioncited by 203
- 2017Demystifying Neural Style Transfercited by 152
- 2016Learning a No-Reference Quality Metric for Single-Image Super-Resolutioncited by 143
- 2020Unfolding the Alternating Optimization for Blind Super Resolutioncited by 129
- 2020Structure-Preserving Super Resolution with Gradient Guidancecited by 116
- 2019Frequency Separation for Real-World Super-Resolutioncited by 115
- 2022Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priorscited by 98
- 2022Efficient and Degradation-Adaptive Network for Real-World Image Super-Resolutioncited by 96
- 2020Unsupervised Real-world Image Super Resolution via Domain-distance Aware Trainingcited by 83
- 2020NTIRE 2020 Challenge on Real-World Image Super-Resolution: Methods and Resultscited by 83
- 2021Adaptive Multi-Teacher Multi-level Knowledge Distillationcited by 69
- 2023Omni Aggregation Networks for Lightweight Image Super-Resolutioncited by 62
- 2020Unsupervised Multi-Target Domain Adaptation Through Knowledge Distillationcited by 46
- 2022Cross-Domain Correlation Distillation for Unsupervised Domain Adaptation in Nighttime Semantic Segmentationcited by 40
- 2019Wavelet Domain Style Transfer for an Effective Perception-distortion Tradeoff in Single Image Super-Resolutioncited by 30
- 2018Joint Sub-bands Learning with Clique Structures for Wavelet Domain Super-Resolutioncited by 24
- 2022Cross-Task Knowledge Distillation in Multi-Task Recommendationcited by 22
- 2022Perception-Oriented Single Image Super-Resolution using Optimal Objective Estimationcited by 21
- 2023Crafting Training Degradation Distribution for the Accuracy-Generalization Trade-off in Real-World Super-Resolutioncited by 21
- 2021Discovering Distinctive "Semantics" in Super-Resolution Networkscited by 20
- 2022Perception-Distortion Balanced ADMM Optimization for Single-Image Super-Resolutioncited by 19
- 2022Evaluating the Generalization Ability of Super-Resolution Networkscited by 18
- 2019Go From the General to the Particular: Multi-Domain Translation with Domain Transformation Networkscited by 12
- 2021Local-Selective Feature Distillation for Single Image Super-Resolutioncited by 4
- 2023Tunable Convolutions with Parametric Multi-Loss Optimizationcited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 1.
2 papers.