mlsanityData to 7 Oct 2026

Pairwise Distance Distillation for Unsupervised Real-World Image Super-Resolution

arXiv 2407.07302 ↗First posted 10 Jul 2024eess.IV cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Standard single-image super-resolution creates paired training data from high-resolution images through fixed downsampling kernels. However, real-world super-resolution (RWSR) faces unknown degradations in the low-resolution inputs, all the while lacking paired training data. Existing methods approach this problem by learning blind general models through complex synthetic augmentations on training inputs; they sacrifice the performance on specific degradation for broader generalization to many possible ones. We address the unsupervised RWSR for a targeted real-world degradation. We study from a distillation perspective and introduce a novel pairwise distance distillation framework. Through our framework, a model specialized in synthetic degradation adapts to target real-world degradations by distilling intra- and inter-model distances across the specialized model and an auxiliary generalized model. Experiments on diverse datasets demonstrate that our method significantly enhances fidelity and perceptual quality, surpassing state-of-the-art approaches in RWSR. The source code is available at https://github.com/Yuehan717/PDD.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 37 of its 50 references that are in the map. First posted on arXiv 10 Jul 2024.

Builds on

37 of 50 references.

References · 37

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  6. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  7. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  8. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  9. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  10. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  11. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
  12. 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
25 more
  1. 2019Blind Super-Resolution With Iterative Kernel Correctioncited by 203
  2. 2017Demystifying Neural Style Transfercited by 152
  3. 2016Learning a No-Reference Quality Metric for Single-Image Super-Resolutioncited by 143
  4. 2020Unfolding the Alternating Optimization for Blind Super Resolutioncited by 129
  5. 2020Structure-Preserving Super Resolution with Gradient Guidancecited by 116
  6. 2019Frequency Separation for Real-World Super-Resolutioncited by 115
  7. 2022Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priorscited by 98
  8. 2022Efficient and Degradation-Adaptive Network for Real-World Image Super-Resolutioncited by 96
  9. 2020Unsupervised Real-world Image Super Resolution via Domain-distance Aware Trainingcited by 83
  10. 2020NTIRE 2020 Challenge on Real-World Image Super-Resolution: Methods and Resultscited by 83
  11. 2021Adaptive Multi-Teacher Multi-level Knowledge Distillationcited by 69
  12. 2023Omni Aggregation Networks for Lightweight Image Super-Resolutioncited by 62
  13. 2020Unsupervised Multi-Target Domain Adaptation Through Knowledge Distillationcited by 46
  14. 2022Cross-Domain Correlation Distillation for Unsupervised Domain Adaptation in Nighttime Semantic Segmentationcited by 40
  15. 2019Wavelet Domain Style Transfer for an Effective Perception-distortion Tradeoff in Single Image Super-Resolutioncited by 30
  16. 2018Joint Sub-bands Learning with Clique Structures for Wavelet Domain Super-Resolutioncited by 24
  17. 2022Cross-Task Knowledge Distillation in Multi-Task Recommendationcited by 22
  18. 2022Perception-Oriented Single Image Super-Resolution using Optimal Objective Estimationcited by 21
  19. 2023Crafting Training Degradation Distribution for the Accuracy-Generalization Trade-off in Real-World Super-Resolutioncited by 21
  20. 2021Discovering Distinctive "Semantics" in Super-Resolution Networkscited by 20
  21. 2022Perception-Distortion Balanced ADMM Optimization for Single-Image Super-Resolutioncited by 19
  22. 2022Evaluating the Generalization Ability of Super-Resolution Networkscited by 18
  23. 2019Go From the General to the Particular: Multi-Domain Translation with Domain Transformation Networkscited by 12
  24. 2021Local-Selective Feature Distillation for Single Image Super-Resolutioncited by 4
  25. 2023Tunable Convolutions with Parametric Multi-Loss Optimizationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 1.

2 papers.