# Unpaired Image Super-Resolution using Pseudo-Supervision

arXiv: https://arxiv.org/abs/2002.11397 · HTML: https://mlsanity.com/paper/2002.11397/

## Key facts

- Cited by 67 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 26 Feb 2020.

## Built on by (most cited first, 30 of 67)

- [Exploiting Diffusion Prior for Real-World Image Super-Resolution](https://mlsanity.com/paper/2305.07015/) (2023)
- [Investigating Tradeoffs in Real-World Video Super-Resolution](https://mlsanity.com/paper/2111.12704/) (2021)
- [Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priors](https://mlsanity.com/paper/2202.13142/) (2022)
- [Efficient and Degradation-Adaptive Network for Real-World Image Super-Resolution](https://mlsanity.com/paper/2203.14216/) (2022)
- [Blind Image Super-Resolution: A Survey and Beyond](https://mlsanity.com/paper/2107.03055/) (2021)
- [CoSeR: Bridging Image and Language for Cognitive Super-Resolution](https://mlsanity.com/paper/2311.16512/) (2023)
- [Real-World Single Image Super-Resolution: A Brief Review](https://mlsanity.com/paper/2103.02368/) (2021)
- [Towards Realistic Data Generation for Real-World Super-Resolution](https://mlsanity.com/paper/2406.07255/) (2024)
- [Mutual Affine Network for Spatially Variant Kernel Estimation in Blind Image Super-Resolution](https://mlsanity.com/paper/2108.05302/) (2021)
- [MM-RealSR: Metric Learning based Interactive Modulation for Real-World Super-Resolution](https://mlsanity.com/paper/2205.05065/) (2022)
- [Blind Image Super-resolution with Elaborate Degradation Modeling on Noise and Kernel](https://mlsanity.com/paper/2107.00986/) (2021)
- [Learning the Degradation Distribution for Blind Image Super-Resolution](https://mlsanity.com/paper/2203.04962/) (2022)
- [Diffusion-based Blind Text Image Super-Resolution](https://mlsanity.com/paper/2312.08886/) (2023)
- [You Only Need One Step: Fast Super-Resolution with Stable Diffusion via Scale Distillation](https://mlsanity.com/paper/2401.17258/) (2024)
- [AnimeSR: Learning Real-World Super-Resolution Models for Animation Videos](https://mlsanity.com/paper/2206.07038/) (2022)
- [Human Guided Ground-truth Generation for Realistic Image Super-resolution](https://mlsanity.com/paper/2303.13069/) (2023)
- [A Systematic Survey of Deep Learning-based Single-Image Super-Resolution](https://mlsanity.com/paper/2109.14335/) (2021)
- [Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning](https://mlsanity.com/paper/2403.02601/) (2024)
- [Structure-Preserving Image Super-Resolution](https://mlsanity.com/paper/2109.12530/) (2021)
- [Evaluating the Generalization Ability of Super-Resolution Networks](https://mlsanity.com/paper/2205.07019/) (2022)
- [Efficient Test-Time Adaptation for Super-Resolution with Second-Order Degradation and Reconstruction](https://mlsanity.com/paper/2310.19011/) (2023)
- [Self-Supervised Deep Blind Video Super-Resolution](https://mlsanity.com/paper/2201.07422/) (2022)
- [Scene Text Image Super-resolution based on Text-conditional Diffusion Models](https://mlsanity.com/paper/2311.09759/) (2023)
- [Toward Real-World Super-Resolution via Adaptive Downsampling Models](https://mlsanity.com/paper/2109.03444/) (2021)
- [An Optimal Transport Perspective on Unpaired Image Super-Resolution](https://mlsanity.com/paper/2202.01116/) (2022)
- [Bayesian Image Super-Resolution with Deep Modeling of Image Statistics](https://mlsanity.com/paper/2204.00623/) (2022)
- [Generative Adversarial Networks for Image Super-Resolution: A Survey](https://mlsanity.com/paper/2204.13620/) (2022)
- [Learning Mutual Modulation for Self-Supervised Cross-Modal Super-Resolution](https://mlsanity.com/paper/2207.09156/) (2022)
- [Synthesizing Realistic Image Restoration Training Pairs: A Diffusion Approach](https://mlsanity.com/paper/2303.06994/) (2023)
- [Generalized Real-World Super-Resolution through Adversarial Robustness](https://mlsanity.com/paper/2108.11505/) (2021)

## Abstract (arXiv)

In most studies on learning-based image super-resolution (SR), the paired training dataset is created by downscaling high-resolution (HR) images with a predetermined operation (e.g., bicubic). However, these methods fail to super-resolve real-world low-resolution (LR) images, for which the degradation process is much more complicated and unknown. In this paper, we propose an unpaired SR method using a generative adversarial network that does not require a paired/aligned training dataset. Our network consists of an unpaired kernel/noise correction network and a pseudo-paired SR network. The correction network removes noise and adjusts the kernel of the inputted LR image; then, the corrected clean LR image is upscaled by the SR network. In the training phase, the correction network also produces a pseudo-clean LR image from the inputted HR image, and then a mapping from the pseudo-clean LR image to the inputted HR image is learned by the SR network in a paired manner. Because our SR network is independent of the correction network, well-studied existing network architectures and pixel-wise loss functions can be integrated with the proposed framework. Experiments on diverse datasets show that the proposed method is superior to existing solutions to the unpaired SR problem.
