Rethinking Image Super-Resolution from Training Data Perspectives
Not on the map. Why?
Abstract (arXiv)
In this work, we investigate the understudied effect of the training data used for image super-resolution (SR). Most commonly, novel SR methods are developed and benchmarked on common training datasets such as DIV2K and DF2K. However, we investigate and rethink the training data from the perspectives of diversity and quality, {thereby addressing the question of ``How important is SR training for SR models?''}. To this end, we propose an automated image evaluation pipeline. With this, we stratify existing high-resolution image datasets and larger-scale image datasets such as ImageNet and PASS to compare their performances. We find that datasets with (i) low compression artifacts, (ii) high within-image diversity as judged by the number of different objects, and (iii) a large number of images from ImageNet or PASS all positively affect SR performance. We hope that the proposed simple-yet-effective dataset curation pipeline will inform the construction of SR datasets in the future and yield overall better models.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 23 of its 41 references that are in the map. First posted on arXiv 1 Sep 2024.
Builds on
23 of 41 references.
References · 23
- 2023Segment Anythingcited by 8,158
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2020Pre-Trained Image Processing Transformercited by 891
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
11 more
- 2016Accelerating the Super-Resolution Convolutional Neural Networkcited by 393
- 2015Sketch-based Manga Retrieval using Manga109 Datasetcited by 326
- 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
- 2019Residual Non-local Attention Networks for Image Restorationcited by 236
- 2022Efficient Long-Range Attention Network for Image Super-resolutioncited by 151
- 2020Cross-Scale Internal Graph Neural Network for Image Super-Resolutioncited by 94
- 2022SwinFIR: Revisiting the SwinIR with Fast Fourier Convolution and Improved Training for Image Super-Resolutioncited by 67
- 2021On Efficient Transformer-Based Image Pre-training for Low-Level Visioncited by 64
- 2021PASS: An ImageNet replacement for self-supervised pretraining without humanscited by 51
- 2022Revisiting RCAN: Improved Training for Image Super-Resolutioncited by 32
- 2023HQ-50K: A Large-scale, High-quality Dataset for Image Restorationcited by 15
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025Emulating Self-attention with Convolution for Efficient Image Super-Resolutioncited by 5
- 2025LR0.FM: Low-Res Benchmark and Improving Robustness for Zero-Shot Classification in Foundation Modelscited by 3
- 2025Instance Data Condensation for Image Super-Resolutioncited by 1
- 2026Rank-Factorized Implicit Neural Bias: Scaling Super-Resolution Transformer with FlashAttentioncited by 1
- 20264KLSDB: A Large-Scale Dataset for 4K Image Restoration and Generationcited by 0
- 2026CAT-Flow: Curvature-Adaptive sTeps for Flow Matchingcited by 0
- 2026CAT-Flow: Curvature-Adaptive sTeps for Flow Matching1 Sep 2026
- 20264KLSDB: A Large-Scale Dataset for 4K Image Restoration and Generation23 May 2026
- 2026Rank-Factorized Implicit Neural Bias: Scaling Super-Resolution Transformer with FlashAttention6 Mar 2026
- 2025Instance Data Condensation for Image Super-Resolution27 May 2025
- 2025Emulating Self-attention with Convolution for Efficient Image Super-Resolution9 Mar 2025
- 2025LR0.FM: Low-Res Benchmark and Improving Robustness for Zero-Shot Classification in Foundation Models6 Feb 2025