NTIRE 2021 Challenge on Perceptual Image Quality Assessment
Not on the map. Why?
Abstract (arXiv)
This paper reports on the NTIRE 2021 challenge on perceptual image quality assessment (IQA), held in conjunction with the New Trends in Image Restoration and Enhancement workshop (NTIRE) workshop at CVPR 2021. As a new type of image processing technology, perceptual image processing algorithms based on Generative Adversarial Networks (GAN) have produced images with more realistic textures. These output images have completely different characteristics from traditional distortions, thus pose a new challenge for IQA methods to evaluate their visual quality. In comparison with previous IQA challenges, the training and testing datasets in this challenge include the outputs of perceptual image processing algorithms and the corresponding subjective scores. Thus they can be used to develop and evaluate IQA methods on GAN-based distortions. The challenge has 270 registered participants in total. In the final testing stage, 13 participating teams submitted their models and fact sheets. Almost all of them have achieved much better results than existing IQA methods, while the winning method can demonstrate state-of-the-art performance.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 32 of its 61 references that are in the map. First posted on arXiv 7 May 2021.
Builds on
32 of 61 references.
References · 32
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
20 more
- 2021Transformers in Vision: A Surveycited by 1,009
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2017The Perception-Distortion Tradeoffcited by 582
- 2019Making Convolutional Networks Shift-Invariant Againcited by 390
- 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 369
- 2018CatBoost: gradient boosting with categorical features supportcited by 208
- 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 177
- 2020FcaNet: Frequency Channel Attention Networkscited by 177
- 2018PieAPP: Perceptual Image-Error Assessment through Pairwise Preferencecited by 158
- 2018The 2018 PIRM Challenge on Perceptual Image Super-resolutioncited by 155
- 2019RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolutioncited by 145
- 2016Learning a No-Reference Quality Metric for Single-Image Super-Resolutioncited by 143
- 2021Perceptual Image Quality Assessment with Transformerscited by 54
- 2021NTIRE 2021 Challenge on Image Deblurringcited by 49
- 2019SoDeep: a Sorting Deep net to learn ranking loss surrogatescited by 28
- 2020Image Quality Assessment for Perceptual Image Restoration: A New Dataset, Benchmark and Metriccited by 26
- 2021NTIRE 2021 Challenge on Quality Enhancement of Compressed Video: Methods and Resultscited by 26
- 2021NTIRE 2021 Depth Guided Image Relighting Challengecited by 23
- 2021NTIRE 2021 Challenge on Video Super-Resolutioncited by 15
- 2021Region-Adaptive Deformable Network for Image Quality Assessmentcited by 14
Built on by
Citing papers per year: 2021: 4; 2022: 12; 2023: 2.
18 papers.
Sort:
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
- 2022NTIRE 2022 Challenge on Perceptual Image Quality Assessmentcited by 41
- 2021NTIRE 2021 Challenge on High Dynamic Range Imaging: Dataset, Methods and Resultscited by 36
- 2022PyTorch Image Quality: Metrics for Image Quality Assessmentcited by 34
- 2021NTIRE 2021 Challenge on Burst Super-Resolution: Methods and Resultscited by 22
- 2022Evaluating the Generalization Ability of Super-Resolution Networkscited by 18
- 2023Comparing the Robustness of Modern No-Reference Image- and Video-Quality Metrics to Adversarial Attackscited by 14
- 2022Incorporating Semi-Supervised and Positive-Unlabeled Learning for Boosting Full Reference Image Quality Assessmentcited by 12
- 2021Unravelling the Effect of Image Distortions for Biased Prediction of Pre-trained Face Recognition Modelscited by 11
- 2022MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusioncited by 10
- 2021NTIRE 2021 Multi-modal Aerial View Object Classification Challengecited by 7
6 more
- 2022Conformer and Blind Noisy Students for Improved Image Quality Assessmentcited by 5
- 2022MAiVAR: Multimodal Audio-Image and Video Action Recognizercited by 3
- 2022Image Quality Assessment with Gradient Siamese Networkcited by 2
- 2022Content-Diverse Comparisons improve IQAcited by 2
- 2022Pixel-by-pixel Mean Opinion Score (pMOS) for No-Reference Image Quality Assessmentcited by 0
- 2022Continuous Facial Motion Deblurringcited by 0
- 2023Comparing the Robustness of Modern No-Reference Image- and Video-Quality Metrics to Adversarial Attacks10 Oct 2023
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment6 Aug 2023
- 2022Content-Diverse Comparisons improve IQA9 Nov 2022
- 2022MAiVAR: Multimodal Audio-Image and Video Action Recognizer11 Sep 2022
- 2022PyTorch Image Quality: Metrics for Image Quality Assessment31 Aug 2022
- 2022Image Quality Assessment with Gradient Siamese Network8 Aug 2022
- 2022Continuous Facial Motion Deblurring14 Jul 2022
- 2022NTIRE 2022 Challenge on Perceptual Image Quality Assessment23 Jun 2022
- 2022Pixel-by-pixel Mean Opinion Score (pMOS) for No-Reference Image Quality Assessment14 Jun 2022
- 2022MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusion20 May 2022
- 2022Evaluating the Generalization Ability of Super-Resolution Networks14 May 2022
- 2022Conformer and Blind Noisy Students for Improved Image Quality Assessment27 Apr 2022
6 more
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment19 Apr 2022
- 2022Incorporating Semi-Supervised and Positive-Unlabeled Learning for Boosting Full Reference Image Quality Assessment19 Apr 2022
- 2021Unravelling the Effect of Image Distortions for Biased Prediction of Pre-trained Face Recognition Models14 Aug 2021
- 2021NTIRE 2021 Multi-modal Aerial View Object Classification Challenge2 Jul 2021
- 2021NTIRE 2021 Challenge on Burst Super-Resolution: Methods and Results7 Jun 2021
- 2021NTIRE 2021 Challenge on High Dynamic Range Imaging: Dataset, Methods and Results2 Jun 2021
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
- 2022NTIRE 2022 Challenge on Perceptual Image Quality Assessmentcited by 41
- 2021NTIRE 2021 Challenge on High Dynamic Range Imaging: Dataset, Methods and Resultscited by 36
- 2022PyTorch Image Quality: Metrics for Image Quality Assessmentcited by 34
- 2021NTIRE 2021 Challenge on Burst Super-Resolution: Methods and Resultscited by 22
- 2022Evaluating the Generalization Ability of Super-Resolution Networkscited by 18
- 2023Comparing the Robustness of Modern No-Reference Image- and Video-Quality Metrics to Adversarial Attackscited by 14
- 2022Incorporating Semi-Supervised and Positive-Unlabeled Learning for Boosting Full Reference Image Quality Assessmentcited by 12
- 2021Unravelling the Effect of Image Distortions for Biased Prediction of Pre-trained Face Recognition Modelscited by 11
- 2022MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusioncited by 10
- 2021NTIRE 2021 Multi-modal Aerial View Object Classification Challengecited by 7
12 most cited of 18 All 18 (JSON)
- 2023Comparing the Robustness of Modern No-Reference Image- and Video-Quality Metrics to Adversarial Attacks10 Oct 2023
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment6 Aug 2023
- 2022Content-Diverse Comparisons improve IQA9 Nov 2022
- 2022MAiVAR: Multimodal Audio-Image and Video Action Recognizer11 Sep 2022
- 2022PyTorch Image Quality: Metrics for Image Quality Assessment31 Aug 2022
- 2022Image Quality Assessment with Gradient Siamese Network8 Aug 2022
- 2022Continuous Facial Motion Deblurring14 Jul 2022
- 2022NTIRE 2022 Challenge on Perceptual Image Quality Assessment23 Jun 2022
- 2022Pixel-by-pixel Mean Opinion Score (pMOS) for No-Reference Image Quality Assessment14 Jun 2022
- 2022MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusion20 May 2022
- 2022Evaluating the Generalization Ability of Super-Resolution Networks14 May 2022
- 2022Conformer and Blind Noisy Students for Improved Image Quality Assessment27 Apr 2022
12 newest of 18 All 18 (JSON)