Dual-Representation Interaction Driven Image Quality Assessment with Restoration Assistance
Not on the map. Why?
Abstract (arXiv)
No-Reference Image Quality Assessment for distorted images has always been a challenging problem due to image content variance and distortion diversity. Previous IQA models mostly encode explicit single-quality features of synthetic images to obtain quality-aware representations for quality score prediction. However, performance decreases when facing real-world distortion and restored images from restoration models. The reason is that they do not consider the degradation factors of the low-quality images adequately. To address this issue, we first introduce the DRI method to obtain degradation vectors and quality vectors of images, which separately model the degradation and quality information of low-quality images. After that, we add the restoration network to provide the MOS score predictor with degradation information. Then, we design the Representation-based Semantic Loss (RS Loss) to assist in enhancing effective interaction between representations. Extensive experimental results demonstrate that the proposed method performs favorably against existing state-of-the-art models on both synthetic and real-world datasets.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 57 references that are in the map. First posted on arXiv 26 Nov 2024.
Builds on
39 of 57 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020Supervised Contrastive Learningcited by 2,829
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
27 more
- 2022Simple Baselines for Image Restorationcited by 708
- 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 577
- 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 569
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 362
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 302
- 2021When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentationscited by 260
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 223
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 209
- 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 178
- 2021Unsupervised Degradation Representation Learning for Blind Super-Resolutioncited by 177
- 2022Surrogate Gap Minimization Improves Sharpness-Aware Trainingcited by 172
- 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 166
- 2020MetaIQA: Deep Meta-learning for No-Reference Image Quality Assessmentcited by 144
- 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
- 2021Image Quality Assessment using Contrastive Learningcited by 95
- 2021Unpaired Deep Image Deraining Using Dual Contrastive Learningcited by 60
- 2021Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessmentcited by 41
- 2023DeSRA: Detect and Delete the Artifacts of GAN-based Real-World Super-Resolution Modelscited by 41
- 2023Unsupervised Image Denoising in Real-World Scenarios via Self-Collaboration Parallel Generative Adversarial Branchescited by 29
- 2017A Probabilistic Quality Representation Approach to Deep Blind Image Quality Predictioncited by 28
- 2023All-in-one Multi-degradation Image Restoration Network via Hierarchical Degradation Representationcited by 21
- 2022Animation from Blur: Multi-modal Blur Decomposition with Motion Guidancecited by 16
- 2023Dual Degradation Representation for Joint Deraining and Low-Light Enhancement in the Darkcited by 9
- 2024Re-boosting Self-Collaboration Parallel Prompt GAN for Unsupervised Image Restorationcited by 7
- 2024Asymmetric Mask Scheme for Self-Supervised Real Image Denoisingcited by 6
Built on by
Citing papers per year: 2025: 1.
1 paper.