mlsanityData to 14 Oct 2026

Dual-Representation Interaction Driven Image Quality Assessment with Restoration Assistance

arXiv 2411.17390 ↗First posted 26 Nov 2024eess.IV cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

No-Reference Image Quality Assessment for distorted images has always been a challenging problem due to image content variance and distortion diversity. Previous IQA models mostly encode explicit single-quality features of synthetic images to obtain quality-aware representations for quality score prediction. However, performance decreases when facing real-world distortion and restored images from restoration models. The reason is that they do not consider the degradation factors of the low-quality images adequately. To address this issue, we first introduce the DRI method to obtain degradation vectors and quality vectors of images, which separately model the degradation and quality information of low-quality images. After that, we add the restoration network to provide the MOS score predictor with degradation information. Then, we design the Representation-based Semantic Loss (RS Loss) to assist in enhancing effective interaction between representations. Extensive experimental results demonstrate that the proposed method performs favorably against existing state-of-the-art models on both synthetic and real-world datasets.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 57 references that are in the map. First posted on arXiv 26 Nov 2024.

Builds on

39 of 57 references.

References · 39

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  6. 2020Supervised Contrastive Learningcited by 2,829
  7. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  8. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  9. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
  10. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  11. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  12. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
27 more
  1. 2022Simple Baselines for Image Restorationcited by 708
  2. 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 577
  3. 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 569
  4. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  5. 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 362
  6. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
  7. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 302
  8. 2021When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentationscited by 260
  9. 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 223
  10. 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 209
  11. 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 178
  12. 2021Unsupervised Degradation Representation Learning for Blind Super-Resolutioncited by 177
  13. 2022Surrogate Gap Minimization Improves Sharpness-Aware Trainingcited by 172
  14. 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 166
  15. 2020MetaIQA: Deep Meta-learning for No-Reference Image Quality Assessmentcited by 144
  16. 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
  17. 2021Image Quality Assessment using Contrastive Learningcited by 95
  18. 2021Unpaired Deep Image Deraining Using Dual Contrastive Learningcited by 60
  19. 2021Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessmentcited by 41
  20. 2023DeSRA: Detect and Delete the Artifacts of GAN-based Real-World Super-Resolution Modelscited by 41
  21. 2023Unsupervised Image Denoising in Real-World Scenarios via Self-Collaboration Parallel Generative Adversarial Branchescited by 29
  22. 2017A Probabilistic Quality Representation Approach to Deep Blind Image Quality Predictioncited by 28
  23. 2023All-in-one Multi-degradation Image Restoration Network via Hierarchical Degradation Representationcited by 21
  24. 2022Animation from Blur: Multi-modal Blur Decomposition with Motion Guidancecited by 16
  25. 2023Dual Degradation Representation for Joint Deraining and Low-Light Enhancement in the Darkcited by 9
  26. 2024Re-boosting Self-Collaboration Parallel Prompt GAN for Unsupervised Image Restorationcited by 7
  27. 2024Asymmetric Mask Scheme for Self-Supervised Real Image Denoisingcited by 6

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.