mlsanityData to 7 Oct 2026

Learning Generalizable Perceptual Representations for Data-Efficient No-Reference Image Quality Assessment

arXiv 2312.04838 ↗First posted 8 Dec 2023cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

No-reference (NR) image quality assessment (IQA) is an important tool in enhancing the user experience in diverse visual applications. A major drawback of state-of-the-art NR-IQA techniques is their reliance on a large number of human annotations to train models for a target IQA application. To mitigate this requirement, there is a need for unsupervised learning of generalizable quality representations that capture diverse distortions. We enable the learning of low-level quality features agnostic to distortion types by introducing a novel quality-aware contrastive loss. Further, we leverage the generalizability of vision-language models by fine-tuning one such model to extract high-level image quality information through relevant text prompts. The two sets of features are combined to effectively predict quality by training a simple regressor with very few samples on a target dataset. Additionally, we design zero-shot quality predictions from both pathways in a completely blind setting. Our experiments on diverse datasets encompassing various distortions show the generalizability of the features and their superior performance in the data-efficient and zero-shot settings. Code will be made available at https://github.com/suhas-srinath/GRepQ.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 28 of its 43 references that are in the map. First posted on arXiv 8 Dec 2023.

Builds on

28 of 43 references.

References · 28

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2020Supervised Contrastive Learningcited by 2,803
  6. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  7. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  8. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  9. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
  10. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
  11. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
  12. 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 224
16 more
  1. 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
  2. 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
  3. 2013Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Indexcited by 193
  4. 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
  5. 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 177
  6. 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
  7. 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 150
  8. 2020MetaIQA: Deep Meta-learning for No-Reference Image Quality Assessmentcited by 144
  9. 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
  10. 2022CLIP-Event: Connecting Text and Images with Event Structurescited by 86
  11. 2020Transformer for Image Quality Assessmentcited by 76
  12. 2021Unleashing the Power of Contrastive Self-Supervised Visual Models via Contrast-Regularized Fine-Tuningcited by 50
  13. 2023Data-Efficient Image Quality Assessment with Attention-Panel Decodercited by 49
  14. 2022MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusioncited by 10
  15. 2019Quality-aware Unpaired Image-to-Image Translationcited by 9
  16. 2021Degraded Reference Image Quality Assessmentcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 3; 2026: 3.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024ATTIQA: Generalizable Image Quality Feature Extractor using Attribute-aware Pretraining
  2. 2025Revisiting Vision Language Foundations for No-Reference Image Quality Assessment
  3. 2025Investigate the Low-level Visual Perception in Vision-Language based Image Quality Assessment
  4. 2026From Glance to Scrutiny: Progressive Distortion Reasoning for Fine-Grained Image Quality Assessment
  5. 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Compare
  6. 2025Segmenting and Understanding: Region-aware Semantic Attention for Fine-grained Image Quality Assessment with Large Language Models
  7. 2025Parameter-Efficient Adaptation of mPLUG-Owl2 via Pixel-Level Visual Prompts for NR-IQA
  8. 2025ViDA-UGC: Detailed Image Quality Analysis via Visual Distortion Assessment for UGC Images