Learning Generalizable Perceptual Representations for Data-Efficient No-Reference Image Quality Assessment
Not on the map. Why?
Abstract (arXiv)
No-reference (NR) image quality assessment (IQA) is an important tool in enhancing the user experience in diverse visual applications. A major drawback of state-of-the-art NR-IQA techniques is their reliance on a large number of human annotations to train models for a target IQA application. To mitigate this requirement, there is a need for unsupervised learning of generalizable quality representations that capture diverse distortions. We enable the learning of low-level quality features agnostic to distortion types by introducing a novel quality-aware contrastive loss. Further, we leverage the generalizability of vision-language models by fine-tuning one such model to extract high-level image quality information through relevant text prompts. The two sets of features are combined to effectively predict quality by training a simple regressor with very few samples on a target dataset. Additionally, we design zero-shot quality predictions from both pathways in a completely blind setting. Our experiments on diverse datasets encompassing various distortions show the generalizability of the features and their superior performance in the data-efficient and zero-shot settings. Code will be made available at https://github.com/suhas-srinath/GRepQ.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 28 of its 43 references that are in the map. First posted on arXiv 8 Dec 2023.
Builds on
28 of 43 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2020Supervised Contrastive Learningcited by 2,803
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
- 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 224
16 more
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
- 2013Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Indexcited by 193
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 177
- 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
- 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 150
- 2020MetaIQA: Deep Meta-learning for No-Reference Image Quality Assessmentcited by 144
- 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
- 2022CLIP-Event: Connecting Text and Images with Event Structurescited by 86
- 2020Transformer for Image Quality Assessmentcited by 76
- 2021Unleashing the Power of Contrastive Self-Supervised Visual Models via Contrast-Regularized Fine-Tuningcited by 50
- 2023Data-Efficient Image Quality Assessment with Attention-Panel Decodercited by 49
- 2022MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusioncited by 10
- 2019Quality-aware Unpaired Image-to-Image Translationcited by 9
- 2021Degraded Reference Image Quality Assessmentcited by 5
Built on by
Citing papers per year: 2024: 5; 2025: 3; 2026: 3.
11 papers.
- 2024Quality-Aware Image-Text Alignment for Opinion-Unaware Image Quality Assessmentcited by 31
- 2024UniQA: Unified Vision-Language Pre-training for Image Quality and Aesthetic Assessmentcited by 12
- 2024Dog-IQA: Standard-guided Zero-shot MLLM for Mix-grained Image Quality Assessmentcited by 9
- 2024Few-Shot Image Quality Assessment via Adaptation of Vision-Language Modelscited by 4
- 2024Image and Video Quality Assessment using Prompt-Guided Latent Diffusion Models for Cross-Dataset Generalizationcited by 3
- 2025Latent Guidance in Diffusion Models for Perceptual Evaluationscited by 2
- 2025BPCLIP: A Bottom-up Image Quality Assessment from Distortion to Semantics Based on CLIPcited by 2
- 2025HiRQA: Hierarchical Ranking and Quality Alignment for Opinion-Unaware Image Quality Assessmentcited by 1
- 2026ELIQ: A Label-Free Framework for Quality Assessment of Evolving AI-Generated Imagescited by 1
- 2026Learning Where to Look and How to Judge: Resolution-agnostic Image Quality Assessment with Quality-aware Saliencycited by 1
- 2026Spatially Localized Image Degradation Embeddings for Image Quality Assessmentcited by 0
- 2026Learning Where to Look and How to Judge: Resolution-agnostic Image Quality Assessment with Quality-aware Saliency3 Aug 2026
- 2026Spatially Localized Image Degradation Embeddings for Image Quality Assessment28 Jun 2026
- 2026ELIQ: A Label-Free Framework for Quality Assessment of Evolving AI-Generated Images3 Feb 2026
- 2025HiRQA: Hierarchical Ranking and Quality Alignment for Opinion-Unaware Image Quality Assessment20 Aug 2025
- 2025BPCLIP: A Bottom-up Image Quality Assessment from Distortion to Semantics Based on CLIP22 Jun 2025
- 2025Latent Guidance in Diffusion Models for Perceptual Evaluations31 May 2025
- 2024Dog-IQA: Standard-guided Zero-shot MLLM for Mix-grained Image Quality Assessment3 Oct 2024
- 2024Few-Shot Image Quality Assessment via Adaptation of Vision-Language Models9 Sep 2024
- 2024Image and Video Quality Assessment using Prompt-Guided Latent Diffusion Models for Cross-Dataset Generalization7 Jun 2024
- 2024UniQA: Unified Vision-Language Pre-training for Image Quality and Aesthetic Assessment3 Jun 2024
- 2024Quality-Aware Image-Text Alignment for Opinion-Unaware Image Quality Assessment17 Mar 2024
Similar, not cited
Close in wording, no citation either way
- 2024ATTIQA: Generalizable Image Quality Feature Extractor using Attribute-aware Pretraining
- 2025Revisiting Vision Language Foundations for No-Reference Image Quality Assessment
- 2025Investigate the Low-level Visual Perception in Vision-Language based Image Quality Assessment
- 2026From Glance to Scrutiny: Progressive Distortion Reasoning for Fine-Grained Image Quality Assessment
- 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Compare
- 2025Segmenting and Understanding: Region-aware Semantic Attention for Fine-grained Image Quality Assessment with Large Language Models
- 2025Parameter-Efficient Adaptation of mPLUG-Owl2 via Pixel-Level Visual Prompts for NR-IQA
- 2025ViDA-UGC: Detailed Image Quality Analysis via Visual Distortion Assessment for UGC Images