Quality-Aware Image-Text Alignment for Opinion-Unaware Image Quality Assessment
Not on the map. Why?
Abstract (arXiv)
No-Reference Image Quality Assessment (NR-IQA) focuses on designing methods to measure image quality in alignment with human perception when a high-quality reference image is unavailable. Most state-of-the-art NR-IQA approaches are opinion-aware, i.e. they require human annotations for training. This dependency limits their scalability and broad applicability. To overcome this limitation, we propose QualiCLIP (Quality-aware CLIP), a CLIP-based self-supervised opinion-unaware approach that does not require human opinions. In particular, we introduce a quality-aware image-text alignment strategy to make CLIP generate quality-aware image representations. Starting from pristine images, we synthetically degrade them with increasing levels of intensity. Then, we train CLIP to rank these degraded images based on their similarity to quality-related antonym text prompts. At the same time, we force CLIP to generate consistent representations for images with similar content and the same level of degradation. Our experiments show that the proposed method improves over existing opinion-unaware approaches across multiple datasets with diverse distortion types. Moreover, despite not requiring human annotations, QualiCLIP achieves excellent performance against supervised opinion-aware methods in cross-dataset experiments, thus demonstrating remarkable generalization capabilities. The code and the model are publicly available at https://github.com/miccunifi/QualiCLIP.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 34 of its 69 references that are in the map. First posted on arXiv 17 Mar 2024.
Builds on
34 of 69 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
22 more
- 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 177
- 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
- 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 150
- 2016Learning a No-Reference Quality Metric for Single-Image Super-Resolutioncited by 143
- 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
- 2022SuS-X: Training-Free Name-Only Transfer of Vision-Language Modelscited by 118
- 2023Iterative Prompt Learning for Unsupervised Backlit Image Enhancementcited by 107
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
- 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
- 2021Image Quality Assessment using Contrastive Learningcited by 95
- 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 87
- 2019dipIQ: Blind Image Quality Assessment by Learning-to-Rank Discriminable Image Pairscited by 73
- 2023VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretrainingcited by 63
- 2023A Perceptual Quality Assessment Exploration for AIGC Imagescited by 54
- 2020Assessing Image Quality Issues for Real-World Problemscited by 28
- 2023Exploring Opinion-unaware Video Quality Assessment with Semantic Affinity Criterioncited by 23
- 2023Towards Robust Text-Prompted Semantic Criterion for In-the-Wild Video Quality Assessmentcited by 16
- 2023Test Time Adaptation for Blind Image Quality Assessmentcited by 11
- 2023Learning Generalizable Perceptual Representations for Data-Efficient No-Reference Image Quality Assessmentcited by 11
- 2023Transformer-based No-Reference Image Quality Assessment via Supervised Contrastive Learningcited by 9
- 2023Reference-based Restoration of Digitized Analog Videotapescited by 3
- 2022Content-Diverse Comparisons improve IQAcited by 2
Built on by
Citing papers per year: 2024: 7; 2025: 10; 2026: 14.
31 papers.
Sort:
By area:
- 2024UHD-IQA Benchmark Database: Pushing the Boundaries of Blind Photo Quality Assessmentcited by 16
- 2024SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuningcited by 13
- 2024Assessing UHD Image Quality from Aesthetics, Distortions, and Saliencycited by 9
- 2025Latent Wavelet Diffusion For Ultra-High-Resolution Image Synthesiscited by 6
- 2024LAR-IQA: A Lightweight, Accurate, and Robust No-Reference Image Quality Assessment Modelcited by 5
- 2024AIM 2024 Challenge on UHD Blind Photo Quality Assessmentcited by 5
- 2025CLIP-PCQA: Exploring Subjective-Aligned Vision-Language Modeling for Point Cloud Quality Assessmentcited by 5
- 2026QualiTeacher: Quality-Conditioned Pseudo-Labeling for Real-World Image Restorationcited by 5
- 2026Decoupling Semantics from Distortions: Multi-Scale Two-Stream Vision-Language Alignment for AI-Generated Image Quality Assessmentcited by 4
- 2024Embodied Image Quality Assessment for Robotic Intelligencecited by 2
- 2025Image Intrinsic Scale Assessment: Bridging the Gap Between Quality and Resolutioncited by 2
- 2025Modeling Beyond MOS: Quality Assessment Models Must Integrate Context, Reasoning, and Multimodalitycited by 2
19 more
- 2026From Global to Granular: Revealing IQA Model Performance via Correlation Surfacecited by 2
- 2026Evaluating Generative Models via One-Dimensional Code Distributionscited by 2
- 2024MobileIQA: Exploiting Mobile-level Diverse Opinion Network For No-Reference Image Quality Assessment Using Knowledge Distillationcited by 1
- 2025HiRQA: Hierarchical Ranking and Quality Alignment for Opinion-Unaware Image Quality Assessmentcited by 1
- 2025A Style is Worth One Code: Unlocking Code-to-Style Image Generation with Discrete Style Spacecited by 1
- 2025FrontierGS: Progressive View-Space Frontier Expansion for Sparse 3D Gaussian Splattingcited by 1
- 2026Decoupling Perception and Calibration: Label-Efficient Image Quality Assessment Frameworkcited by 1
- 2026ELIQ: A Label-Free Framework for Quality Assessment of Evolving AI-Generated Imagescited by 1
- 2026Self-Aware Object Detection via Degradation Manifoldscited by 1
- 2026Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolutioncited by 1
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Procited by 1
- 2026A Distributional View for Visual Mechanistic Interpretability: KL-Minimal Soft-Constraint Principlecited by 1
- 2025A Lightweight Ensemble-Based Face Image Quality Assessment Method with Correlation-Aware Losscited by 0
- 2025NovisVQ: A Streaming Convolutional Neural Network for No-Reference Opinion-Unaware Frame Quality Assessmentcited by 0
- 2025DEAR: Dataset for Evaluating the Aesthetics of Renderingcited by 0
- 2026Viewport-Unaware Blind Omnidirectional Image Quality Assessment: A Unified and Generalized Approachcited by 0
- 2026Computing Monetary Risk Measures in Linear Timecited by 0
- 2026MCIQA-2K: A Multi-Dimensional Dataset and No-Reference Quality Assessment Benchmark for Colorized Imagescited by 0
- 2026Bridging the Perceptual Gap: Residual-Enhanced Downscaling and Manifold-Aware Perception Alignment Adaptation for NR-IQAcited by 0
- 2026Bridging the Perceptual Gap: Residual-Enhanced Downscaling and Manifold-Aware Perception Alignment Adaptation for NR-IQA15 Sep 2026
- 2026MCIQA-2K: A Multi-Dimensional Dataset and No-Reference Quality Assessment Benchmark for Colorized Images13 Sep 2026
- 2026Computing Monetary Risk Measures in Linear Time6 Jul 2026
- 2026Decoupling Semantics from Distortions: Multi-Scale Two-Stream Vision-Language Alignment for AI-Generated Image Quality Assessment15 Jun 2026
- 2026A Distributional View for Visual Mechanistic Interpretability: KL-Minimal Soft-Constraint Principle17 May 2026
- 2026Viewport-Unaware Blind Omnidirectional Image Quality Assessment: A Unified and Generalized Approach27 Apr 2026
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Pro3 Apr 2026
- 2026Evaluating Generative Models via One-Dimensional Code Distributions9 Mar 2026
- 2026QualiTeacher: Quality-Conditioned Pseudo-Labeling for Real-World Image Restoration9 Mar 2026
- 2026Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolution6 Mar 2026
- 2026Self-Aware Object Detection via Degradation Manifolds20 Feb 2026
- 2026ELIQ: A Label-Free Framework for Quality Assessment of Evolving AI-Generated Images3 Feb 2026
19 more
- 2026From Global to Granular: Revealing IQA Model Performance via Correlation Surface29 Jan 2026
- 2026Decoupling Perception and Calibration: Label-Efficient Image Quality Assessment Framework28 Jan 2026
- 2025DEAR: Dataset for Evaluating the Aesthetics of Rendering4 Dec 2025
- 2025FrontierGS: Progressive View-Space Frontier Expansion for Sparse 3D Gaussian Splatting20 Nov 2025
- 2025A Style is Worth One Code: Unlocking Code-to-Style Image Generation with Discrete Style Space13 Nov 2025
- 2025NovisVQ: A Streaming Convolutional Neural Network for No-Reference Opinion-Unaware Frame Quality Assessment6 Nov 2025
- 2025A Lightweight Ensemble-Based Face Image Quality Assessment Method with Correlation-Aware Loss12 Sep 2025
- 2025HiRQA: Hierarchical Ranking and Quality Alignment for Opinion-Unaware Image Quality Assessment20 Aug 2025
- 2025Latent Wavelet Diffusion For Ultra-High-Resolution Image Synthesis31 May 2025
- 2025Modeling Beyond MOS: Quality Assessment Models Must Integrate Context, Reasoning, and Multimodality26 May 2025
- 2025Image Intrinsic Scale Assessment: Bridging the Gap Between Quality and Resolution10 Feb 2025
- 2025CLIP-PCQA: Exploring Subjective-Aligned Vision-Language Modeling for Point Cloud Quality Assessment17 Jan 2025
- 2024Embodied Image Quality Assessment for Robotic Intelligence25 Dec 2024
- 2024SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuning15 Nov 2024
- 2024AIM 2024 Challenge on UHD Blind Photo Quality Assessment24 Sep 2024
- 2024MobileIQA: Exploiting Mobile-level Diverse Opinion Network For No-Reference Image Quality Assessment Using Knowledge Distillation2 Sep 2024
- 2024Assessing UHD Image Quality from Aesthetics, Distortions, and Saliency1 Sep 2024
- 2024LAR-IQA: A Lightweight, Accurate, and Robust No-Reference Image Quality Assessment Model30 Aug 2024
- 2024UHD-IQA Benchmark Database: Pushing the Boundaries of Blind Photo Quality Assessment25 Jun 2024
- 2024SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuningcited by 13
- 2025CLIP-PCQA: Exploring Subjective-Aligned Vision-Language Modeling for Point Cloud Quality Assessmentcited by 5
- 2026Decoupling Semantics from Distortions: Multi-Scale Two-Stream Vision-Language Alignment for AI-Generated Image Quality Assessmentcited by 4
- 2026Decoupling Perception and Calibration: Label-Efficient Image Quality Assessment Frameworkcited by 1
- 2026Bridging the Perceptual Gap: Residual-Enhanced Downscaling and Manifold-Aware Perception Alignment Adaptation for NR-IQAcited by 0
- 2026Bridging the Perceptual Gap: Residual-Enhanced Downscaling and Manifold-Aware Perception Alignment Adaptation for NR-IQA15 Sep 2026
- 2026Decoupling Semantics from Distortions: Multi-Scale Two-Stream Vision-Language Alignment for AI-Generated Image Quality Assessment15 Jun 2026
- 2026Decoupling Perception and Calibration: Label-Efficient Image Quality Assessment Framework28 Jan 2026
- 2025CLIP-PCQA: Exploring Subjective-Aligned Vision-Language Modeling for Point Cloud Quality Assessment17 Jan 2025
- 2024SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuning15 Nov 2024
- 2024UHD-IQA Benchmark Database: Pushing the Boundaries of Blind Photo Quality Assessmentcited by 16
- 2024Assessing UHD Image Quality from Aesthetics, Distortions, and Saliencycited by 9
- 2025Latent Wavelet Diffusion For Ultra-High-Resolution Image Synthesiscited by 6
- 2024LAR-IQA: A Lightweight, Accurate, and Robust No-Reference Image Quality Assessment Modelcited by 5
- 2024AIM 2024 Challenge on UHD Blind Photo Quality Assessmentcited by 5
- 2026QualiTeacher: Quality-Conditioned Pseudo-Labeling for Real-World Image Restorationcited by 5
- 2024Embodied Image Quality Assessment for Robotic Intelligencecited by 2
- 2025Image Intrinsic Scale Assessment: Bridging the Gap Between Quality and Resolutioncited by 2
- 2026From Global to Granular: Revealing IQA Model Performance via Correlation Surfacecited by 2
- 2026Evaluating Generative Models via One-Dimensional Code Distributionscited by 2
- 2024MobileIQA: Exploiting Mobile-level Diverse Opinion Network For No-Reference Image Quality Assessment Using Knowledge Distillationcited by 1
- 2025HiRQA: Hierarchical Ranking and Quality Alignment for Opinion-Unaware Image Quality Assessmentcited by 1
12 most cited of 23 All 23 (JSON)
- 2026MCIQA-2K: A Multi-Dimensional Dataset and No-Reference Quality Assessment Benchmark for Colorized Images13 Sep 2026
- 2026Computing Monetary Risk Measures in Linear Time6 Jul 2026
- 2026A Distributional View for Visual Mechanistic Interpretability: KL-Minimal Soft-Constraint Principle17 May 2026
- 2026Viewport-Unaware Blind Omnidirectional Image Quality Assessment: A Unified and Generalized Approach27 Apr 2026
- 2026Evaluating Generative Models via One-Dimensional Code Distributions9 Mar 2026
- 2026QualiTeacher: Quality-Conditioned Pseudo-Labeling for Real-World Image Restoration9 Mar 2026
- 2026Self-Aware Object Detection via Degradation Manifolds20 Feb 2026
- 2026ELIQ: A Label-Free Framework for Quality Assessment of Evolving AI-Generated Images3 Feb 2026
- 2026From Global to Granular: Revealing IQA Model Performance via Correlation Surface29 Jan 2026
- 2025DEAR: Dataset for Evaluating the Aesthetics of Rendering4 Dec 2025
- 2025FrontierGS: Progressive View-Space Frontier Expansion for Sparse 3D Gaussian Splatting20 Nov 2025
- 2025A Style is Worth One Code: Unlocking Code-to-Style Image Generation with Discrete Style Space13 Nov 2025
12 newest of 23 All 23 (JSON)