mlsanityData to 7 Oct 2026

Quality-Aware Image-Text Alignment for Opinion-Unaware Image Quality Assessment

arXiv 2403.11176 ↗First posted 17 Mar 2024cs.CV cs.CLcited by 31

Not on the map. Why?

Abstract (arXiv)

No-Reference Image Quality Assessment (NR-IQA) focuses on designing methods to measure image quality in alignment with human perception when a high-quality reference image is unavailable. Most state-of-the-art NR-IQA approaches are opinion-aware, i.e. they require human annotations for training. This dependency limits their scalability and broad applicability. To overcome this limitation, we propose QualiCLIP (Quality-aware CLIP), a CLIP-based self-supervised opinion-unaware approach that does not require human opinions. In particular, we introduce a quality-aware image-text alignment strategy to make CLIP generate quality-aware image representations. Starting from pristine images, we synthetically degrade them with increasing levels of intensity. Then, we train CLIP to rank these degraded images based on their similarity to quality-related antonym text prompts. At the same time, we force CLIP to generate consistent representations for images with similar content and the same level of degradation. Our experiments show that the proposed method improves over existing opinion-unaware approaches across multiple datasets with diverse distortion types. Moreover, despite not requiring human annotations, QualiCLIP achieves excellent performance against supervised opinion-aware methods in cross-dataset experiments, thus demonstrating remarkable generalization capabilities. The code and the model are publicly available at https://github.com/miccunifi/QualiCLIP.

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 34 of its 69 references that are in the map. First posted on arXiv 17 Mar 2024.

Builds on

34 of 69 references.

References · 34

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  7. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  8. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
  9. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
  10. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
  11. 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
  12. 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
22 more
  1. 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 177
  2. 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
  3. 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 150
  4. 2016Learning a No-Reference Quality Metric for Single-Image Super-Resolutioncited by 143
  5. 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
  6. 2022SuS-X: Training-Free Name-Only Transfer of Vision-Language Modelscited by 118
  7. 2023Iterative Prompt Learning for Unsupervised Backlit Image Enhancementcited by 107
  8. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
  9. 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
  10. 2021Image Quality Assessment using Contrastive Learningcited by 95
  11. 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 87
  12. 2019dipIQ: Blind Image Quality Assessment by Learning-to-Rank Discriminable Image Pairscited by 73
  13. 2023VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretrainingcited by 63
  14. 2023A Perceptual Quality Assessment Exploration for AIGC Imagescited by 54
  15. 2020Assessing Image Quality Issues for Real-World Problemscited by 28
  16. 2023Exploring Opinion-unaware Video Quality Assessment with Semantic Affinity Criterioncited by 23
  17. 2023Towards Robust Text-Prompted Semantic Criterion for In-the-Wild Video Quality Assessmentcited by 16
  18. 2023Test Time Adaptation for Blind Image Quality Assessmentcited by 11
  19. 2023Learning Generalizable Perceptual Representations for Data-Efficient No-Reference Image Quality Assessmentcited by 11
  20. 2023Transformer-based No-Reference Image Quality Assessment via Supervised Contrastive Learningcited by 9
  21. 2023Reference-based Restoration of Digitized Analog Videotapescited by 3
  22. 2022Content-Diverse Comparisons improve IQAcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 10; 2026: 14.

31 papers.

Sort:

By area:

  1. 2024UHD-IQA Benchmark Database: Pushing the Boundaries of Blind Photo Quality Assessmentcited by 16
  2. 2024SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuningcited by 13
  3. 2024Assessing UHD Image Quality from Aesthetics, Distortions, and Saliencycited by 9
  4. 2025Latent Wavelet Diffusion For Ultra-High-Resolution Image Synthesiscited by 6
  5. 2024LAR-IQA: A Lightweight, Accurate, and Robust No-Reference Image Quality Assessment Modelcited by 5
  6. 2024AIM 2024 Challenge on UHD Blind Photo Quality Assessmentcited by 5
  7. 2025CLIP-PCQA: Exploring Subjective-Aligned Vision-Language Modeling for Point Cloud Quality Assessmentcited by 5
  8. 2026QualiTeacher: Quality-Conditioned Pseudo-Labeling for Real-World Image Restorationcited by 5
  9. 2026Decoupling Semantics from Distortions: Multi-Scale Two-Stream Vision-Language Alignment for AI-Generated Image Quality Assessmentcited by 4
  10. 2024Embodied Image Quality Assessment for Robotic Intelligencecited by 2
  11. 2025Image Intrinsic Scale Assessment: Bridging the Gap Between Quality and Resolutioncited by 2
  12. 2025Modeling Beyond MOS: Quality Assessment Models Must Integrate Context, Reasoning, and Multimodalitycited by 2
19 more
  1. 2026From Global to Granular: Revealing IQA Model Performance via Correlation Surfacecited by 2
  2. 2026Evaluating Generative Models via One-Dimensional Code Distributionscited by 2
  3. 2024MobileIQA: Exploiting Mobile-level Diverse Opinion Network For No-Reference Image Quality Assessment Using Knowledge Distillationcited by 1
  4. 2025HiRQA: Hierarchical Ranking and Quality Alignment for Opinion-Unaware Image Quality Assessmentcited by 1
  5. 2025A Style is Worth One Code: Unlocking Code-to-Style Image Generation with Discrete Style Spacecited by 1
  6. 2025FrontierGS: Progressive View-Space Frontier Expansion for Sparse 3D Gaussian Splattingcited by 1
  7. 2026Decoupling Perception and Calibration: Label-Efficient Image Quality Assessment Frameworkcited by 1
  8. 2026ELIQ: A Label-Free Framework for Quality Assessment of Evolving AI-Generated Imagescited by 1
  9. 2026Self-Aware Object Detection via Degradation Manifoldscited by 1
  10. 2026Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolutioncited by 1
  11. 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Procited by 1
  12. 2026A Distributional View for Visual Mechanistic Interpretability: KL-Minimal Soft-Constraint Principlecited by 1
  13. 2025A Lightweight Ensemble-Based Face Image Quality Assessment Method with Correlation-Aware Losscited by 0
  14. 2025NovisVQ: A Streaming Convolutional Neural Network for No-Reference Opinion-Unaware Frame Quality Assessmentcited by 0
  15. 2025DEAR: Dataset for Evaluating the Aesthetics of Renderingcited by 0
  16. 2026Viewport-Unaware Blind Omnidirectional Image Quality Assessment: A Unified and Generalized Approachcited by 0
  17. 2026Computing Monetary Risk Measures in Linear Timecited by 0
  18. 2026MCIQA-2K: A Multi-Dimensional Dataset and No-Reference Quality Assessment Benchmark for Colorized Imagescited by 0
  19. 2026Bridging the Perceptual Gap: Residual-Enhanced Downscaling and Manifold-Aware Perception Alignment Adaptation for NR-IQAcited by 0