mlsanityData to 7 Oct 2026

ExIQA: Explainable Image Quality Assessment Using Distortion Attributes

arXiv 2409.06853 ↗First posted 10 Sep 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Blind Image Quality Assessment (BIQA) aims to develop methods that estimate the quality scores of images in the absence of a reference image. In this paper, we approach BIQA from a distortion identification perspective, where our primary goal is to predict distortion types and strengths using Vision-Language Models (VLMs), such as CLIP, due to their extensive knowledge and generalizability. Based on these predicted distortions, we then estimate the quality score of the image. To achieve this, we propose an explainable approach for distortion identification based on attribute learning. Instead of prompting VLMs with the names of distortions, we prompt them with the attributes or effects of distortions and aggregate this information to infer the distortion strength. Additionally, we consider multiple distortions per image, making our method more scalable. To support this, we generate a dataset consisting of 100,000 images for efficient training. Finally, attribute probabilities are retrieved and fed into a regressor to predict the image quality score. The results show that our approach, besides its explainability and transparency, achieves state-of-the-art (SOTA) performance across multiple datasets in both PLCC and SRCC metrics. Moreover, the zero-shot results demonstrate the generalizability of the proposed approach.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 55 references that are in the map. First posted on arXiv 10 Sep 2024.

Builds on

30 of 55 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2016Layer Normalizationcited by 5,579
  6. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  7. 2023A Survey of Large Language Modelscited by 2,537
  8. 2022Visual Prompt Tuningcited by 1,674
  9. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 994
  10. 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
  11. 2017Self-Normalizing Neural Networkscited by 591
  12. 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 553
18 more
  1. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
  2. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
  3. 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 224
  4. 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
  5. 2021Image Quality Assessment using Contrastive Learningcited by 95
  6. 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 87
  7. 2019Towards Explainable Deep Neural Networks (xDNN)cited by 61
  8. 2016On the Use of Deep Learning for Blind Image Quality Assessmentcited by 34
  9. 2023GPT-3.5, GPT-4, or BARD? Evaluating LLMs Reasoning Ability in Zero-Shot Setting and Performance Boosting Through Promptscited by 34
  10. 2020DeepFL-IQA: Weak Supervision for Deep IQA Feature Learningcited by 29
  11. 2022Doubly Right Object Recognition: A Why Prompt for Visual Rationalescited by 29
  12. 2019A deep Convolutional Neural Network for topology optimization with strong generalization abilitycited by 16
  13. 2022Rectify ViT Shortcut Learning by Visual Saliencycited by 14
  14. 2024ECOR: Explainable CLIP for Object Recognitioncited by 4
  15. 2020Towards a Video Quality Assessment based Framework for Enhancement of Laparoscopic Videoscited by 3
  16. 2021Residual Networks based Distortion Classification and Ranking for Laparoscopic Image Quality Assessmentcited by 3
  17. 2022A Neural Network based Framework for Effective Laparoscopic Video Quality Assessmentcited by 2
  18. 2023Collaborative Auto-encoding for Blind Image Quality Assessmentcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Parameter-Efficient Adaptation of a Multi-Stream Vision-Language Framework for Blind Image Quality Assessment
  2. 2026DR.Experts: Differential Refinement of Distortion-Aware Experts for Blind Image Quality Assessment
  3. 2024Vision Language Modeling of Content, Distortion and Appearance for Image Quality Assessment
  4. 2025Investigate the Low-level Visual Perception in Vision-Language based Image Quality Assessment
  5. 2026Understanding Pure Textual Reasoning for Blind Image Quality Assessment
  6. 2025Building Reasonable Inference for Vision-Language Models in Blind Image Quality Assessment
  7. 2024ATTIQA: Generalizable Image Quality Feature Extractor using Attribute-aware Pretraining
  8. 2024Feature Denoising Diffusion Model for Blind Image Quality Assessment