mlsanityData to 14 Oct 2026

Evaluating Vision-Language Models for Image Quality Assessment using Psychophysical Data

arXiv 2603.24578 ↗First posted 25 Mar 2026cs.CV eess.IVcited by 0

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

Abstract (arXiv)

Psychophysical experiments remain the most reliable approach for perceptual image quality assessment (IQA), yet their cost and limited scalability motivate automated alternatives. This paper investigates whether Vision-Language Models (VLMs) can assist in assessing perceived image appearance and quality. We introduce a psychophysics-inspired framework to probe VLM perceptual sensitivity through controlled pairwise image comparisons of contrast, colorfulness, and overall preference. Six VLMs (four proprietary and two open-weight models) are compared against psychophysical data. Results reveal strong attribute-dependent variability: Claude exhibits the highest internal consistency, whereas GPT achieves the strongest agreement for overall preference. Claude and Qwen show the strongest alignment for colorfulness, while Qwen performs best for contrast. However, no model consistently matches human perception across all attributes. High self-consistency does not necessarily imply perceptual validity, and VLM--human agreement generally improves when perceptual differences among renderings are more pronounced.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 3 of its 26 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

3 of 26 references.

References · 3

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2016Perceptual Quality Prediction on Authentically Distorted Images Using a Bag of Features Approachcited by 71
  3. 2023Perceptual Tone Mapping Model for High Dynamic Range Imagingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessment
  2. 2024VisualCritic: Making LMMs Perceive Visual Quality Like Humans
  3. 2024Evaluating Model Perception of Color Illusions in Photorealistic Scenes
  4. 2025Investigate the Low-level Visual Perception in Vision-Language based Image Quality Assessment
  5. 2025From Pixels to Feelings: Aligning MLLMs with Human Cognitive Perception of Images
  6. 2024UniQA: Unified Vision-Language Pre-training for Image Quality and Aesthetic Assessment
  7. 2026Can Vision Language Models Assess Graphic Design Aesthetics? A Benchmark, Evaluation, and Dataset Perspective
  8. 2024Towards Open-ended Visual Quality Comparison