Revisiting MLLM Based Image Quality Assessment: Errors and Remedy
On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment
Abstract (arXiv)
The rapid progress of multi-modal large language models (MLLMs) has boosted the task of image quality assessment (IQA). However, a key challenge arises from the inherent mismatch between the discrete token outputs of MLLMs and the continuous nature of quality scores required by IQA tasks. This discrepancy significantly hinders the performance of MLLM-based IQA methods. Previous approaches that convert discrete token predictions into continuous scores often suffer from conversion errors. Moreover, the semantic confusion introduced by level tokens (e.g., ``good'') further constrains the performance of MLLMs on IQA tasks and degrades their original capabilities for related tasks. To tackle these problems, we provide a theoretical analysis of the errors inherent in previous approaches and, motivated by this analysis, propose a simple yet effective framework, Q-Scorer. This framework incorporates a lightweight regression module and IQA-specific score tokens into the MLLM pipeline. Extensive experiments demonstrate that Q-Scorer achieves state-of-the-art performance across multiple IQA benchmarks, generalizes well to mixed datasets, and further improves when combined with other methods.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 27 of its 44 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
27 of 44 references.
Closest ancestors · 5
Same direction, newest first
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distribution20 Jan
- 2024SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuning15 Nov
- 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Compare29 May
- 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Dataset29 May
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Models14 Dec
Other references · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 547
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2017NIMA: Neural Image Assessmentcited by 389
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 302
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
10 more
- 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 225
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 151
- 2020Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wildcited by 134
- 2021Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessmentcited by 41
- 2024Q-Ground: Image Quality Grounding with Large Multi-modality Modelscited by 30
- 2022Quality Assessment of Image Super-Resolution: Balancing Deterministic and Statistical Fidelitycited by 24
- 2024CLIP-AGIQA: Boosting the Performance of AI-Generated Image Quality Assessment with CLIPcited by 14
- 2025HandEval: Taking the First Step Towards Hand Quality Evaluation in Generated Imagescited by 3
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessmentcited by 1
- 2026Clearer Sight, Fewer Lies: Oriented Pickup Preference Optimization for Multimodal Hallucination Mitigationcited by 1
- 2026VGIF-Score: Interpretable and Diagnostic Evaluation of Spatio-Temporal Instruction Following in Video Generationcited by 1
- 2026An Evolutionary Agentic Approach for Open-ended Image Quality Perceptioncited by 1
- 2026RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modelingcited by 1
- 2026Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessmentcited by 0
- 2026SenseBench: A Benchmark for Remote Sensing Low-Level Visual Perception and Description in Large Vision-Language Modelscited by 0
- 2026RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modeling19 Sep 2026
- 2026An Evolutionary Agentic Approach for Open-ended Image Quality Perception19 Sep 2026
- 2026VGIF-Score: Interpretable and Diagnostic Evaluation of Spatio-Temporal Instruction Following in Video Generation15 Jul 2026
- 2026Clearer Sight, Fewer Lies: Oriented Pickup Preference Optimization for Multimodal Hallucination Mitigation29 Jun 2026
- 2026SenseBench: A Benchmark for Remote Sensing Low-Level Visual Perception and Description in Large Vision-Language Models11 May 2026
- 2026Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessment14 Apr 2026
- 2026Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessment30 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025iDETEX: Empowering MLLMs for Intelligent DETailed EXplainable IQA
- 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessment
- 2024Grounding-IQA: Grounding Multimodal Language Model for Image Quality Assessment
- 2026Zoom-IQA: Image Quality Assessment with Reliable Region-Aware Reasoning
- 2026Decoupling Perception and Calibration: Label-Efficient Image Quality Assessment Framework
- 2026ME-IQA: Memory-Enhanced Image Quality Assessment via Re-Ranking
- 2024Dog-IQA: Standard-guided Zero-shot MLLM for Mix-grained Image Quality Assessment
- 2023Q-Boost: On Visual Quality Assessment Ability of Low-level Multi-Modality Foundation Models