IQA-Spider: Unifying Multi-Granularity Image Quality Assessment with Reasoning, Grounding and Referring
Not on the map. Why?
Abstract (arXiv)
We present IQA-Spider, the first image quality assessment (IQA) framework that unifies reasoning, grounding, and referring into a single LMM-based framework for multi-granularity quality understanding. Existing LMM-based IQA methods typically support only partial perception dimensions, such as quality description and question answering~(textiti.e., reasoning) or pixel-level grounding. This limitation largely stems from the absence of (i) a unified task and data formulation and (ii) effective optimization paradigms for multi-granularity learning. To address these limitations, we formulate a rigorous four-task paradigm covering global and local quality description, pixel-level grounding, and region-level referring. Based on this formulation, we construct a corresponding IQA dataset with a scalable and automatic annotation pipeline, thereby providing a solid foundation for unified multi-granularity learning. To further enable unified perception, we adopt a conflict-free two-stage design that progressively extends text-level multi-granularity understanding to pixel-level grounding: (i) the first stage equips the model with fine-grained text-level reasoning across multiple IQA tasks, and (ii) the second stage introduces a training-free text-to-point grounding paradigm, which bridges textual semantics and pixel-level perception by mapping token logits to spatial coordinates. Based on these efforts, we achieve IQA-Spider with unified multi-granularity explainable image quality assessment. Extensive experiments across multiple benchmarks demonstrate strong performance, validating the effectiveness and versatility of the proposed formulation and framework.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 40 of its 49 references that are in the map. First posted on arXiv 23 May 2026.
Builds on
40 of 49 references.
References · 40
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Segment Anythingcited by 8,234
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
28 more
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 547
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 509
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
- 2023InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Compositioncited by 297
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 222
- 2023LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmarkcited by 169
- 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 159
- 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 154
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
- 2024Towards Open-ended Visual Quality Comparisoncited by 85
- 2024Text4Seg: Reimagining Image Segmentation as Text Generationcited by 61
- 2024LaSagnA: Language-based Segmentation Assistant for Complex Queriescited by 55
- 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessmentcited by 43
- 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
- 2024F-LMM: Grounding Frozen Large Multimodal Modelscited by 34
- 2024Q-Ground: Image Quality Grounding with Large Multi-modality Modelscited by 30
- 20242AFC Prompting of Large Multimodal Models for Image Quality Assessmentcited by 20
- 2024Grounding-IQA: Grounding Multimodal Language Model for Image Quality Assessmentcited by 12
- 2025Q-Adapt: Adapting LMM for Visual Quality Assessment with Progressive Instruction Tuningcited by 6
- 20253DGS-IEval-15K: A Large-scale Image Quality Evaluation Database for 3D Gaussian-Splattingcited by 6
- 2025Image Quality Assessment for Embodied AIcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.