mlsanityData to 14 Oct 2026

IQA-Spider: Unifying Multi-Granularity Image Quality Assessment with Reasoning, Grounding and Referring

arXiv 2605.24553 ↗First posted 23 May 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

We present IQA-Spider, the first image quality assessment (IQA) framework that unifies reasoning, grounding, and referring into a single LMM-based framework for multi-granularity quality understanding. Existing LMM-based IQA methods typically support only partial perception dimensions, such as quality description and question answering~(textiti.e., reasoning) or pixel-level grounding. This limitation largely stems from the absence of (i) a unified task and data formulation and (ii) effective optimization paradigms for multi-granularity learning. To address these limitations, we formulate a rigorous four-task paradigm covering global and local quality description, pixel-level grounding, and region-level referring. Based on this formulation, we construct a corresponding IQA dataset with a scalable and automatic annotation pipeline, thereby providing a solid foundation for unified multi-granularity learning. To further enable unified perception, we adopt a conflict-free two-stage design that progressively extends text-level multi-granularity understanding to pixel-level grounding: (i) the first stage equips the model with fine-grained text-level reasoning across multiple IQA tasks, and (ii) the second stage introduces a training-free text-to-point grounding paradigm, which bridges textual semantics and pixel-level perception by mapping token logits to spatial coordinates. Based on these efforts, we achieve IQA-Spider with unified multi-granularity explainable image quality assessment. Extensive experiments across multiple benchmarks demonstrate strong performance, validating the effectiveness and versatility of the proposed formulation and framework.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 40 of its 49 references that are in the map. First posted on arXiv 23 May 2026.

Builds on

40 of 49 references.

References · 40

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2023Segment Anythingcited by 8,234
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  6. 2025Qwen3-VL Technical Reportcited by 2,793
  7. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  8. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  9. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  10. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  11. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  12. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
28 more
  1. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
  2. 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 547
  3. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  4. 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 509
  5. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  6. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
  7. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
  8. 2023InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Compositioncited by 297
  9. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
  10. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
  11. 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 222
  12. 2023LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmarkcited by 169
  13. 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 159
  14. 2023GSVA: Generalized Segmentation via Multimodal Large Language Modelscited by 154
  15. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  16. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
  17. 2024Towards Open-ended Visual Quality Comparisoncited by 85
  18. 2024Text4Seg: Reimagining Image Segmentation as Text Generationcited by 61
  19. 2024LaSagnA: Language-based Segmentation Assistant for Complex Queriescited by 55
  20. 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessmentcited by 43
  21. 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
  22. 2024F-LMM: Grounding Frozen Large Multimodal Modelscited by 34
  23. 2024Q-Ground: Image Quality Grounding with Large Multi-modality Modelscited by 30
  24. 20242AFC Prompting of Large Multimodal Models for Image Quality Assessmentcited by 20
  25. 2024Grounding-IQA: Grounding Multimodal Language Model for Image Quality Assessmentcited by 12
  26. 2025Q-Adapt: Adapting LMM for Visual Quality Assessment with Progressive Instruction Tuningcited by 6
  27. 20253DGS-IEval-15K: A Large-scale Image Quality Evaluation Database for 3D Gaussian-Splattingcited by 6
  28. 2025Image Quality Assessment for Embodied AIcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.