mlsanityData to 7 Oct 2026

Parameter-Efficient Adaptation of mPLUG-Owl2 via Pixel-Level Visual Prompts for NR-IQA

arXiv 2509.03494 ↗First posted 3 Sep 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose a novel parameter-efficient adaptation method for No- Reference Image Quality Assessment (NR-IQA) using visual prompts optimized in pixel-space. Unlike full fine-tuning of Multimodal Large Language Models (MLLMs), our approach trains only 600K parameters at most (< 0.01% of the base model), while keeping the underlying model fully frozen. During inference, these visual prompts are combined with images via addition and processed by mPLUG-Owl2 with the textual query "Rate the technical quality of the image." Evaluations across distortion types (synthetic, realistic, AI-generated) on KADID- 10k, KonIQ-10k, and AGIQA-3k demonstrate competitive performance against full finetuned methods and specialized NR-IQA models, achieving 0.93 SRCC on KADID-10k. To our knowledge, this is the first work to leverage pixel-space visual prompts for NR-IQA, enabling efficient MLLM adaptation for low-level vision tasks. The source code is publicly available at https: // github. com/ yahya-ben/ mplug2-vp-for-nriqa.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 34 references that are in the map. First posted on arXiv 3 Sep 2025.

Builds on

28 of 34 references.

References · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  3. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  4. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  5. 2023A Survey on Multimodal Large Language Modelscited by 898
  6. 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 545
  7. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  8. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  9. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
  10. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
  11. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
  12. 2022Exploring Visual Prompts for Adapting Large-Scale Modelscited by 271
16 more
  1. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
  2. 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
  3. 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
  4. 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
  5. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  6. 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
  7. 2020Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wildcited by 134
  8. 2021Image Quality Assessment using Contrastive Learningcited by 95
  9. 2022Understanding and Improving Visual Prompting: A Label-Mapping Perspectivecited by 86
  10. 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessmentcited by 43
  11. 2025A Survey of Automatic Prompt Engineering: An Optimization Perspectivecited by 41
  12. 2022Unleashing the Power of Visual Prompting At the Pixel Levelcited by 37
  13. 2023AutoVP: An Automated Visual Prompting Framework and Benchmarkcited by 29
  14. 2025Q-Adapt: Adapting LMM for Visual Quality Assessment with Progressive Instruction Tuningcited by 6
  15. 2024Robust Adaptation of Foundation Models with Black-Box Visual Promptingcited by 3
  16. 2024Multi-Modal Prompt Learning on Blind Image Quality Assessmentcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Revisiting Vision Language Foundations for No-Reference Image Quality Assessment
  2. 2024Few-Shot Image Quality Assessment via Adaptation of Vision-Language Models
  3. 2024ATTIQA: Generalizable Image Quality Feature Extractor using Attribute-aware Pretraining
  4. 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Compare
  5. 2023Learning Generalizable Perceptual Representations for Data-Efficient No-Reference Image Quality Assessment
  6. 2024Grounding-IQA: Grounding Multimodal Language Model for Image Quality Assessment
  7. 2026Zoom-IQA: Image Quality Assessment with Reliable Region-Aware Reasoning
  8. 2025Revisiting MLLM Based Image Quality Assessment: Errors and Remedy