Parameter-Efficient Adaptation of mPLUG-Owl2 via Pixel-Level Visual Prompts for NR-IQA
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel parameter-efficient adaptation method for No- Reference Image Quality Assessment (NR-IQA) using visual prompts optimized in pixel-space. Unlike full fine-tuning of Multimodal Large Language Models (MLLMs), our approach trains only 600K parameters at most (< 0.01% of the base model), while keeping the underlying model fully frozen. During inference, these visual prompts are combined with images via addition and processed by mPLUG-Owl2 with the textual query "Rate the technical quality of the image." Evaluations across distortion types (synthetic, realistic, AI-generated) on KADID- 10k, KonIQ-10k, and AGIQA-3k demonstrate competitive performance against full finetuned methods and specialized NR-IQA models, achieving 0.93 SRCC on KADID-10k. To our knowledge, this is the first work to leverage pixel-space visual prompts for NR-IQA, enabling efficient MLLM adaptation for low-level vision tasks. The source code is publicly available at https: // github. com/ yahya-ben/ mplug2-vp-for-nriqa.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 34 references that are in the map. First posted on arXiv 3 Sep 2025.
Builds on
28 of 34 references.
References · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 545
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
- 2022Exploring Visual Prompts for Adapting Large-Scale Modelscited by 271
16 more
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
- 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
- 2020Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wildcited by 134
- 2021Image Quality Assessment using Contrastive Learningcited by 95
- 2022Understanding and Improving Visual Prompting: A Label-Mapping Perspectivecited by 86
- 2024A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessmentcited by 43
- 2025A Survey of Automatic Prompt Engineering: An Optimization Perspectivecited by 41
- 2022Unleashing the Power of Visual Prompting At the Pixel Levelcited by 37
- 2023AutoVP: An Automated Visual Prompting Framework and Benchmarkcited by 29
- 2025Q-Adapt: Adapting LMM for Visual Quality Assessment with Progressive Instruction Tuningcited by 6
- 2024Robust Adaptation of Foundation Models with Black-Box Visual Promptingcited by 3
- 2024Multi-Modal Prompt Learning on Blind Image Quality Assessmentcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Revisiting Vision Language Foundations for No-Reference Image Quality Assessment
- 2024Few-Shot Image Quality Assessment via Adaptation of Vision-Language Models
- 2024ATTIQA: Generalizable Image Quality Feature Extractor using Attribute-aware Pretraining
- 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Compare
- 2023Learning Generalizable Perceptual Representations for Data-Efficient No-Reference Image Quality Assessment
- 2024Grounding-IQA: Grounding Multimodal Language Model for Image Quality Assessment
- 2026Zoom-IQA: Image Quality Assessment with Reliable Region-Aware Reasoning
- 2025Revisiting MLLM Based Image Quality Assessment: Errors and Remedy