mlsanityData to 7 Oct 2026

Parameter-Efficient Adaptation of a Multi-Stream Vision-Language Framework for Blind Image Quality Assessment

arXiv 2606.02002 ↗First posted 1 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Blind image quality assessment (BIQA) predicts perceived image quality without access to a pristine reference and is fundamental to applications such as image compression, transmission, and restoration. Recent BIQA methods increasingly rely on large vision-language models (VLMs). Although frozen VLMs provide an efficient alternative to computationally expensive full fine-tuning, it remains unclear how much performance is sacrificed by not adapting the backbone and, more importantly, under what conditions such adaptation is truly beneficial. Answering this question, however, is complicated by the widespread use of image-level splitting on synthetic-distortion benchmarks, where distorted versions of the same reference image can appear in both training and test partitions. This content overlap artificially inflates the apparent performance of frozen representations, masking their true generalization ability and potentially leading to incorrect conclusions about the value of backbone adaptation. We therefore address these two issues jointly. We develop an efficient BIQA framework that fuses a natural-scene-statistics descriptor with frozen SigLIP and CLIP-H embeddings through a lightweight regression head, and then apply parameter-efficient Low-Rank Adaptation (LoRA) to the SigLIP backbone, training only 0.23% of its parameters. Evaluating both frozen and adapted models across six datasets under image-level and reference-level protocols, we find that image-level splitting inflates frozen-feature SROCC by up to 0.44 and masks wide variation in true difficulty, which reference-level evaluation reveals. Under this content-independent protocol, LoRA adaptation recovers performance in proportion to the exposed difficulty, with the largest gains where frozen features generalize poorly (up to +0.357 SROCC on TID2013) and little benefit where they are already strong.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 47 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

29 of 47 references.

References · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  6. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  7. 2022Visual Prompt Tuningcited by 1,674
  8. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  9. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  10. 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 740
  11. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  12. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
17 more
  1. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 351
  2. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
  3. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
  4. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
  5. 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
  6. 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
  7. 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 177
  8. 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
  9. 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
  10. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
  11. 2020Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wildcited by 134
  12. 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
  13. 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 87
  14. 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Comparecited by 66
  15. 2023AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondencecited by 61
  16. 2023Data-Efficient Image Quality Assessment with Attention-Panel Decodercited by 49
  17. 2020Critical analysis on the reproducibility of visual quality assessment using deep featurescited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024ExIQA: Explainable Image Quality Assessment Using Distortion Attributes
  2. 2025Building Reasonable Inference for Vision-Language Models in Blind Image Quality Assessment
  3. 2026DR.Experts: Differential Refinement of Distortion-Aware Experts for Blind Image Quality Assessment
  4. 2025Investigate the Low-level Visual Perception in Vision-Language based Image Quality Assessment
  5. 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation
  6. 2026VLM-RobustBench: A Comprehensive Benchmark for Robustness of Vision-Language Models
  7. 2025DVLTA-VQA: Decoupled Vision-Language Modeling with Text-Guided Adaptation for Blind Video Quality Assessment
  8. 2024Mitigating Perception Bias: A Training-Free Approach to Enhance LMM for Image Quality Assessment