PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
Visual Quality Assessment (QA) seeks to predict human perceptual judgments of visual fidelity. While recent multimodal large language models (MLLMs) show promise in reasoning about image and video quality, existing approaches mainly rely on supervised fine-tuning or rank-only objectives, resulting in shallow reasoning, poor score calibration, and limited cross-domain generalization. We propose PreResQ-R1, a Preference-Response Disentangled Reinforcement Learning framework that unifies absolute score regression and relative ranking consistency within a single reasoning-driven optimization scheme. Unlike prior QA methods, PreResQ-R1 introduces a dual-branch reward formulation that separately models intra-sample response coherence and inter-sample preference alignment, optimized via Group Relative Policy Optimization (GRPO). This design encourages fine-grained, stable, and interpretable chain-of-thought reasoning about perceptual quality. To extend beyond static imagery, we further design a global-temporal and local-spatial data flow strategy for Video Quality Assessment. Remarkably, with reinforcement fine-tuning on only 6K images and 28K videos, PreResQ-R1 achieves state-of-the-art results across 10 IQA and 5 VQA benchmarks under both SRCC and PLCC metrics, surpassing by margins of 5.30% and textbf2.15% in IQA task, respectively. Beyond quantitative gains, it produces human-aligned reasoning traces that reveal the perceptual cues underlying quality judgments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 66 references that are in the map. First posted on arXiv 7 Nov 2025.
Builds on
32 of 66 references.
Closest ancestors · 2
Same direction, newest first
- 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rank20 May
- 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuning6 May
Other references · 30
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 302
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
- 2025Improving Video Generation with Human Feedbackcited by 284
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 223
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 209
18 more
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 178
- 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 151
- 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
- 2020Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wildcited by 134
- 2024RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinesscited by 131
- 2018Large-Scale Study of Perceptual Video Qualitycited by 127
- 2019YouTube UGC Dataset for Video Compression Researchcited by 124
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generationcited by 108
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
- 2024Adaptive Image Quality Assessment via Teaching Large Multimodal Model to Comparecited by 66
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
- 2025Toward Generalized Image Quality Assessment: Relaxing the Perfect Reference Quality Assumptioncited by 35
- 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learningcited by 26
- 2024PhoCoLens: Photorealistic and Consistent Reconstruction in Lensless Imagingcited by 13
- 2023Prompt-based test-time real image dehazing: a novel pipelinecited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025VQAThinker: Exploring Generalizable and Explainable Video Quality Assessment via Reinforcement Learning
- 2026Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessment
- 2025Q-Ponder: A Unified Training Pipeline for Reasoning-based Visual Quality Assessment
- 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessment
- 2026Multi-Granularity Reasoning for Image Quality Assessment via Attribute-Aware Reinforcement Learning to Rank
- 2026Q-Tacit: Image Quality Assessment via Latent Visual Reasoning
- 2026Q-Probe: Scaling Image Quality Assessment to High Resolution via Context-Aware Agentic Probing
- 2026Q-DeepSight: Incentivizing Thinking with Images for Image Quality Assessment and Refinement