VQAThinker: Exploring Generalizable and Explainable Video Quality Assessment via Reinforcement Learning
On the map: Deep reinforcement learning methods → RL training of language and agent models
Abstract (arXiv)
Video quality assessment (VQA) aims to objectively quantify perceptual quality degradation in alignment with human visual perception. Despite recent advances, existing VQA models still suffer from two critical limitations: textitpoor generalization to out-of-distribution (OOD) videos and textitlimited explainability, which restrict their applicability in real-world scenarios. To address these challenges, we propose VQAThinker, a reasoning-based VQA framework that leverages large multimodal models (LMMs) with reinforcement learning to jointly model video quality understanding and scoring, emulating human perceptual decision-making. Specifically, we adopt group relative policy optimization (GRPO), a rule-guided reinforcement learning algorithm that enables reasoning over video quality under score-level supervision, and introduce three VQA-specific rewards: (1) a bell-shaped regression reward that increases rapidly as the prediction error decreases and becomes progressively less sensitive near the ground truth; (2) a pairwise ranking reward that guides the model to correctly determine the relative quality between video pairs; and (3) a temporal consistency reward that encourages the model to prefer temporally coherent videos over their perturbed counterparts. Extensive experiments demonstrate that VQAThinker achieves state-of-the-art performance on both in-domain and OOD VQA benchmarks, showing strong generalization for video quality scoring. Furthermore, evaluations on video quality understanding tasks validate its superiority in distortion attribution and quality description compared to existing explainable VQA models and LMMs. These findings demonstrate that reinforcement learning offers an effective pathway toward building generalizable and explainable VQA models solely with score-level supervision.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 31 of its 52 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
31 of 52 references.
References · 31
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
19 more
- 2019Quality Assessment of In-the-Wild Videoscited by 164
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
- 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
- 2018Large-Scale Study of Perceptual Video Qualitycited by 127
- 2019YouTube UGC Dataset for Video Compression Researchcited by 124
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
- 2021Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perceptioncited by 97
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
- 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 79
- 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
- 2024Perceptual Video Quality Assessment: A Surveycited by 43
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
- 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
- 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learningcited by 26
- 2020Subjective and Objective Quality Assessment of High Frame Rate Videoscited by 24
- 2023VDPVE: VQA Dataset for Perceptual Video Enhancementcited by 22
- 2023Study of Subjective and Objective Quality Assessment of Mobile Cloud Gaming Videoscited by 10
- 2024QPT V2: Masked Image Modeling Advances Visual Scoringcited by 8
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026EEmo-Logic: A Unified Dataset and Multi-Stage Framework for Comprehensive Image-Evoked Emotion Assessmentcited by 4
- 2026AesRM: Improving Video Aesthetics with Expert-Level Feedbackcited by 3
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentationcited by 2
- 2026Q-DeepSight: Incentivizing Thinking with Images for Image Quality Assessment and Refinementcited by 0
- 2026GameScope: A Multi-Attribute, Multi-Codec Benchmark Dataset for Gaming Video Quality Assessmentcited by 0
- 2026VersusQ: Pairwise Margin Reasoning for Generalizable Video Quality Assessmentcited by 0
- 2026LEIQ-Assessor: Multi-dimensional Quality Assessment of Low-light Enhanced Images via Multi-task Learningcited by 0
- 2026DroneIQA-VLE: Multi-Task Drone Image Quality Assessment via Vision-Language Ensemblecited by 0
- 2026CompressedVQA-AEV: Full-Reference and No-Reference Quality Assessment Models for Asymmetric Encoded Videoscited by 0
- 2026SemABR: Measuring Video Semantic Fidelity with Multimodal LLMs for Adaptive Bitrate Streamingcited by 0
- 2026SemABR: Measuring Video Semantic Fidelity with Multimodal LLMs for Adaptive Bitrate Streaming16 Sep 2026
- 2026CompressedVQA-AEV: Full-Reference and No-Reference Quality Assessment Models for Asymmetric Encoded Videos6 Jul 2026
- 2026DroneIQA-VLE: Multi-Task Drone Image Quality Assessment via Vision-Language Ensemble1 Jul 2026
- 2026LEIQ-Assessor: Multi-dimensional Quality Assessment of Low-light Enhanced Images via Multi-task Learning29 Jun 2026
- 2026VersusQ: Pairwise Margin Reasoning for Generalizable Video Quality Assessment20 May 2026
- 2026GameScope: A Multi-Attribute, Multi-Codec Benchmark Dataset for Gaming Video Quality Assessment2 May 2026
- 2026AesRM: Improving Video Aesthetics with Expert-Level Feedback30 Apr 2026
- 2026Q-DeepSight: Incentivizing Thinking with Images for Image Quality Assessment and Refinement18 Apr 2026
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentation3 Feb 2026
- 2026EEmo-Logic: A Unified Dataset and Multi-Stage Framework for Comprehensive Image-Evoked Emotion Assessment1 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment
- 2026DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessment
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation
- 2025Q-Ponder: A Unified Training Pipeline for Reasoning-based Visual Quality Assessment
- 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessment
- 2025Towards Unified Video Quality Assessment
- 2026Q-Tacit: Image Quality Assessment via Latent Visual Reasoning
- 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Models