mlsanityData to 14 Oct 2026

VQAThinker: Exploring Generalizable and Explainable Video Quality Assessment via Reinforcement Learning

arXiv 2508.06051 ↗First posted 8 Aug 2025cs.CVcited by 10

On the map: Deep reinforcement learning methods → RL training of language and agent models

Abstract (arXiv)

Video quality assessment (VQA) aims to objectively quantify perceptual quality degradation in alignment with human visual perception. Despite recent advances, existing VQA models still suffer from two critical limitations: textitpoor generalization to out-of-distribution (OOD) videos and textitlimited explainability, which restrict their applicability in real-world scenarios. To address these challenges, we propose VQAThinker, a reasoning-based VQA framework that leverages large multimodal models (LMMs) with reinforcement learning to jointly model video quality understanding and scoring, emulating human perceptual decision-making. Specifically, we adopt group relative policy optimization (GRPO), a rule-guided reinforcement learning algorithm that enables reasoning over video quality under score-level supervision, and introduce three VQA-specific rewards: (1) a bell-shaped regression reward that increases rapidly as the prediction error decreases and becomes progressively less sensitive near the ground truth; (2) a pairwise ranking reward that guides the model to correctly determine the relative quality between video pairs; and (3) a temporal consistency reward that encourages the model to prefer temporally coherent videos over their perturbed counterparts. Extensive experiments demonstrate that VQAThinker achieves state-of-the-art performance on both in-domain and OOD VQA benchmarks, showing strong generalization for video quality scoring. Furthermore, evaluations on video quality understanding tasks validate its superiority in distortion attribution and quality description compared to existing explainable VQA models and LMMs. These findings demonstrate that reinforcement learning offers an effective pathway toward building generalizable and explainable VQA models solely with score-level supervision.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 31 of its 52 references that are in the map. First posted on arXiv 8 Aug 2025.

Builds on

31 of 52 references.

References · 31

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  4. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  5. 2018SlowFast Networks for Video Recognitioncited by 1,867
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  7. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  8. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  9. 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
  10. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
  11. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
  12. 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
19 more
  1. 2019Quality Assessment of In-the-Wild Videoscited by 164
  2. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  3. 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
  4. 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 129
  5. 2018Large-Scale Study of Perceptual Video Qualitycited by 127
  6. 2019YouTube UGC Dataset for Video Compression Researchcited by 124
  7. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
  8. 2021Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perceptioncited by 97
  9. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
  10. 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 79
  11. 2023Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approachcited by 45
  12. 2024Perceptual Video Quality Assessment: A Surveycited by 43
  13. 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
  14. 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
  15. 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learningcited by 26
  16. 2020Subjective and Objective Quality Assessment of High Frame Rate Videoscited by 24
  17. 2023VDPVE: VQA Dataset for Perceptual Video Enhancementcited by 22
  18. 2023Study of Subjective and Objective Quality Assessment of Mobile Cloud Gaming Videoscited by 10
  19. 2024QPT V2: Masked Image Modeling Advances Visual Scoringcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment
  2. 2026DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessment
  3. 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation
  4. 2025Q-Ponder: A Unified Training Pipeline for Reasoning-based Visual Quality Assessment
  5. 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessment
  6. 2025Towards Unified Video Quality Assessment
  7. 2026Q-Tacit: Image Quality Assessment via Latent Visual Reasoning
  8. 2024LMM-VQA: Advancing Video Quality Assessment with Large Multimodal Models