VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Recent advances in AI-generated content (AIGC) have led to the emergence of powerful text-to-video generation models. Despite these successes, evaluating the quality of AIGC-generated videos remains challenging due to limited generalization, lack of temporal awareness, heavy reliance on large-scale annotated datasets, and the lack of effective interaction with generation models. Most current approaches rely on supervised finetuning of vision-language models (VLMs), which often require large-scale annotated datasets and tend to decouple understanding and generation. To address these shortcomings, we propose VQ-Insight, a novel reasoning-style VLM framework for AIGC video quality assessment. Our approach features: (1) a progressive video quality learning scheme that combines image quality warm-up, general task-specific temporal learning, and joint optimization with the video generation model; (2) the design of multi-dimension scoring rewards, preference comparison rewards, and temporal modeling rewards to enhance both generalization and specialization in video quality evaluation. Extensive experiments demonstrate that VQ-Insight consistently outperforms state-of-the-art baselines in preference comparison, multi-dimension scoring, and natural video scoring, bringing significant improvements for video generation tasks.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 32 of its 44 references that are in the map. First posted on arXiv 23 Jun 2025.
Builds on
32 of 44 references.
References · 32
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
20 more
- 2025Improving Video Generation with Human Feedbackcited by 284
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 156
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2020Patch-VQ: 'Patching Up' the Video Quality Problemcited by 147
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
- 2018Large-Scale Study of Perceptual Video Qualitycited by 127
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generationcited by 108
- 2024Video Diffusion Alignment via Reward Gradientscited by 107
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 105
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
- 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuningcited by 90
- 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedbackcited by 87
- 2024GenAI Arena: An Open Evaluation Platform for Generative Modelscited by 82
- 2023Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie Calibrationcited by 74
- 2024LiFT: Leveraging Human Feedback for Text-to-Video Model Alignmentcited by 53
- 2023Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Modelscited by 38
- 2024OmniDrag: Enabling Motion Control for Omnidirectional Image-to-Video Generationcited by 5
Built on by
Citing papers per year: 2025: 8; 2026: 18.
26 papers.
Sort:
By area:
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
- 2025NoHumansRequired: Autonomous High-Quality Image Editing Triplet Miningcited by 33
- 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessmentcited by 18
- 2025VQAThinker: Exploring Generalizable and Explainable Video Quality Assessment via Reinforcement Learningcited by 10
- 2025Reinforcement Learning for Large Model: A Surveycited by 9
- 2025UniShield: An Adaptive Multi-Agent Framework for Unified Forgery Image Detection and Localizationcited by 9
- 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancementcited by 5
- 2026EEmo-Logic: A Unified Dataset and Multi-Stage Framework for Comprehensive Image-Evoked Emotion Assessmentcited by 4
- 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editingcited by 3
- 2026Q-Bench-Portrait: Benchmarking Multimodal Large Language Models on Portrait Image Quality Perceptioncited by 2
- 2026Advances in GRPO for Generation Models: A Surveycited by 2
- 2026MDS-VQA: Model-Informed Data Selection for Video Quality Assessmentcited by 1
14 more
- 2026OARS: Process-Aware Online Alignment for Generative Real-World Image Super-Resolutioncited by 1
- 2026DRM: Diffusion-based Reward Model With Step-wise Guidancecited by 1
- 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Modelscited by 1
- 2025PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessmentcited by 0
- 2026VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thoughtcited by 0
- 2026Comparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessmentcited by 0
- 2026VersusQ: Pairwise Margin Reasoning for Generalizable Video Quality Assessmentcited by 0
- 2026Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Groundingcited by 0
- 2026LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Modelscited by 0
- 2026CoordRefer: Coordinate-Aware 3D Visual Grounding from Multiview Imagescited by 0
- 2026Sample-Adaptive Latent Rewards for Uncertainty-Guided Diffusion Post-Trainingcited by 0
- 2026CodecArena: Codec Quality Assessment via Visual Reinforcement Learningcited by 0
- 2026TryOnReward: Learning Foveated Consistency for Reinforcement Fine-Tuning of Virtual Try-Oncited by 0
- 2026MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videoscited by 0
- 2026MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videos29 Sep 2026
- 2026TryOnReward: Learning Foveated Consistency for Reinforcement Fine-Tuning of Virtual Try-On6 Sep 2026
- 2026CodecArena: Codec Quality Assessment via Visual Reinforcement Learning10 Aug 2026
- 2026Sample-Adaptive Latent Rewards for Uncertainty-Guided Diffusion Post-Training6 Aug 2026
- 2026CoordRefer: Coordinate-Aware 3D Visual Grounding from Multiview Images6 Aug 2026
- 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Models10 Jul 2026
- 2026LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Models1 Jul 2026
- 2026Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Grounding10 Jun 2026
- 2026DRM: Diffusion-based Reward Model With Step-wise Guidance25 May 2026
- 2026VersusQ: Pairwise Margin Reasoning for Generalizable Video Quality Assessment20 May 2026
- 2026Comparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessment18 Apr 2026
- 2026VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thought24 Mar 2026
14 more
- 2026OARS: Process-Aware Online Alignment for Generative Real-World Image Super-Resolution13 Mar 2026
- 2026MDS-VQA: Model-Informed Data Selection for Video Quality Assessment12 Mar 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
- 2026EEmo-Logic: A Unified Dataset and Multi-Stage Framework for Comprehensive Image-Evoked Emotion Assessment1 Feb 2026
- 2026Q-Bench-Portrait: Benchmarking Multimodal Large Language Models on Portrait Image Quality Perception26 Jan 2026
- 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editing5 Jan 2026
- 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancement7 Dec 2025
- 2025PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment7 Nov 2025
- 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessment13 Oct 2025
- 2025UniShield: An Adaptive Multi-Agent Framework for Unified Forgery Image Detection and Localization3 Oct 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Models10 Sep 2025
- 2025Reinforcement Learning for Large Model: A Survey11 Aug 2025
- 2025VQAThinker: Exploring Generalizable and Explainable Video Quality Assessment via Reinforcement Learning8 Aug 2025
- 2025NoHumansRequired: Autonomous High-Quality Image Editing Triplet Mining18 Jul 2025
- 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancementcited by 5
- 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editingcited by 3
- 2026Q-Bench-Portrait: Benchmarking Multimodal Large Language Models on Portrait Image Quality Perceptioncited by 2
- 2026VersusQ: Pairwise Margin Reasoning for Generalizable Video Quality Assessmentcited by 0
- 2026LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Modelscited by 0
- 2026LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Models1 Jul 2026
- 2026VersusQ: Pairwise Margin Reasoning for Generalizable Video Quality Assessment20 May 2026
- 2026Q-Bench-Portrait: Benchmarking Multimodal Large Language Models on Portrait Image Quality Perception26 Jan 2026
- 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editing5 Jan 2026
- 2025UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancement7 Dec 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
- 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessmentcited by 18
- 2026Advances in GRPO for Generation Models: A Surveycited by 2
- 2025PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessmentcited by 0
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
- 2025PreResQ-R1: Response-Preference Disentangled Ranking-and-Scoring Reinforcement Optimization for Robust Visual Quality Assessment7 Nov 2025
- 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessment13 Oct 2025
- 2025A Survey of Reinforcement Learning for Large Reasoning Models10 Sep 2025
- 2026TryOnReward: Learning Foveated Consistency for Reinforcement Fine-Tuning of Virtual Try-On6 Sep 2026
- 2026Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Grounding10 Jun 2026
- 2026OARS: Process-Aware Online Alignment for Generative Real-World Image Super-Resolution13 Mar 2026
- 2025NoHumansRequired: Autonomous High-Quality Image Editing Triplet Miningcited by 33
- 2025UniShield: An Adaptive Multi-Agent Framework for Unified Forgery Image Detection and Localizationcited by 9
- 2026EEmo-Logic: A Unified Dataset and Multi-Stage Framework for Comprehensive Image-Evoked Emotion Assessmentcited by 4
- 2026MDS-VQA: Model-Informed Data Selection for Video Quality Assessmentcited by 1
- 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Modelscited by 1
- 2026Comparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessmentcited by 0
- 2026CoordRefer: Coordinate-Aware 3D Visual Grounding from Multiview Imagescited by 0
- 2026MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videoscited by 0
- 2026MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videos29 Sep 2026
- 2026CoordRefer: Coordinate-Aware 3D Visual Grounding from Multiview Images6 Aug 2026
- 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Models10 Jul 2026
- 2026Comparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessment18 Apr 2026
- 2026MDS-VQA: Model-Informed Data Selection for Video Quality Assessment12 Mar 2026
- 2026EEmo-Logic: A Unified Dataset and Multi-Stage Framework for Comprehensive Image-Evoked Emotion Assessment1 Feb 2026
- 2025UniShield: An Adaptive Multi-Agent Framework for Unified Forgery Image Detection and Localization3 Oct 2025
- 2025NoHumansRequired: Autonomous High-Quality Image Editing Triplet Mining18 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2026VQQA: An Agentic Approach for Video Evaluation and Quality Improvement
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation
- 2026Q-Tacit: Image Quality Assessment via Latent Visual Reasoning
- 2025Towards Holistic Visual Quality Assessment of AI-Generated Videos: A LLM-Based Multi-Dimensional Evaluation Model
- 2026DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessment
- 2025Multilevel Semantic-Aware Model for AI-Generated Video Quality Assessment
- 2025Q-Ponder: A Unified Training Pipeline for Reasoning-based Visual Quality Assessment
- 2026From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models