Q-Save: Towards Scoring and Attribution for Generated Video Evaluation
Not on the map. Why?
Abstract (arXiv)
Evaluating AI-generated video (AIGV) quality hinges on three crucial dimensions: visual quality, dynamic quality, and text-video alignment. While numerous evaluation datasets and algorithms have been proposed, existing approaches are constrained by two limitations: the absence of systematic definitions for evaluation dimensions, and the isolated treatment of the three dimensions in separate models. Therefore, we introduce Q-Save, a holistic benchmark dataset and unified evaluation model for AIGV quality assessment. The Q-Save dataset contains nearly 10,000 video samples, each annotated with Mean Opinion Scores (MOS) and fine-grained attribution explanations across the three core dimensions. Leveraging this attribution-annotated dataset, we train the proposed Q-Save model, which adopts the SlowFast framework to balance accuracy and efficiency, and employs a three-stage training strategy with Chain-of-Thought (COT) formatted data: Supervised Fine-Tuning (SFT), Grouped Relative Policy Optimization (GRPO), and a final SFT round for stability, to jointly perform quality scoring and attribution generation. Experimental results demonstrate that Q-Save achieves superior performance in AIGV quality prediction while providing interpretable justifications. Code and dataset will be released upon publication.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 45 of its 66 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
45 of 66 references.
References · 45
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2016Improved Techniques for Training GANscited by 2,970
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
33 more
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 575
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2018A Note on the Inception Scorecited by 226
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
- 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 171
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
- 2023Rich Human Feedback for Text-to-Image Generationcited by 141
- 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 135
- 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 119
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
- 2023AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondencecited by 61
- 2024LiFT: Leveraging Human Feedback for Text-to-Video Model Alignmentcited by 53
- 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?cited by 39
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
- 2024AIGIQA-20K: A Large Database for AI-Generated Image Quality Assessmentcited by 33
- 2024GAIA: Rethinking Action Quality Assessment for AI-Generated Videoscited by 30
- 2024Quality Assessment in the Era of Large Models: A Surveycited by 26
- 2023Exploring the Naturalness of AI-Generated Imagescited by 22
- 2023Q-Boost: On Visual Quality Assessment Ability of Low-level Multi-Modality Foundation Modelscited by 22
- 2024Q-Refine: A Perceptual Quality Refiner for AI-Generated Imagecited by 21
- 2024NTIRE 2024 Quality Assessment of AI-Generated Content Challengecited by 20
- 2024LMM-PCQA: Assisting Point Cloud Quality Assessment with LMMcited by 19
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026TAGRPO: Boosting GRPO on Image-to-Video Generation with Direct Trajectory Alignmentcited by 10
- 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agentscited by 5
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generationcited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignmentcited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignment30 Sep 2026
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generation1 Sep 2026
- 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agents9 Mar 2026
- 2026TAGRPO: Boosting GRPO on Image-to-Video Generation with Direct Trajectory Alignment9 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025AIGVE-MACS: Unified Multi-Aspect Commenting and Scoring Model for AI-Generated Video Evaluation
- 2024AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMM
- 2025Towards Holistic Visual Quality Assessment of AI-Generated Videos: A LLM-Based Multi-Dimensional Evaluation Model
- 2025LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretation
- 2026Multi-Dimensional Quality Assessment for AI-Generated Human-Centric Videos: Dataset and Model
- 2025VideoScore2: Think before You Score in Generative Video Evaluation
- 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learning
- 2024Subjective-Aligned Dataset and Metric for Text-to-Video Quality Assessment