mlsanityData to 14 Oct 2026

Q-Save: Towards Scoring and Attribution for Generated Video Evaluation

arXiv 2511.18825 ↗First posted 24 Nov 2025cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Evaluating AI-generated video (AIGV) quality hinges on three crucial dimensions: visual quality, dynamic quality, and text-video alignment. While numerous evaluation datasets and algorithms have been proposed, existing approaches are constrained by two limitations: the absence of systematic definitions for evaluation dimensions, and the isolated treatment of the three dimensions in separate models. Therefore, we introduce Q-Save, a holistic benchmark dataset and unified evaluation model for AIGV quality assessment. The Q-Save dataset contains nearly 10,000 video samples, each annotated with Mean Opinion Scores (MOS) and fine-grained attribution explanations across the three core dimensions. Leveraging this attribution-annotated dataset, we train the proposed Q-Save model, which adopts the SlowFast framework to balance accuracy and efficiency, and employs a three-stage training strategy with Chain-of-Thought (COT) formatted data: Supervised Fine-Tuning (SFT), Grouped Relative Policy Optimization (GRPO), and a final SFT round for stability, to jointly perform quality scoring and attribution generation. Experimental results demonstrate that Q-Save achieves superior performance in AIGV quality prediction while providing interpretable justifications. Code and dataset will be released upon publication.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 45 of its 66 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

45 of 66 references.

References · 45

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2017Deep reinforcement learning from human preferencescited by 3,912
  3. 2016Improved Techniques for Training GANscited by 2,970
  4. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  5. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  6. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  8. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  9. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
  10. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  11. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  12. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
33 more
  1. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  2. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  3. 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 575
  4. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  5. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  6. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  7. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
  8. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
  9. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
  10. 2018A Note on the Inception Scorecited by 226
  11. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
  12. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
  13. 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
  14. 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
  15. 2023Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generationcited by 171
  16. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  17. 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
  18. 2023Rich Human Feedback for Text-to-Image Generationcited by 141
  19. 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 135
  20. 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 119
  21. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
  22. 2023AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondencecited by 61
  23. 2024LiFT: Leveraging Human Feedback for Text-to-Video Model Alignmentcited by 53
  24. 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?cited by 39
  25. 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
  26. 2024AIGIQA-20K: A Large Database for AI-Generated Image Quality Assessmentcited by 33
  27. 2024GAIA: Rethinking Action Quality Assessment for AI-Generated Videoscited by 30
  28. 2024Quality Assessment in the Era of Large Models: A Surveycited by 26
  29. 2023Exploring the Naturalness of AI-Generated Imagescited by 22
  30. 2023Q-Boost: On Visual Quality Assessment Ability of Low-level Multi-Modality Foundation Modelscited by 22
  31. 2024Q-Refine: A Perceptual Quality Refiner for AI-Generated Imagecited by 21
  32. 2024NTIRE 2024 Quality Assessment of AI-Generated Content Challengecited by 20
  33. 2024LMM-PCQA: Assisting Point Cloud Quality Assessment with LMMcited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AIGVE-MACS: Unified Multi-Aspect Commenting and Scoring Model for AI-Generated Video Evaluation
  2. 2024AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMM
  3. 2025Towards Holistic Visual Quality Assessment of AI-Generated Videos: A LLM-Based Multi-Dimensional Evaluation Model
  4. 2025LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretation
  5. 2026Multi-Dimensional Quality Assessment for AI-Generated Human-Centric Videos: Dataset and Model
  6. 2025VideoScore2: Think before You Score in Generative Video Evaluation
  7. 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learning
  8. 2024Subjective-Aligned Dataset and Metric for Text-to-Video Quality Assessment