mlsanityData to 14 Oct 2026

VideoScore2: Think before You Score in Generative Video Evaluation

arXiv 2509.22799 ↗First posted 26 Sep 2025cs.CV cs.AI cs.CLcited by 40

Not on the map. Why?

Abstract (arXiv)

Recent advances in text-to-video generation have produced increasingly realistic and diverse content, yet evaluating such videos remains a fundamental challenge due to their multi-faceted nature encompassing visual quality, semantic alignment, and physical consistency. Existing evaluators and reward models are limited to single opaque scores, lack interpretability, or provide only coarse analysis, making them insufficient for capturing the comprehensive nature of video quality assessment. We present VideoScore2, a multi-dimensional, interpretable, and human-aligned framework that explicitly evaluates visual quality, text-to-video alignment, and physical/common-sense consistency while producing detailed chain-of-thought rationales. Our model is trained on a large-scale dataset VideoFeedback2 containing 27,168 human-annotated videos with both scores and reasoning traces across three dimensions, using a two-stage pipeline of supervised fine-tuning followed by reinforcement learning with Group Relative Policy Optimization (GRPO) to enhance analytical robustness. Extensive experiments demonstrate that VideoScore2 achieves superior performance with 44.35 (+5.94) accuracy on our in-domain benchmark VideoScore-Bench-v2 and 50.37 (+4.32) average performance across four out-of-domain benchmarks (VideoGenReward-Bench, VideoPhy2, etc), while providing interpretable assessments that bridge the gap between evaluation and controllable generation through effective reward modeling for Best-of-N sampling. Project Page: https://tiger-ai-lab.github.io/VideoScore2/

Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Builds on 38 of its 48 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

38 of 48 references.

References · 38

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  6. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  7. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  9. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  10. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  11. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  12. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
26 more
  1. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  2. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  3. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  4. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  5. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
  6. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  7. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  8. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  9. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
  10. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  11. 2025Improving Video Generation with Human Feedbackcited by 284
  12. 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
  13. 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
  14. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
  15. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
  16. 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
  17. 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 131
  18. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
  19. 2025Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Modelscited by 60
  20. 2024LiFT: Leveraging Human Feedback for Text-to-Video Model Alignmentcited by 53
  21. 2024MagicTime: Time-lapse Video Generation Models as Metamorphic Simulatorscited by 51
  22. 2024Subjective-Aligned Dataset and Metric for Text-to-Video Quality Assessmentcited by 39
  23. 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 30
  24. 2025VideoGen-Eval: Agent-based System for Video Generation Evaluationcited by 23
  25. 2025VideoEval-Pro: Robust and Realistic Long Video Understanding Evaluationcited by 21
  26. 2025MJ-VIDEO: Fine-Grained Benchmarking and Rewarding Video Preferences in Video Generationcited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 34.

40 papers.

Sort:

By area:

  1. 2026Speed by Simplicity: A Single-Stream Architecture for Fast Audio-Video Generative Foundation Modelcited by 25
  2. 2025Video Generation Models Are Good Latent Reward Modelscited by 16
  3. 2026Unified Personalized Reward Model for Vision Generationcited by 13
  4. 2026VQQA: An Agentic Approach for Video Evaluation and Quality Improvementcited by 12
  5. 2026PhyGround: Benchmarking Physical Reasoning in Generative World Modelscited by 12
  6. 2025Enhancing Large Language Model Reasoning with Reward Models: An Analytical Surveycited by 8
  7. 2025Benchmarking Scientific Understanding and Reasoning for Video Generation using VideoScience-Benchcited by 7
  8. 2026VisPhyWorld: Probing Physical Reasoning via Code-Driven Video Reconstructioncited by 7
  9. 2026WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictorscited by 6
  10. 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generationcited by 6
  11. 2025A Benchmark for Omni-Modal Reasoning in Long Videoscited by 5
  12. 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agentscited by 5
28 more
  1. 2026RewardHarness: Self-Evolving Agentic Post-Trainingcited by 5
  2. 2026CaC: Advancing Video Reward Models via Hierarchical Spatiotemporal Concentratingcited by 5
  3. 2026SwitchCraft: Training-Free Multi-Event Video Generation with Attention Controlscited by 4
  4. 2026Inference-Time Scaling for Joint Audio-Video Generationcited by 4
  5. 2026Thinking with Frames: Generative Video Distortion Evaluation via Frame Reward Modelcited by 3
  6. 2026MMPhysVideo: Physically Plausible Video Generation Through Joint RGB-Perception Modelingcited by 3
  7. 2026How Far Are Video Models from True Multimodal Reasoning?cited by 2
  8. 2026Think, then Score: Decoupled Reasoning and Scoring for Video Reward Modelingcited by 2
  9. 2026Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domainscited by 2
  10. 2026FIRM-Video: Check Before You Score for Reliable Text-to-Video Reward Modelingcited by 2
  11. 2026Early Failure Detection and Intervention in Video Diffusion Modelscited by 1
  12. 2026AnimationBench: Are Video Models Good at Character-Centric Animation?cited by 1
  13. 2026LoViF 2026 The First Challenge on Holistic Quality Assessment for 4D World Model (PhyScore)cited by 1
  14. 2026SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generationcited by 1
  15. 2026RoboGaze: Evaluating Robot World Models via Structured Vision-Language Analysiscited by 1
  16. 2026Distilling Physical Priors into Streaming World Modelscited by 1
  17. 2026RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modelingcited by 1
  18. 2025Generative Action Tell-Tales: Assessing Human Motion in Synthesized Videoscited by 0
  19. 2025Understanding Virality: A Rubric based Vision-Language Model Framework for Short-Form Edutainment Evaluationcited by 0
  20. 2026Long-CODE: Isolating Pure Long-Context as an Orthogonal Dimension in Video Evaluationcited by 0
  21. 2026Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Groundingcited by 0
  22. 2026Through the PRISM: Preference Representation in Intermediate States of Video Diffusion Modelscited by 0
  23. 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recyclingcited by 0
  24. 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinementcited by 0
  25. 2026WorldReward: Reward Modeling for Camera-Conditioned World Modelscited by 0
  26. 2026PhyProbe: Rethinking Physical Consistency Evaluation in Generated Videoscited by 0
  27. 2026Video Generation Models: A Survey of Post-Training and Alignmentcited by 0
  28. 2026GraftOOD: Grafting Out-of-Distribution Exemplars into Advantage-Weighted Rectification for Video Reward Optimizationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Towards A Better Metric for Text-to-Video Generation
  2. 2025Video-Bench: Human-Aligned Video Generation Benchmark
  3. 2025Score2Instruct: Scaling Up Video Quality-Centric Instructions via Automated Dimension Scoring
  4. 2026VGA-BenchV2: An Expanded Unified Benchmark and Multi-Model Framework for Evaluating Video Aesthetics and Generation Quality
  5. 2025World Consistency Score: A Unified Metric for Video Generation Quality
  6. 2025GRADEO: Towards Human-Like Evaluation for Text-to-Video Generation via Multi-Step Reasoning
  7. 2026VideoArgus: Agentic Rubric-Grounded Unified Evaluation for Video Generation and Editing
  8. 2026UniVBench: Towards Unified Evaluation for Video Foundation Models