VideoScore2: Think before You Score in Generative Video Evaluation
Not on the map. Why?
Abstract (arXiv)
Recent advances in text-to-video generation have produced increasingly realistic and diverse content, yet evaluating such videos remains a fundamental challenge due to their multi-faceted nature encompassing visual quality, semantic alignment, and physical consistency. Existing evaluators and reward models are limited to single opaque scores, lack interpretability, or provide only coarse analysis, making them insufficient for capturing the comprehensive nature of video quality assessment. We present VideoScore2, a multi-dimensional, interpretable, and human-aligned framework that explicitly evaluates visual quality, text-to-video alignment, and physical/common-sense consistency while producing detailed chain-of-thought rationales. Our model is trained on a large-scale dataset VideoFeedback2 containing 27,168 human-annotated videos with both scores and reasoning traces across three dimensions, using a two-stage pipeline of supervised fine-tuning followed by reinforcement learning with Group Relative Policy Optimization (GRPO) to enhance analytical robustness. Extensive experiments demonstrate that VideoScore2 achieves superior performance with 44.35 (+5.94) accuracy on our in-domain benchmark VideoScore-Bench-v2 and 50.37 (+4.32) average performance across four out-of-domain benchmarks (VideoGenReward-Bench, VideoPhy2, etc), while providing interpretable assessments that bridge the gap between evaluation and controllable generation through effective reward modeling for Best-of-N sampling. Project Page: https://tiger-ai-lab.github.io/VideoScore2/
Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Builds on 38 of its 48 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
38 of 48 references.
References · 38
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
26 more
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2025Improving Video Generation with Human Feedbackcited by 284
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
- 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
- 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 131
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 98
- 2025Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Modelscited by 60
- 2024LiFT: Leveraging Human Feedback for Text-to-Video Model Alignmentcited by 53
- 2024MagicTime: Time-lapse Video Generation Models as Metamorphic Simulatorscited by 51
- 2024Subjective-Aligned Dataset and Metric for Text-to-Video Quality Assessmentcited by 39
- 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 30
- 2025VideoGen-Eval: Agent-based System for Video Generation Evaluationcited by 23
- 2025VideoEval-Pro: Robust and Realistic Long Video Understanding Evaluationcited by 21
- 2025MJ-VIDEO: Fine-Grained Benchmarking and Rewarding Video Preferences in Video Generationcited by 16
Built on by
Citing papers per year: 2025: 6; 2026: 34.
40 papers.
Sort:
By area:
- 2026Speed by Simplicity: A Single-Stream Architecture for Fast Audio-Video Generative Foundation Modelcited by 25
- 2025Video Generation Models Are Good Latent Reward Modelscited by 16
- 2026Unified Personalized Reward Model for Vision Generationcited by 13
- 2026VQQA: An Agentic Approach for Video Evaluation and Quality Improvementcited by 12
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Modelscited by 12
- 2025Enhancing Large Language Model Reasoning with Reward Models: An Analytical Surveycited by 8
- 2025Benchmarking Scientific Understanding and Reasoning for Video Generation using VideoScience-Benchcited by 7
- 2026VisPhyWorld: Probing Physical Reasoning via Code-Driven Video Reconstructioncited by 7
- 2026WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictorscited by 6
- 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generationcited by 6
- 2025A Benchmark for Omni-Modal Reasoning in Long Videoscited by 5
- 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agentscited by 5
28 more
- 2026RewardHarness: Self-Evolving Agentic Post-Trainingcited by 5
- 2026CaC: Advancing Video Reward Models via Hierarchical Spatiotemporal Concentratingcited by 5
- 2026SwitchCraft: Training-Free Multi-Event Video Generation with Attention Controlscited by 4
- 2026Inference-Time Scaling for Joint Audio-Video Generationcited by 4
- 2026Thinking with Frames: Generative Video Distortion Evaluation via Frame Reward Modelcited by 3
- 2026MMPhysVideo: Physically Plausible Video Generation Through Joint RGB-Perception Modelingcited by 3
- 2026How Far Are Video Models from True Multimodal Reasoning?cited by 2
- 2026Think, then Score: Decoupled Reasoning and Scoring for Video Reward Modelingcited by 2
- 2026Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domainscited by 2
- 2026FIRM-Video: Check Before You Score for Reliable Text-to-Video Reward Modelingcited by 2
- 2026Early Failure Detection and Intervention in Video Diffusion Modelscited by 1
- 2026AnimationBench: Are Video Models Good at Character-Centric Animation?cited by 1
- 2026LoViF 2026 The First Challenge on Holistic Quality Assessment for 4D World Model (PhyScore)cited by 1
- 2026SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generationcited by 1
- 2026RoboGaze: Evaluating Robot World Models via Structured Vision-Language Analysiscited by 1
- 2026Distilling Physical Priors into Streaming World Modelscited by 1
- 2026RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modelingcited by 1
- 2025Generative Action Tell-Tales: Assessing Human Motion in Synthesized Videoscited by 0
- 2025Understanding Virality: A Rubric based Vision-Language Model Framework for Short-Form Edutainment Evaluationcited by 0
- 2026Long-CODE: Isolating Pure Long-Context as an Orthogonal Dimension in Video Evaluationcited by 0
- 2026Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Groundingcited by 0
- 2026Through the PRISM: Preference Representation in Intermediate States of Video Diffusion Modelscited by 0
- 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recyclingcited by 0
- 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinementcited by 0
- 2026WorldReward: Reward Modeling for Camera-Conditioned World Modelscited by 0
- 2026PhyProbe: Rethinking Physical Consistency Evaluation in Generated Videoscited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignmentcited by 0
- 2026GraftOOD: Grafting Out-of-Distribution Exemplars into Advantage-Weighted Rectification for Video Reward Optimizationcited by 0
- 2026GraftOOD: Grafting Out-of-Distribution Exemplars into Advantage-Weighted Rectification for Video Reward Optimization9 Oct 2026
- 2026Video Generation Models: A Survey of Post-Training and Alignment30 Sep 2026
- 2026PhyProbe: Rethinking Physical Consistency Evaluation in Generated Videos29 Sep 2026
- 2026RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modeling19 Sep 2026
- 2026WorldReward: Reward Modeling for Camera-Conditioned World Models3 Sep 2026
- 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement2 Sep 2026
- 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recycling29 Aug 2026
- 2026FIRM-Video: Check Before You Score for Reliable Text-to-Video Reward Modeling22 Aug 2026
- 2026Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domains10 Aug 2026
- 2026Distilling Physical Priors into Streaming World Models8 Aug 2026
- 2026RoboGaze: Evaluating Robot World Models via Structured Vision-Language Analysis22 Jun 2026
- 2026Through the PRISM: Preference Representation in Intermediate States of Video Diffusion Models18 Jun 2026
28 more
- 2026SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generation10 Jun 2026
- 2026Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Grounding10 Jun 2026
- 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generation8 Jun 2026
- 2026Inference-Time Scaling for Joint Audio-Video Generation2 Jun 2026
- 2026CaC: Advancing Video Reward Models via Hierarchical Spatiotemporal Concentrating12 May 2026
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models11 May 2026
- 2026WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictors11 May 2026
- 2026RewardHarness: Self-Evolving Agentic Post-Training9 May 2026
- 2026Think, then Score: Decoupled Reasoning and Scoring for Video Reward Modeling7 May 2026
- 2026LoViF 2026 The First Challenge on Holistic Quality Assessment for 4D World Model (PhyScore)6 May 2026
- 2026How Far Are Video Models from True Multimodal Reasoning?21 Apr 2026
- 2026Long-CODE: Isolating Pure Long-Context as an Orthogonal Dimension in Video Evaluation19 Apr 2026
- 2026AnimationBench: Are Video Models Good at Character-Centric Animation?16 Apr 2026
- 2026MMPhysVideo: Physically Plausible Video Generation Through Joint RGB-Perception Modeling3 Apr 2026
- 2026Speed by Simplicity: A Single-Stream Architecture for Fast Audio-Video Generative Foundation Model23 Mar 2026
- 2026Early Failure Detection and Intervention in Video Diffusion Models15 Mar 2026
- 2026VQQA: An Agentic Approach for Video Evaluation and Quality Improvement12 Mar 2026
- 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agents9 Mar 2026
- 2026SwitchCraft: Training-Free Multi-Event Video Generation with Attention Controls27 Feb 2026
- 2026VisPhyWorld: Probing Physical Reasoning via Code-Driven Video Reconstruction9 Feb 2026
- 2026Unified Personalized Reward Model for Vision Generation2 Feb 2026
- 2026Thinking with Frames: Generative Video Distortion Evaluation via Frame Reward Model7 Jan 2026
- 2025Understanding Virality: A Rubric based Vision-Language Model Framework for Short-Form Edutainment Evaluation24 Dec 2025
- 2025A Benchmark for Omni-Modal Reasoning in Long Videos18 Dec 2025
- 2025Benchmarking Scientific Understanding and Reasoning for Video Generation using VideoScience-Bench2 Dec 2025
- 2025Generative Action Tell-Tales: Assessing Human Motion in Synthesized Videos1 Dec 2025
- 2025Video Generation Models Are Good Latent Reward Models26 Nov 2025
- 2025Enhancing Large Language Model Reasoning with Reward Models: An Analytical Survey2 Oct 2025
- 2025Enhancing Large Language Model Reasoning with Reward Models: An Analytical Surveycited by 8
- 2026VisPhyWorld: Probing Physical Reasoning via Code-Driven Video Reconstructioncited by 7
- 2025A Benchmark for Omni-Modal Reasoning in Long Videoscited by 5
- 2026Inference-Time Scaling for Joint Audio-Video Generationcited by 4
- 2026How Far Are Video Models from True Multimodal Reasoning?cited by 2
- 2026Think, then Score: Decoupled Reasoning and Scoring for Video Reward Modelingcited by 2
- 2026Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domainscited by 2
- 2025Understanding Virality: A Rubric based Vision-Language Model Framework for Short-Form Edutainment Evaluationcited by 0
- 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recyclingcited by 0
- 2026PhyProbe: Rethinking Physical Consistency Evaluation in Generated Videoscited by 0
- 2026PhyProbe: Rethinking Physical Consistency Evaluation in Generated Videos29 Sep 2026
- 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recycling29 Aug 2026
- 2026Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domains10 Aug 2026
- 2026Inference-Time Scaling for Joint Audio-Video Generation2 Jun 2026
- 2026Think, then Score: Decoupled Reasoning and Scoring for Video Reward Modeling7 May 2026
- 2026How Far Are Video Models from True Multimodal Reasoning?21 Apr 2026
- 2026VisPhyWorld: Probing Physical Reasoning via Code-Driven Video Reconstruction9 Feb 2026
- 2025Understanding Virality: A Rubric based Vision-Language Model Framework for Short-Form Edutainment Evaluation24 Dec 2025
- 2025A Benchmark for Omni-Modal Reasoning in Long Videos18 Dec 2025
- 2025Enhancing Large Language Model Reasoning with Reward Models: An Analytical Survey2 Oct 2025
- 2025Video Generation Models Are Good Latent Reward Modelscited by 16
- 2026Unified Personalized Reward Model for Vision Generationcited by 13
- 2026WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictorscited by 6
- 2026Thinking with Frames: Generative Video Distortion Evaluation via Frame Reward Modelcited by 3
- 2026FIRM-Video: Check Before You Score for Reliable Text-to-Video Reward Modelingcited by 2
- 2026RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modelingcited by 1
- 2026Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Groundingcited by 0
- 2026RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modeling19 Sep 2026
- 2026FIRM-Video: Check Before You Score for Reliable Text-to-Video Reward Modeling22 Aug 2026
- 2026Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Grounding10 Jun 2026
- 2026WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictors11 May 2026
- 2026Unified Personalized Reward Model for Vision Generation2 Feb 2026
- 2026Thinking with Frames: Generative Video Distortion Evaluation via Frame Reward Model7 Jan 2026
- 2025Video Generation Models Are Good Latent Reward Models26 Nov 2025
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Modelscited by 12
- 2026LoViF 2026 The First Challenge on Holistic Quality Assessment for 4D World Model (PhyScore)cited by 1
- 2026RoboGaze: Evaluating Robot World Models via Structured Vision-Language Analysiscited by 1
- 2026Distilling Physical Priors into Streaming World Modelscited by 1
- 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinementcited by 0
- 2026WorldReward: Reward Modeling for Camera-Conditioned World Modelscited by 0
- 2026WorldReward: Reward Modeling for Camera-Conditioned World Models3 Sep 2026
- 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement2 Sep 2026
- 2026Distilling Physical Priors into Streaming World Models8 Aug 2026
- 2026RoboGaze: Evaluating Robot World Models via Structured Vision-Language Analysis22 Jun 2026
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models11 May 2026
- 2026LoViF 2026 The First Challenge on Holistic Quality Assessment for 4D World Model (PhyScore)6 May 2026
- 2026SwitchCraft: Training-Free Multi-Event Video Generation with Attention Controlscited by 4
- 2026MMPhysVideo: Physically Plausible Video Generation Through Joint RGB-Perception Modelingcited by 3
- 2026Early Failure Detection and Intervention in Video Diffusion Modelscited by 1
- 2026SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generationcited by 1
- 2026Through the PRISM: Preference Representation in Intermediate States of Video Diffusion Modelscited by 0
- 2026Through the PRISM: Preference Representation in Intermediate States of Video Diffusion Models18 Jun 2026
- 2026SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generation10 Jun 2026
- 2026MMPhysVideo: Physically Plausible Video Generation Through Joint RGB-Perception Modeling3 Apr 2026
- 2026Early Failure Detection and Intervention in Video Diffusion Models15 Mar 2026
- 2026SwitchCraft: Training-Free Multi-Event Video Generation with Attention Controls27 Feb 2026
- 2026Speed by Simplicity: A Single-Stream Architecture for Fast Audio-Video Generative Foundation Modelcited by 25
- 2025Benchmarking Scientific Understanding and Reasoning for Video Generation using VideoScience-Benchcited by 7
- 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generationcited by 6
- 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agentscited by 5
- 2026AnimationBench: Are Video Models Good at Character-Centric Animation?cited by 1
- 2025Generative Action Tell-Tales: Assessing Human Motion in Synthesized Videoscited by 0
- 2026Long-CODE: Isolating Pure Long-Context as an Orthogonal Dimension in Video Evaluationcited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignmentcited by 0
- 2026GraftOOD: Grafting Out-of-Distribution Exemplars into Advantage-Weighted Rectification for Video Reward Optimizationcited by 0
- 2026GraftOOD: Grafting Out-of-Distribution Exemplars into Advantage-Weighted Rectification for Video Reward Optimization9 Oct 2026
- 2026Video Generation Models: A Survey of Post-Training and Alignment30 Sep 2026
- 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generation8 Jun 2026
- 2026Long-CODE: Isolating Pure Long-Context as an Orthogonal Dimension in Video Evaluation19 Apr 2026
- 2026AnimationBench: Are Video Models Good at Character-Centric Animation?16 Apr 2026
- 2026Speed by Simplicity: A Single-Stream Architecture for Fast Audio-Video Generative Foundation Model23 Mar 2026
- 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agents9 Mar 2026
- 2025Benchmarking Scientific Understanding and Reasoning for Video Generation using VideoScience-Bench2 Dec 2025
- 2025Generative Action Tell-Tales: Assessing Human Motion in Synthesized Videos1 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2024Towards A Better Metric for Text-to-Video Generation
- 2025Video-Bench: Human-Aligned Video Generation Benchmark
- 2025Score2Instruct: Scaling Up Video Quality-Centric Instructions via Automated Dimension Scoring
- 2026VGA-BenchV2: An Expanded Unified Benchmark and Multi-Model Framework for Evaluating Video Aesthetics and Generation Quality
- 2025World Consistency Score: A Unified Metric for Video Generation Quality
- 2025GRADEO: Towards Human-Like Evaluation for Text-to-Video Generation via Multi-Step Reasoning
- 2026VideoArgus: Agentic Rubric-Grounded Unified Evaluation for Video Generation and Editing
- 2026UniVBench: Towards Unified Evaluation for Video Foundation Models