Benchmarking Scientific Understanding and Reasoning for Video Generation using VideoScience-Bench
Not on the map. Why?
Abstract (arXiv)
The next frontier for video generation lies in developing models capable of zero-shot reasoning, where understanding real-world scientific laws is crucial for accurate physical outcome modeling under diverse conditions. However, existing video benchmarks are physical commonsense-based, offering limited insight into video models' scientific reasoning capability. We introduce VideoScience-Bench, a benchmark designed to evaluate undergraduate-level scientific understanding in video models. Each prompt encodes a composite scientific scenario that requires understanding and reasoning across multiple scientific concepts to generate the correct phenomenon. The benchmark comprises 200 carefully curated prompts spanning 14 topics and 103 concepts in physics and chemistry. We conduct expert-annotated evaluations across seven state-of-the-art video models in T2V and I2V settings along five dimensions: Prompt Consistency, Phenomenon Congruency, Correct Dynamism, Immutability, and Spatio-Temporal Continuity. Using a VLM-as-a-Judge to assess video generations, we observe strong correlation with human assessments. To the best of our knowledge, VideoScience-Bench is the first benchmark to evaluate video models not only as generators but also as reasoners, requiring their generations to demonstrate scientific understanding consistent with expected physical and chemical phenomena. Our data and evaluation code are available at: hrefhttps://github.com/hao-ai-lab/VideoSciencegithub.com/hao-ai-lab/VideoScience.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 27 of its 45 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
27 of 45 references.
References · 27
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
15 more
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
- 2024GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generationcited by 135
- 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 124
- 2023VDT: General-purpose Video Diffusion Transformers via Mask Modelingcited by 103
- 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 58
- 2025Video-Bench: Human-Aligned Video Generation Benchmarkcited by 57
- 2024VHELM: A Holistic Evaluation of Vision Language Modelscited by 53
- 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigmcited by 42
- 2025VideoScore2: Think before You Score in Generative Video Evaluationcited by 40
- 2025SciVideoBench: Benchmarking Scientific Video Reasoning in Large Multimodal Modelscited by 13
- 2025ExpVid: A Benchmark for Experiment Video Understanding & Reasoningcited by 5
- 2025PhysLab: A Benchmark Dataset for Multi-Granularity Visual Parsing of Physics Experimentscited by 4
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Modelscited by 12
- 2026PhyRPR: Training-Free Physics-Constrained Video Generationcited by 7
- 2026CRONOS: Benchmarking Counterfactual Physical Consistency in Video Modelscited by 4
- 2026Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domainscited by 2
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
- 2026MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videoscited by 0
- 2026LabInstruct: Benchmarking Situated Instructional Video Generation for Lab Procedurescited by 0
- 2026LabInstruct: Benchmarking Situated Instructional Video Generation for Lab Procedures29 Sep 2026
- 2026MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videos29 Sep 2026
- 2026Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domains10 Aug 2026
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence17 Jul 2026
- 2026CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models22 May 2026
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models11 May 2026
- 2026PhyRPR: Training-Free Physics-Constrained Video Generation14 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Physics-IQ Verified
- 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Concepts
- 2026PhysicsMind: Sim and Real Mechanics Benchmarking for Physical Reasoning and Prediction in Foundational VLMs and World Models
- 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Models
- 2026World Models' Last Exam in Physics
- 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoning
- 2025PhysVidBench: Language-Grounded Evaluation of Physical Commonsense in Text-to-Video Models
- 2026PhysMRV: Physical Memory Retrieval and Verification for Physics Plausibility Reasoning