mlsanityData to 14 Oct 2026

T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generation

arXiv 2505.00337 ↗First posted 1 May 2025cs.LG cs.AI cs.CLcited by 39

Not on the map. Why?

Abstract (arXiv)

Text-to-video generative models have made significant strides in recent years, producing high-quality videos that excel in both aesthetic appeal and accurate instruction following, and have become central to digital art creation and user engagement online. Yet, despite these advancements, their ability to respect fundamental physical laws remains largely untested: many outputs still violate basic constraints such as rigid-body collisions, energy conservation, and gravitational dynamics, resulting in unrealistic or even misleading content. Existing physical-evaluation benchmarks typically rely on automatic, pixel-level metrics applied to simplistic, life-scenario prompts, and thus overlook both human judgment and first-principles physics. To fill this gap, we introduce T2VPhysBench, a first-principled benchmark that systematically evaluates whether state-of-the-art text-to-video systems, both open-source and commercial, obey twelve core physical laws including Newtonian mechanics, conservation principles, and phenomenological effects. Our benchmark employs a rigorous human evaluation protocol and includes three targeted studies: (1) an overall compliance assessment showing that all models score below 0.60 on average in each law category; (2) a prompt-hint ablation revealing that even detailed, law-specific hints fail to remedy physics violations; and (3) a counterfactual robustness test demonstrating that models often generate videos that explicitly break physical rules when so instructed. The results expose persistent limitations in current architectures and offer concrete insights for guiding future research toward truly physics-aware video generation.

Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). Builds on 43 of its 58 references that are in the map. First posted on arXiv 1 May 2025.

Builds on

43 of 58 references.

References · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Generative Adversarial Networkscited by 5,627
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  4. 2022Video Diffusion Modelscited by 2,305
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  6. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  7. 2021ViViT: A Video Vision Transformercited by 1,620
  8. 2018World Modelscited by 1,513
  9. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  10. 2021Video Swin Transformercited by 1,091
  11. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  12. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
31 more
  1. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  2. 2023ModelScope Text-to-Video Technical Reportcited by 658
  3. 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 602
  4. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
  5. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  6. 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
  7. 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 473
  8. 2017Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equationscited by 373
  9. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
  10. 2022Flexible Diffusion Modeling of Long Videoscited by 294
  11. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
  12. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
  13. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
  14. 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 168
  15. 2017Video Generation From Textcited by 154
  16. 2021Align and Prompt: Video-and-Language Pre-training with Entity Promptscited by 149
  17. 2023Vision Language Models in Autonomous Driving: A Survey and Outlookcited by 126
  18. 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 122
  19. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 90
  20. 2018To Create What You Tell: Generating Videos from Captionscited by 84
  21. 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 67
  22. 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
  23. 2024TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generationcited by 43
  24. 2021A Survey on Neural-symbolic Learning Systemscited by 39
  25. 2024PhyBench: A Physical Commonsense Benchmark for Evaluating Text-to-Image Modelscited by 36
  26. 2016Learning a Driving Simulatorcited by 33
  27. 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
  28. 2023StoryBench: A Multifaceted Benchmark for Continuous Story Visualizationcited by 29
  29. 2018A review of possible effects of cognitive biases on the interpretation of rule-based machine learning modelscited by 22
  30. 2024Towards Neuro-Symbolic Video Understandingcited by 16
  31. 2025Can You Count to Nine? A Human Evaluation Benchmark for Counting Limits in Modern Text-to-Video Modelscited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 16; 2026: 23.

39 papers.

Sort:

By area:

  1. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  2. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  3. 2025RoboScape: Physics-informed Embodied World Modelcited by 40
  4. 2025Robotic Manipulation by Imitating Generated Videos Without Physical Demonstrationscited by 38
  5. 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Modelscited by 36
  6. 2026Rethinking Video Generation Model for the Embodied Worldcited by 33
  7. 2025T2AV-Compass: Towards Unified Evaluation for Text-to-Audio-Video Generationcited by 24
  8. 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generationcited by 19
  9. 2025Your Vision-Language Model Can't Even Count to 20: Exposing the Failures of VLMs in Compositional Countingcited by 18
  10. 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Modelscited by 18
  11. 2025LikePhys: Evaluating Intuitive Physics Understanding in Video Diffusion Models via Likelihood Preferencecited by 16
  12. 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoningcited by 14
27 more
  1. 2026PhyGround: Benchmarking Physical Reasoning in Generative World Modelscited by 12
  2. 2026Current World Models Lack a Persistent State Corecited by 12
  3. 2025T2VTextBench: A Human Evaluation Benchmark for Textual Control in Video Generation Modelscited by 10
  4. 2026Do Joint Audio-Video Generation Models Understand Physics?cited by 8
  5. 2025Only Large Weights (And Not Skip Connections) Can Prevent the Perils of Rank Collapsecited by 7
  6. 2025Towards High-Order Mean Flow Generative Models: Feasibility, Expressivity, and Provably Efficient Criteriacited by 5
  7. 2025Objects in Generated Videos Are Slower Than They Appear: Models Suffer Sub-Earth Gravity and Don't Know Galileo's Principle...for nowcited by 5
  8. 2025MoReGen: Multi-Agent Motion-Reasoning Engine for Code-based Text-to-Video Synthesiscited by 5
  9. 2025Minimalist Softmax Attention Provably Learns Constrained Boolean Functionscited by 4
  10. 2025Too Easily Fooled? Prompt Injection Breaks LLMs on Frustratingly Simple Multiple-Choice Questionscited by 4
  11. 2026CRONOS: Benchmarking Counterfactual Physical Consistency in Video Modelscited by 4
  12. 2026PH-Dreamer: A Physics-Driven World Model via Port-Hamiltonian Generative Dynamicscited by 3
  13. 2026YoCausal: How Far is Video Generation from World Model? A Causality Perspectivecited by 3
  14. 2025Envision: Benchmarking Unified Understanding & Generation for Causal World Process Insightscited by 2
  15. 2026Physically Viable World Models: A Case for Query-Conditioned Embodied AIcited by 2
  16. 2026The Seriality Gap in Video Diffusion Modelscited by 2
  17. 2026Principia: Relational Physics Tests for Video Modelscited by 2
  18. 2026PhysWeep: Does a Video Generator Realize the Physics You Ask For?cited by 2
  19. 2026Detecting AI-Generated Video: A Vision-Language Dual-View Surveycited by 1
  20. 2026VideoPhysEdit: Physical Counterfactual Video Editing via Rigid-Body Physical Scene Reconstructioncited by 1
  21. 2026PAWBench: How Far Are We from Probabilistically Aligned World Modeling?cited by 0
  22. 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generationcited by 0
  23. 2026PhysAI-Bench: A Benchmark for LLM-Based Agentic Decision-Making in Autonomous UAV-Centric Physical AIcited by 0
  24. 2026VideoGen-Agent: Reinforcing Video Generation Agentscited by 0
  25. 2026Does Physics Live in the Activations? Localizing Physical Quantities in Video Diffusion Modelscited by 0
  26. 2026S2PD: Serial-to-Parallel Diffusion for Physically and Logically Consistent Video Generationcited by 0
  27. 2026World Models' Last Exam in Physicscited by 0