"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Models
Not on the map. Why?
Abstract (arXiv)
Video generation models have achieved remarkable progress in creating high-quality, photorealistic content. However, their ability to accurately simulate physical phenomena remains a critical and unresolved challenge. This paper presents PhyWorldBench, a comprehensive benchmark designed to evaluate video generation models based on their adherence to the laws of physics. The benchmark covers multiple levels of physical phenomena, ranging from fundamental principles such as object motion and energy conservation to more complex scenarios involving rigid body interactions and human or animal motion. Additionally, we introduce a novel Anti-Physics category, where prompts intentionally violate real-world physics, enabling the assessment of whether models can follow such instructions while maintaining logical consistency. Besides large-scale human evaluation, we also design a simple yet effective method that utilizes current multimodal large language models to evaluate physics realism in a zero-shot fashion. We evaluate 12 state-of-the-art text-to-video generation models, including five open-source and five proprietary models, with detailed comparison and analysis. Through systematic testing across 1050 curated prompts spanning fundamental, composite, and anti-physics scenarios, we identify pivotal challenges these models face in adhering to real-world physics. We further examine their performance under diverse physical phenomena and prompt types, and derive targeted recommendations for crafting prompts that enhance fidelity to physical principles.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 17 Jul 2025.
Builds on
23 of 37 references.
References · 23
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2016Improved Techniques for Training GANscited by 2,938
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
11 more
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
- 2025Do generative video models understand physical principles?cited by 151
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
- 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
- 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
- 2025Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systemscited by 44
- 2025T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generationcited by 35
Built on by
Citing papers per year: 2025: 7; 2026: 27.
34 papers.
Sort:
By area:
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 40
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 34
- 2026Self-Refining Video Samplingcited by 14
- 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoningcited by 13
- 20254DWorldBench: A Comprehensive Evaluation Framework for 3D/4D World Generation Modelscited by 10
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 10
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Modelscited by 10
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suitecited by 9
- 2026MiraBench: Evaluating Action-Conditioned Reliability in Robotic World Modelscited by 8
- 2025Planning with Sketch-Guided Verification for Physics-Aware Video Generationcited by 6
- 2025MATRIX: Mask Track Alignment for Interaction-aware Video Generationcited by 4
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
22 more
- 2025Objects in Generated Videos Are Slower Than They Appear: Models Suffer Sub-Earth Gravity and Don't Know Galileo's Principle...for nowcited by 3
- 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generationcited by 3
- 2026PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignmentcited by 3
- 2026CRONOS: Benchmarking Counterfactual Physical Consistency in Video Modelscited by 3
- 2026A Definition and Roadmap for World Modelscited by 3
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 3
- 2026Lighting-grounded Video Generation with Renderer-based Agent Reasoningcited by 2
- 2026BadDreamer: Transferable Backdoor Attacks against Video World Models for Autonomous Drivingcited by 1
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstructioncited by 1
- 2026Gen2Balance: Generative Balancing for Long-Tailed Video Action Recognitioncited by 0
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioningcited by 0
- 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinementcited by 0
- 2026PhysWeep: Does a Video Generator Realize the Physics You Ask For?cited by 0
- 2026Conservation Buys Stability and Factoring Buys Counterfactuals in Physical World Modelscited by 0
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligencecited by 0
- 2026Continuous-Time Trajectory Generation from Discrete Observations with Stochasticitycited by 0
- 2026MultiEcho: An Experimental Science of Learned Worldscited by 0
- 2026Stable and Counterfactually Robust Physical World Models from Imposed Structure and Learned Physicscited by 0
- 2026PhysVista: Benchmarking Physical Intelligence in VLMs via a Perception-Reasoning-Assessment Loopcited by 0
- 2026PhysicsLENS: Diagnosing Physical Property Blindness in Video Generation Modelscited by 0
- 2026HiPhy: Hierarchical Alignment for Physically-Plausible Multi-Principle Video Generationcited by 0
- 2026HiPhy: Hierarchical Alignment for Physically-Plausible Multi-Principle Video Generation1 Oct 2026
- 2026PhysicsLENS: Diagnosing Physical Property Blindness in Video Generation Models1 Oct 2026
- 2026PhysVista: Benchmarking Physical Intelligence in VLMs via a Perception-Reasoning-Assessment Loop30 Sep 2026
- 2026MultiEcho: An Experimental Science of Learned Worlds27 Sep 2026
- 2026Continuous-Time Trajectory Generation from Discrete Observations with Stochasticity25 Sep 2026
- 2026Stable and Counterfactually Robust Physical World Models from Imposed Structure and Learned Physics24 Sep 2026
- 2026Conservation Buys Stability and Factoring Buys Counterfactuals in Physical World Models17 Sep 2026
- 2026PhysWeep: Does a Video Generator Realize the Physics You Ask For?5 Sep 2026
- 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement2 Sep 2026
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning1 Sep 2026
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence30 Aug 2026
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstruction28 Aug 2026
22 more
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worlds17 Aug 2026
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence17 Jul 2026
- 2026A Definition and Roadmap for World Models7 Jul 2026
- 2026Gen2Balance: Generative Balancing for Long-Tailed Video Action Recognition21 Jun 2026
- 2026BadDreamer: Transferable Backdoor Attacks against Video World Models for Autonomous Driving19 Jun 2026
- 2026MiraBench: Evaluating Action-Conditioned Reliability in Robotic World Models28 May 2026
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May 2026
- 2026CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models22 May 2026
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models11 May 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suite10 Apr 2026
- 2026Lighting-grounded Video Generation with Renderer-based Agent Reasoning9 Apr 2026
- 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoning20 Mar 2026
- 2026PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignment14 Mar 2026
- 2026Self-Refining Video Sampling26 Jan 2026
- 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generation3 Dec 2025
- 2025Objects in Generated Videos Are Slower Than They Appear: Models Suffer Sub-Earth Gravity and Don't Know Galileo's Principle...for now1 Dec 2025
- 20254DWorldBench: A Comprehensive Evaluation Framework for 3D/4D World Generation Models25 Nov 2025
- 2025Planning with Sketch-Guided Verification for Physics-Aware Video Generation21 Nov 2025
- 2025MATRIX: Mask Track Alignment for Interaction-aware Video Generation8 Oct 2025
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI6 Oct 2025
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamics25 Sep 2025
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 34
- 20254DWorldBench: A Comprehensive Evaluation Framework for 3D/4D World Generation Modelscited by 10
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 10
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Modelscited by 10
- 2026MiraBench: Evaluating Action-Conditioned Reliability in Robotic World Modelscited by 8
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
- 2025Objects in Generated Videos Are Slower Than They Appear: Models Suffer Sub-Earth Gravity and Don't Know Galileo's Principle...for nowcited by 3
- 2026CRONOS: Benchmarking Counterfactual Physical Consistency in Video Modelscited by 3
- 2026A Definition and Roadmap for World Modelscited by 3
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 3
- 2026BadDreamer: Transferable Backdoor Attacks against Video World Models for Autonomous Drivingcited by 1
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
12 most cited of 19 All 19 (JSON)
- 2026PhysicsLENS: Diagnosing Physical Property Blindness in Video Generation Models1 Oct 2026
- 2026MultiEcho: An Experimental Science of Learned Worlds27 Sep 2026
- 2026Stable and Counterfactually Robust Physical World Models from Imposed Structure and Learned Physics24 Sep 2026
- 2026Conservation Buys Stability and Factoring Buys Counterfactuals in Physical World Models17 Sep 2026
- 2026VeriPhy: Agentic Physical Reasoning for World Model Evaluation and Refinement2 Sep 2026
- 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence30 Aug 2026
- 2026RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstruction28 Aug 2026
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worlds17 Aug 2026
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence17 Jul 2026
- 2026A Definition and Roadmap for World Models7 Jul 2026
- 2026BadDreamer: Transferable Backdoor Attacks against Video World Models for Autonomous Driving19 Jun 2026
- 2026MiraBench: Evaluating Action-Conditioned Reliability in Robotic World Models28 May 2026
12 newest of 19 All 19 (JSON)
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 40
- 2026Self-Refining Video Samplingcited by 14
- 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoningcited by 13
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suitecited by 9
- 2025Planning with Sketch-Guided Verification for Physics-Aware Video Generationcited by 6
- 2025MATRIX: Mask Track Alignment for Interaction-aware Video Generationcited by 4
- 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generationcited by 3
- 2026Gen2Balance: Generative Balancing for Long-Tailed Video Action Recognitioncited by 0
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioningcited by 0
- 2026PhysWeep: Does a Video Generator Realize the Physics You Ask For?cited by 0
- 2026Continuous-Time Trajectory Generation from Discrete Observations with Stochasticitycited by 0
- 2026HiPhy: Hierarchical Alignment for Physically-Plausible Multi-Principle Video Generationcited by 0
- 2026HiPhy: Hierarchical Alignment for Physically-Plausible Multi-Principle Video Generation1 Oct 2026
- 2026Continuous-Time Trajectory Generation from Discrete Observations with Stochasticity25 Sep 2026
- 2026PhysWeep: Does a Video Generator Realize the Physics You Ask For?5 Sep 2026
- 2026Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning1 Sep 2026
- 2026Gen2Balance: Generative Balancing for Long-Tailed Video Action Recognition21 Jun 2026
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suite10 Apr 2026
- 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoning20 Mar 2026
- 2026Self-Refining Video Sampling26 Jan 2026
- 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generation3 Dec 2025
- 2025Planning with Sketch-Guided Verification for Physics-Aware Video Generation21 Nov 2025
- 2025MATRIX: Mask Track Alignment for Interaction-aware Video Generation8 Oct 2025
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamics25 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026World Models' Last Exam in Physics
- 2025TRAVL: A Recipe for Making Video-Language Models Better Judges of Physics Implausibility
- 2025PhysVidBench: Language-Grounded Evaluation of Physical Commonsense in Text-to-Video Models
- 2026PhyWorld: Physics-Faithful World Model for Video Generation
- 2026Physics-IQ Verified
- 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Concepts
- 2026GAUGE: A Measurement-Grounded Benchmark for Physical Fidelity in Simulation Engines and Video World Models
- 2025PhysCorr: Dual-Reward DPO for Physics-Constrained Text-to-Video Generation with Automated Preference Selection