Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence
On the map: World models → Latent predictive world models
also in 1 more
Abstract (arXiv)
Modern video generation models are increasingly hailed as emerging world models with an internalized grasp of physical law. Yet existing benchmarks largely evaluate physical plausibility only at the output level, without verifying whether the model arrives there through a faithful, law-grounded reasoning process. We introduce Apple-PI, the first benchmark that anchors video-model evaluation explicitly in physical laws. Apple-PI comprises three components. 1) Orchard: a dataset of 400 videos covering ten canonical tasks in classical mechanics. It separates single-law tasks for confounder-free diagnosis from multi-law tasks for probing generalization. 2) Benchmark Protocol: a three-stage protocol based on scientific reasoning, including Perception, Formulation, and Deduction. It uses chain-of-frames prompting on infographic-annotated first frames, treating the generated video as the model's visible reasoning trace. 3) Evaluation Suite: a hybrid evaluation suite that combines MLLM-based subjective scoring with physics-law-grounded objective measures. This enables stage-resolved diagnosis of not only whether a model fails, but where it fails. Benchmarking 11 models shows that current video models remain far from reliable law-grounded world simulators, with the best video model scoring only 0.473. Our stage-, pillar-, and source-resolved analyses further expose a Perception-to-Formulation-to-Deduction bottleneck, weak multi-law state transfer, and a persistent Sim-to-Real gap. These findings position Apple-PI as a diagnostic foundation for guiding future video models toward world models with law-grounded physical intelligence.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 53 of its 73 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
53 of 73 references.
Closest ancestors · 1
Same direction, newest first
Other references · 52
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 484
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
- 2025Video models are zero-shot learners and reasonerscited by 220
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 170
38 more
- 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 160
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2026Advancing Open-source World Modelscited by 154
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 149
- 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 124
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 80
- 2018IntPhys: A Framework and Benchmark for Visual Intuitive Physics Reasoningcited by 73
- 2025Kling-Omni Technical Reportcited by 71
- 2025Intuitive physics understanding emerges from self-supervised pretraining on natural videoscited by 70
- 2025IntPhys 2: Benchmarking Intuitive Physics Understanding In Complex Synthetic Environmentscited by 52
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 44
- 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmarkcited by 43
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 42
- 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigmcited by 42
- 2025PhyX: Does Your Model Have the "Wits" for Physical Reasoning?cited by 38
- 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoningcited by 37
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 37
- 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Modelscited by 36
- 2025NewtonBench: Benchmarking Generalizable Scientific Law Discovery in LLM Agentscited by 36
- 2026A Very Big Video Reasoning Suitecited by 34
- 2025VChain: Chain-of-Visual-Thought for Reasoning in Video Generationcited by 32
- 2025What about gravity in video generation? Post-Training Newton's Laws with Verifiable Rewardscited by 25
- 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Modelscited by 22
- 2025QuantiPhy: A Quantitative Benchmark Evaluating Physical Reasoning Abilities of Vision-Language Modelscited by 20
- 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Modelscited by 19
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Modelscited by 18
- 2026Demystifying Video Reasoningcited by 14
- 2025First Frame Is the Place to Go for Video Content Customizationcited by 12
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 11
- 2026Thinking in Frames: How Visual Context and Test-Time Scaling Empower Video Reasoningcited by 10
- 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generationcited by 9
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suitecited by 9
- 2026UniT: Unified Multimodal Chain-of-Thought Test-time Scalingcited by 8
- 2025Benchmarking Scientific Understanding and Reasoning for Video Generation using VideoScience-Benchcited by 7
- 2026Think in Strokes, Not Pixels: Process-Driven Image Generation via Interleaved Reasoningcited by 7
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
- 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoning
- 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Concepts
- 2026PhyCheck: Fine-Grained Evidence-Grounded Dataset for Physical Law Understanding in Video-LLMs
- 2025PhysVidBench: Language-Grounded Evaluation of Physical Commonsense in Text-to-Video Models
- 2025Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systems
- 2025TRAVL: A Recipe for Making Video-Language Models Better Judges of Physics Implausibility
- 2026PhysicsLENS: Diagnosing Physical Property Blindness in Video Generation Models