Foresight at the Event Boundary: Evaluating Physical Prediction in Video World Models
On the map: World models → Video-generation world models and simulators also fits: Latent predictive world models
Abstract (arXiv)
Video world models are largely regarded as predictive models of the physical world and are therefore expected to anticipate the consequences of observed events. However, evaluation has mainly focused on reference similarity, physical-law consistency, or judgment plausibility, estimating anticipation only indirectly. We address this directly: when a release or impact has just occurred but its consequence is withheld, can a world model anticipate what should happen next? We introduce an event-anchored evaluation based on 62 controlled real-world free-fall recordings and 124 clips spanning three object types, with fine-grained release and impact annotations and ground-truth trajectories. The protocol separates consequence production, temporal placement, and physical realization. Across six contemporary video generation and world models, Runway and Veo produce release and subsequent impact events at rates above 93% but often initiate them substantially late, whereas Cosmos-Predict-2.5 and MAGI-1 frequently preserve the pre-event state and produce little or no measurable consequence. Among measurable falls, plausible timing does not necessarily imply physically consistent motion. We further conduct a 15-participant, 20-condition human study in which participants describe the expected consequence from a single event-anchored frame and draw its trajectory. Human predictions favor the recorded future in aggregate while revealing genuine ambiguity among plausible continuations. Overall, physical foresight emerges as a sequence of distinct challenges: initiating a consequence, anchoring it in time, and realizing its motion.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 8 of its 20 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
8 of 20 references.
Closest ancestors · 1
Same direction, newest first
Other references · 7
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2025Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systemscited by 48
- 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoningcited by 14
- 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Conceptscited by 12
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Modelscited by 12
- 2026Physics-IQ Verifiedcited by 9
- 2026PhyWorld: Physics-Faithful World Model for Video Generationcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026How Does Geometry Enter Generated Motion?cited by 0
- 2026How Does Geometry Enter Generated Motion?4 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2026A Plausible Future Is Not a Causal Future: Can Video Models Generate How the World Unfolds?
- 2026World Models' Last Exam in Physics
- 2024How Far is Video Generation from World Model: A Physical Law Perspective
- 2026World Models Need a Physical Registry: Learning Internal Predictive States for Physically Plausible World Models
- 2026What-If World: A Causal Benchmark for General World Models in Embodied Scenarios
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity
- 2026Event-Conditioned Diagnostics of Kinematic, Contact, and Object-Permanence Structure in Passive Object-State World Models
- 2026WorldMemBench: A Comprehensive Benchmark for Memory of Video World Models