STRIKE: Learning Visual State Transitions for Physical World Modeling
On the map: World models → Video-generation world models and simulators also fits: Latent predictive world models
Abstract (arXiv)
Physical world modeling requires predicting how interactions change a scene, not merely generating coherent motion. We propose STRIKE, a framework that separates visual state transition learning from dense video generation. We construct event-aligned supervision by extracting observed states from training videos and pairing them with transition descriptions and temporal offsets. An image-based transition model learns to predict the next scene configuration from the current image, a local transition specification, and elapsed time. At inference, a pretrained vision-language planner predicts time transition specifications, and recursive application of the learned transition model produces a sequence of future visual states. A separately trained dynamic model then generates the complete rollout conditioned on these states and their temporal locations. Experiments on Physics-IQ Verified, PhyGenBench, Pisa-Experiments, and RoboTwin2.0 show improvements of STRIKE over the corresponding video-backbone baselines in benchmark measures of physical consistency and manipulation-video fidelity. These results support learned visual state transitions as an effective intermediate representation for physical world modeling.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 19 of its 48 references that are in the map. First posted on arXiv 7 Oct 2026.
Builds on
19 of 48 references.
Closest ancestors · 4
Same direction, newest first
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun
- 2026DreamWorld: Unified World Modeling in Video Generation28 Feb
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
Other references · 15
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025Qwen-Image Technical Reportcited by 973
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 220
- 2025World Simulation with Video Foundation Models for Physical AIcited by 183
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 68
- 2025KeyWorld: Key Frame Reasoning Enables Effective and Efficient World Modelscited by 7
- 2026Physics-IQ Verifiedcited by 6
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generationcited by 4
3 more
- 2026CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generationcited by 4
- 2026Motion Forcing: A Decoupled Framework for Robust Video Generation in Motion Dynamicscited by 3
- 2026SKIP: Sparse Keyframe Interpolation Paradigm for Efficient Embodied World Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actions
- 2026Can Image Models Imagine Time? ImageTime: A Novel Benchmark for Probing Visual World Modeling Through Spatiotemporal Consistency
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026Foresight Without Seeing: Latent Futures for World Action Models
- 2026From World Models to World Action Models: Rethinking Next-State Prediction
- 2026VIDEAS: Distilling Explicit Action Semantics from Demonstration Videos for World Models via Prior-Guided Simulation
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image
- 2026EA-WM: Event-Aware Generative World Model with Structured Kinematic-to-Visual Action Fields