mlsanityData to 7 Oct 2026

STRIKE: Learning Visual State Transitions for Physical World Modeling

arXiv 2610.09514 ↗First posted 7 Oct 2026cs.CVcited by 0

On the map: World models → Video-generation world models and simulators also fits: Latent predictive world models

Abstract (arXiv)

Physical world modeling requires predicting how interactions change a scene, not merely generating coherent motion. We propose STRIKE, a framework that separates visual state transition learning from dense video generation. We construct event-aligned supervision by extracting observed states from training videos and pairing them with transition descriptions and temporal offsets. An image-based transition model learns to predict the next scene configuration from the current image, a local transition specification, and elapsed time. At inference, a pretrained vision-language planner predicts time transition specifications, and recursive application of the learned transition model produces a sequence of future visual states. A separately trained dynamic model then generates the complete rollout conditioned on these states and their temporal locations. Experiments on Physics-IQ Verified, PhyGenBench, Pisa-Experiments, and RoboTwin2.0 show improvements of STRIKE over the corresponding video-backbone baselines in benchmark measures of physical consistency and manipulation-video fidelity. These results support learned visual state transitions as an effective intermediate representation for physical world modeling.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 19 of its 48 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

19 of 48 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun
  2. 2026DreamWorld: Unified World Modeling in Video Generation28 Feb
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug

Other references · 15

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2025Qwen-Image Technical Reportcited by 973
  4. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  5. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  6. 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 220
  7. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  8. 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
  9. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 68
  10. 2025KeyWorld: Key Frame Reasoning Enables Effective and Efficient World Modelscited by 7
  11. 2026Physics-IQ Verifiedcited by 6
  12. 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generationcited by 4
3 more
  1. 2026CausalMotion: Structured Physical Reasoning as Keyframe and Trajectory Guidance for Training-Free Video Generationcited by 4
  2. 2026Motion Forcing: A Decoupled Framework for Robust Video Generation in Motion Dynamicscited by 3
  3. 2026SKIP: Sparse Keyframe Interpolation Paradigm for Efficient Embodied World Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actions
  2. 2026Can Image Models Imagine Time? ImageTime: A Novel Benchmark for Probing Visual World Modeling Through Spatiotemporal Consistency
  3. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  4. 2026Foresight Without Seeing: Latent Futures for World Action Models
  5. 2026From World Models to World Action Models: Rethinking Next-State Prediction
  6. 2026VIDEAS: Distilling Explicit Action Semantics from Demonstration Videos for World Models via Prior-Guided Simulation
  7. 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image
  8. 2026EA-WM: Event-Aware Generative World Model with Structured Kinematic-to-Visual Action Fields