minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models
On the map: World models → Video-generation world models and simulators
also in 1 more
Abstract (arXiv)
Recent video diffusion foundation models have achieved remarkable progress in high-quality video generation, yet turning them into real-time interactive video world models remains challenging. Interactive world models require controllable, causal, and low-latency rollout, which in practice demands a full pipeline spanning data construction, controllable fine-tuning, autoregressive training, few-step distillation, and streaming inference. In this work, we present minWM, a full-stack open-source framework for building real-time interactive video world models. minWM provides an end-to-end pipeline that converts existing bidirectional T2V/TI2V video foundation models into camera-controllable few-step autoregressive world models. Specifically, minWM first fine-tunes a bidirectional video diffusion model with camera control, and then applies the Causal Forcing / Causal Forcing++ pipeline, including AR diffusion training, causal ODE or causal consistency distillation, and asymmetric DMD, to distill it into a few-step autoregressive generator for low-latency rollout. The framework is modular and architecture-extensible: we instantiate it on representative open backbones, including Wan2.1-T2V-1.3B and HY1.5-TI2V-8B, covering both cross-attention-based condition injection and MMDiT-style architectures. minWM also supports adapting existing video world models, such as HY-WorldPlay, to new data distributions, training recipes, and latency targets. Beyond releasing runnable scripts, checkpoints, documentation, and inference code, we provide practical ablations on camera trajectory quality, controllability training steps, and minimal batch-size requirements. We hope minWM serves as a reproducible and extensible recipe for building and adapting real-time interactive video world models. Project Page: [https://github.com/shengshu-ai/minWM](https://github.com/shengshu-ai/minWM)
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 30 of its 36 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
30 of 36 references.
Closest ancestors · 9
Same direction, newest first
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025MAGI-1: Autoregressive Video Generation at Scale19 May
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024Open-Sora: Democratizing Efficient Video Production for All29 Dec
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
Other references · 21
- 2023Consistency Modelscited by 1,778
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
- 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 159
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
9 more
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
- 2025Cameras as Relative Positional Encodingcited by 94
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
- 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 71
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
- 2025StreamAvatar: Streaming Diffusion Models for Real-Time Interactive Human Avatarscited by 24
- 2025Towards One-step Causal Video Generation via Adversarial Self-Distillationcited by 15
- 2025Vidarc: Embodied Video Diffusion Model for Closed-loop Controlcited by 15
Built on by
Citing papers per year: 2026: 19.
19 papers.
Sort:
By area:
- 2026Infinite Worlds with Versatile Interactionscited by 37
- 2026DreamX-World 1.0: A General-Purpose Interactive World Modelcited by 33
- 2026Code World Model: Coding Agent as World Braincited by 9
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Modelscited by 9
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Modelscited by 8
- 2026BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregressioncited by 5
- 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillationcited by 5
- 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
- 2026Astronex-World 1.0: Real-Time Interactive World Model Foundationcited by 3
- 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Modelscited by 2
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Imagecited by 2
- 2026Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rolloutcited by 2
7 more
- 2026M4World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streamingcited by 1
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memorycited by 1
- 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
- 2026ActionSplice: In-Flight Action Editing for Interactive World Modelscited by 0
- 2026Action Forcing: Training World Models on Unsupervised Video by Recovering Underlying Egomotion Basescited by 0
- 2026Enhancing Autoregressive Video Generation via Representation Adversarial Distillationcited by 0
- 2026Enhancing Autoregressive Video Generation via Representation Adversarial Distillation30 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026Action Forcing: Training World Models on Unsupervised Video by Recovering Underlying Egomotion Bases24 Sep 2026
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory21 Sep 2026
- 2026Astronex-World 1.0: Real-Time Interactive World Model Foundation17 Sep 2026
- 2026Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rollout8 Sep 2026
- 2026ActionSplice: In-Flight Action Editing for Interactive World Models8 Sep 2026
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image4 Sep 2026
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models2 Sep 2026
- 2026Code World Model: Coding Agent as World Brain26 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models14 Aug 2026
7 more
- 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation13 Aug 2026
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines15 Jul 2026
- 2026M4World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streaming15 Jul 2026
- 2026Infinite Worlds with Versatile Interactions8 Jul 2026
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models30 Jun 2026
- 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun 2026
- 2026BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregression8 Jun 2026
- 2026DreamX-World 1.0: A General-Purpose Interactive World Modelcited by 33
- 2026Code World Model: Coding Agent as World Braincited by 9
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Modelscited by 9
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Modelscited by 8
- 2026BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregressioncited by 5
- 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
- 2026Astronex-World 1.0: Real-Time Interactive World Model Foundationcited by 3
- 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Modelscited by 2
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Imagecited by 2
- 2026M4World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streamingcited by 1
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memorycited by 1
- 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
12 most cited of 15 All 15 (JSON)
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026Action Forcing: Training World Models on Unsupervised Video by Recovering Underlying Egomotion Bases24 Sep 2026
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory21 Sep 2026
- 2026Astronex-World 1.0: Real-Time Interactive World Model Foundation17 Sep 2026
- 2026ActionSplice: In-Flight Action Editing for Interactive World Models8 Sep 2026
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image4 Sep 2026
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models2 Sep 2026
- 2026Code World Model: Coding Agent as World Brain26 Aug 2026
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models14 Aug 2026
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines15 Jul 2026
- 2026M4World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streaming15 Jul 2026
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models
- 2026MiniWorld: Democratizing the Training of Video World Models from Scratch
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Models
- 2026LIVE: Long-horizon Interactive Video World Modeling
- 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
- 2025VideoSSM: Autoregressive Long Video Generation with Hybrid State-Space Memory
- 2026Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model
- 2026UniTemp: Unlocking Video Generation in Any Temporal Order via Bidirectional Distillation