mlsanityData to 7 Oct 2026

minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models

arXiv 2605.30263 ↗First posted 28 May 2026cs.CVcited by 19

On the map: World models → Video-generation world models and simulators

also in 1 more
Abstract (arXiv)

Recent video diffusion foundation models have achieved remarkable progress in high-quality video generation, yet turning them into real-time interactive video world models remains challenging. Interactive world models require controllable, causal, and low-latency rollout, which in practice demands a full pipeline spanning data construction, controllable fine-tuning, autoregressive training, few-step distillation, and streaming inference. In this work, we present minWM, a full-stack open-source framework for building real-time interactive video world models. minWM provides an end-to-end pipeline that converts existing bidirectional T2V/TI2V video foundation models into camera-controllable few-step autoregressive world models. Specifically, minWM first fine-tunes a bidirectional video diffusion model with camera control, and then applies the Causal Forcing / Causal Forcing++ pipeline, including AR diffusion training, causal ODE or causal consistency distillation, and asymmetric DMD, to distill it into a few-step autoregressive generator for low-latency rollout. The framework is modular and architecture-extensible: we instantiate it on representative open backbones, including Wan2.1-T2V-1.3B and HY1.5-TI2V-8B, covering both cross-attention-based condition injection and MMDiT-style architectures. minWM also supports adapting existing video world models, such as HY-WorldPlay, to new data distributions, training recipes, and latency targets. Beyond releasing runnable scripts, checkpoints, documentation, and inference code, we provide practical ablations on camera trajectory quality, controllability training steps, and minimal batch-size requirements. We hope minWM serves as a reproducible and extensible recipe for building and adapting real-time interactive video world models. Project Page: [https://github.com/shengshu-ai/minWM](https://github.com/shengshu-ai/minWM)

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 30 of its 36 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

30 of 36 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  2. 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
  3. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
  4. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  5. 2025MAGI-1: Autoregressive Video Generation at Scale19 May
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  7. 2024Open-Sora: Democratizing Efficient Video Production for All29 Dec
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  9. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov

Other references · 21

  1. 2023Consistency Modelscited by 1,778
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  3. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  4. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  5. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  6. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  7. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  8. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
  9. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  10. 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
  11. 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 159
  12. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
9 more
  1. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
  2. 2025Cameras as Relative Positional Encodingcited by 94
  3. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
  4. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
  5. 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 71
  6. 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
  7. 2025StreamAvatar: Streaming Diffusion Models for Real-Time Interactive Human Avatarscited by 24
  8. 2025Towards One-step Causal Video Generation via Adversarial Self-Distillationcited by 15
  9. 2025Vidarc: Embodied Video Diffusion Model for Closed-loop Controlcited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 19.

19 papers.

Sort:

By area:

  1. 2026Infinite Worlds with Versatile Interactionscited by 37
  2. 2026DreamX-World 1.0: A General-Purpose Interactive World Modelcited by 33
  3. 2026Code World Model: Coding Agent as World Braincited by 9
  4. 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Modelscited by 9
  5. 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Modelscited by 8
  6. 2026BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregressioncited by 5
  7. 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillationcited by 5
  8. 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
  9. 2026Astronex-World 1.0: Real-Time Interactive World Model Foundationcited by 3
  10. 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Modelscited by 2
  11. 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Imagecited by 2
  12. 2026Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rolloutcited by 2
7 more
  1. 2026M4World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streamingcited by 1
  2. 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memorycited by 1
  3. 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
  4. 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
  5. 2026ActionSplice: In-Flight Action Editing for Interactive World Modelscited by 0
  6. 2026Action Forcing: Training World Models on Unsupervised Video by Recovering Underlying Egomotion Basescited by 0
  7. 2026Enhancing Autoregressive Video Generation via Representation Adversarial Distillationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models
  2. 2026MiniWorld: Democratizing the Training of Video World Models from Scratch
  3. 2025Vid2World: Crafting Video Diffusion Models to Interactive World Models
  4. 2026LIVE: Long-horizon Interactive Video World Modeling
  5. 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
  6. 2025VideoSSM: Autoregressive Long Video Generation with Hybrid State-Space Memory
  7. 2026Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model
  8. 2026UniTemp: Unlocking Video Generation in Any Temporal Order via Bidirectional Distillation