WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Interactive world models require responding in real time to versatile controls and maintaining long-horizon consistency. However, modeling heterogeneous controls remains difficult, while explosive contexts and unstable distillation impede achieving both long-horizon consistency and real-time responsiveness. In this paper, we present WorldPlay2, an interactive world model that couples a factorized hybrid control interface with a co-design of compressed memory and stable distillation. 1) Our factorized hybrid control interface integrates frame-aligned action control with structured semantic control that explicitly disentangles scene appearance, character identity, and dynamic semantic events, thereby facilitating effective control learning. 2) To achieve efficient long-horizon modeling, we compress historical contexts into compact memory tokens shared by the autoregressive student and the bidirectional teacher. This design enables clip-wise, memory-conditioned score evaluation instead of jointly processing an entire long rollout, substantially reducing distillation overhead. 3) We further propose Stable Forcing, which initializes the autoregressive student via a few-step strategy and leverages full-rollout replay to preserve the quality of long-horizon rollouts, ensuring robust and stable distillation. Extensive experiments demonstrate the strong generalizability of our model and its superior performance compared to existing methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 51 of its 56 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
51 of 56 references.
Closest ancestors · 23
Same direction, newest first
- 2026EchoWM: Open and Enterable Omnimodal World Models24 Aug
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug
- 2026Wonder: Video World Model Done Better28 Jul
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul
- 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report20 Jul
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models24 Jun
- 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds15 Apr
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
11 more
- 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling8 Apr
- 2026Advancing Open-source World Models28 Jan
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025Yume: An Interactive World Generation Model23 Jul
- 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
- 2022Flow Matching for Generative Modeling6 Oct
Other references · 28
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2025Video models are zero-shot learners and reasonerscited by 220
- 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 185
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
16 more
- 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 114
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
- 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 95
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 94
- 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 86
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 84
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
- 2025Sekai: A Video Dataset towards World Explorationcited by 67
- 2025Evaluating Gemini Robotics Policies in a Veo World Simulatorcited by 51
- 2026Infinite Worlds with Versatile Interactionscited by 48
- 2025Transition Models: Rethinking the Generative Learning Objectivecited by 34
- 2025pi-Flow: Policy-Based Few-Step Generation via Imitation Distillationcited by 29
- 2026AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillationcited by 26
- 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 24
- 2025TinyHistory: Lightweight Video History Embeddings via Two-Stage Context Learningcited by 15
- 2026Parallel Decoding Distillation for Fast Image and Video Generationcited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models
- 2026GameWAM: A World Action Model for Video Games
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory
- 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control
- 2025MagicWorld: Towards Long-Horizon Stability for Interactive Video World Exploration
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control