mlsanityData to 14 Oct 2026

WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon

arXiv 2609.35560 ↗First posted 28 Sep 2026cs.CVcited by 0

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Interactive world models require responding in real time to versatile controls and maintaining long-horizon consistency. However, modeling heterogeneous controls remains difficult, while explosive contexts and unstable distillation impede achieving both long-horizon consistency and real-time responsiveness. In this paper, we present WorldPlay2, an interactive world model that couples a factorized hybrid control interface with a co-design of compressed memory and stable distillation. 1) Our factorized hybrid control interface integrates frame-aligned action control with structured semantic control that explicitly disentangles scene appearance, character identity, and dynamic semantic events, thereby facilitating effective control learning. 2) To achieve efficient long-horizon modeling, we compress historical contexts into compact memory tokens shared by the autoregressive student and the bidirectional teacher. This design enables clip-wise, memory-conditioned score evaluation instead of jointly processing an entire long rollout, substantially reducing distillation overhead. 3) We further propose Stable Forcing, which initializes the autoregressive student via a few-step strategy and leverages full-rollout replay to preserve the quality of long-horizon rollouts, ensuring robust and stable distillation. Extensive experiments demonstrate the strong generalizability of our model and its superior performance compared to existing methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 51 of its 56 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

51 of 56 references.

Closest ancestors · 23

Same direction, newest first

  1. 2026EchoWM: Open and Enterable Omnimodal World Models24 Aug
  2. 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug
  3. 2026Wonder: Video World Model Done Better28 Jul
  4. 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul
  5. 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report20 Jul
  6. 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models24 Jun
  7. 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun
  8. 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun
  9. 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
  10. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
  11. 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds15 Apr
  12. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
11 more
  1. 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling8 Apr
  2. 2026Advancing Open-source World Models28 Jan
  3. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  4. 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
  5. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
  6. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  7. 2025Yume: An Interactive World Generation Model23 Jul
  8. 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  10. 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
  11. 2022Flow Matching for Generative Modeling6 Oct

Other references · 28

  1. 2025Qwen3-VL Technical Reportcited by 2,793
  2. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  3. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  4. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  5. 2025Mean Flows for One-step Generative Modelingcited by 561
  6. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  7. 2025Video models are zero-shot learners and reasonerscited by 220
  8. 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 185
  9. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
  10. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
  11. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
  12. 2025HunyuanVideo 1.5 Technical Reportcited by 160
16 more
  1. 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 114
  2. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
  3. 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 95
  4. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 94
  5. 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 86
  6. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 84
  7. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
  8. 2025Sekai: A Video Dataset towards World Explorationcited by 67
  9. 2025Evaluating Gemini Robotics Policies in a Veo World Simulatorcited by 51
  10. 2026Infinite Worlds with Versatile Interactionscited by 48
  11. 2025Transition Models: Rethinking the Generative Learning Objectivecited by 34
  12. 2025pi-Flow: Policy-Based Few-Step Generation via Imitation Distillationcited by 29
  13. 2026AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillationcited by 26
  14. 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 24
  15. 2025TinyHistory: Lightweight Video History Embeddings via Two-Stage Context Learningcited by 15
  16. 2026Parallel Decoding Distillation for Fast Image and Video Generationcited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
  2. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models
  3. 2026GameWAM: A World Action Model for Video Games
  4. 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory
  5. 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control
  6. 2025MagicWorld: Towards Long-Horizon Stability for Interactive Video World Exploration
  7. 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
  8. 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control