mlsanityData to 7 Oct 2026

Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control

arXiv 2609.17909 ↗First posted 15 Sep 2026cs.CV cs.LGcited by 3

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

We introduce Zing-0.5, a 5B autoregressive world model designed for playability: users can explore generated worlds, influence unfolding events, and respond to the resulting feedback through joint keyboard and online text control. Our approach brings together three technical contributions: (1) Unified action and text conditioning, combining magnitude-aware keyboard inputs with temporally aligned text instructions and jointly annotated videos to learn navigation and event control within the same sequence; (2) Event-scale supervision for incremental generation, using a segment-level teacher trained on connected multi-prompt videos to supervise a block-level causal student through distribution-matching distillation; and (3) Low-cost real-time interaction, combining four-step generation with context-preserving streaming to support 832 x 480 inference at 24 FPS at an estimated server rental cost of approximately USD 0.009 per stream-minute. Zing-0.5 achieves an overall score of 81.0 and a consistency score of 88.5 across 158 WBench Navigation cases. A joint-control demonstration shows a text-directed event change during continued navigation without restarting generation. We release the model weights, inference code, and Zing-SGLang serving implementation to support further work on playable generated worlds.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 38 of its 41 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

38 of 41 references.

Closest ancestors · 16

Same direction, newest first

  1. 2026H3-World: Turning Language Understanding into World Control1 Sep
  2. 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds24 Aug
  3. 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug
  4. 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul
  5. 2026DisCo: World Models with Discrete Camera Motion Control6 Jun
  6. 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
  7. 2026WorldCam: Interactive Autoregressive 3D Gaming Worlds with Camera Pose as a Unifying Geometric Representation17 Mar
  8. 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb
  9. 2026Advancing Open-source World Models28 Jan
  10. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  11. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
  12. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
4 more
  1. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  2. 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
  3. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  4. 2022Flow Matching for Generative Modeling6 Oct

Other references · 22

  1. 2022Classifier-Free Diffusion Guidancecited by 5,717
  2. 2023Consistency Modelscited by 1,778
  3. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  4. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  5. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  6. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  7. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  8. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  9. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  10. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
  11. 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 135
  12. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
10 more
  1. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
  2. 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
  3. 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
  4. 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 38
  5. 2026Infinite Worlds with Versatile Interactionscited by 37
  6. 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 25
  7. 2025CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow Map Modelscited by 18
  8. 2026Self Gradient Forcing: Native Long Video Extrapolationcited by 16
  9. 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narrativescited by 8
  10. 2026Data-Forcing Distillation: Restoring Diversity and Fidelity in Few-Step Video Generationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon
  2. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
  3. 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory
  4. 2026GameWAM: A World Action Model for Video Games
  5. 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
  6. 2024Pandora: Towards General World Model with Natural Language Actions and Video States
  7. 2025Yume-1.5: A Text-Controlled Interactive World Generation Model
  8. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models