Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
We introduce Zing-0.5, a 5B autoregressive world model designed for playability: users can explore generated worlds, influence unfolding events, and respond to the resulting feedback through joint keyboard and online text control. Our approach brings together three technical contributions: (1) Unified action and text conditioning, combining magnitude-aware keyboard inputs with temporally aligned text instructions and jointly annotated videos to learn navigation and event control within the same sequence; (2) Event-scale supervision for incremental generation, using a segment-level teacher trained on connected multi-prompt videos to supervise a block-level causal student through distribution-matching distillation; and (3) Low-cost real-time interaction, combining four-step generation with context-preserving streaming to support 832 x 480 inference at 24 FPS at an estimated server rental cost of approximately USD 0.009 per stream-minute. Zing-0.5 achieves an overall score of 81.0 and a consistency score of 88.5 across 158 WBench Navigation cases. A joint-control demonstration shows a text-directed event change during continued navigation without restarting generation. We release the model weights, inference code, and Zing-SGLang serving implementation to support further work on playable generated worlds.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 38 of its 41 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
38 of 41 references.
Closest ancestors · 16
Same direction, newest first
- 2026H3-World: Turning Language Understanding into World Control1 Sep
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds24 Aug
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul
- 2026DisCo: World Models with Discrete Camera Motion Control6 Jun
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
- 2026WorldCam: Interactive Autoregressive 3D Gaming Worlds with Camera Pose as a Unifying Geometric Representation17 Mar
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb
- 2026Advancing Open-source World Models28 Jan
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
4 more
Other references · 22
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Consistency Modelscited by 1,778
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
- 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 135
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
10 more
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
- 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 38
- 2026Infinite Worlds with Versatile Interactionscited by 37
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 25
- 2025CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow Map Modelscited by 18
- 2026Self Gradient Forcing: Native Long Video Extrapolationcited by 16
- 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narrativescited by 8
- 2026Data-Forcing Distillation: Restoring Diversity and Fidelity in Few-Step Video Generationcited by 7
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory
- 2026GameWAM: A World Action Model for Video Games
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
- 2024Pandora: Towards General World Model with Natural Language Actions and Video States
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Model
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models