AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Unlike conventional video game development, which relies on labor-intensive pipelines for asset production, animation, physics, and programming, video world models generate interactive environments from user inputs instantly. It enable us to create customized, explorable, and continuously evolving virtual world from text, an image, or video. Realizing this vision requires four tightly coupled capabilities: interaction, persistent spatiotemporal consistency, stable long-horizon generation, and efficient response. We present AlayaWorld, an interactive long-horizon video world model that generates 24-fps video at 540p and 720p. Built on a 15B video diffusion transformer, AlayaWorld generates short latent chunks autoregressively under camera trajectories and switchable text prompts. Its bounded visual context combines a persistent sink frame, compressed temporal history, geometry-aligned spatial memory, and recent-frame conditioning. To reduce long-term drift, the model is trained with corrupted histories and prediction residuals collected from its own roll-outs. We further introduce a discrete autoregressive distillation formulation that combines distribution-matching distillation, self-forcing++, and consistency distillation, reducing inference from approximately 30 sampling steps to four steps per chunk. On iWorld-Bench, AlayaWorld achieves the best performance over long-horizon generation. Conceived as a full-stack, open-source, and long-term project, AlayaWorld is intended to provide an extensible foundation for future research on interactive video world models.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 28 of its 34 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
28 of 34 references.
Closest ancestors · 7
Same direction, newest first
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models24 Jun
- 2026Next Forcing: Causal World Modeling with Multi-Chunk Prediction9 Jun
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework5 May
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models23 Apr
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025Yume: An Interactive World Generation Model23 Jul
- 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb
Other references · 21
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2023Consistency Modelscited by 1,778
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2025Gemma 3 Technical Reportcited by 1,686
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 414
9 more
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
- 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 68
- 2025Sekai: A Video Dataset towards World Explorationcited by 64
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
- 2026OmniShotCut: Holistic Relational Shot Boundary Detection with Shot-Query Transformercited by 5
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Programmable World Modelcited by 7
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generationcited by 2
- 2026WorldRover: A Scalable Synthetic Video Data Engine for World Exploration with Rich Annotationscited by 1
- 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Videocited by 1
- 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
- 2026World in World: Explore the World with World Modelscited by 0
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizoncited by 0
- 2026MUGEN: Interactive Panoramic World Exploration via Camera Controlcited by 0
- 2026ROWBench: Do Video Models Render What the Program Specifies?cited by 0
- 2026ROWBench: Do Video Models Render What the Program Specifies?1 Oct 2026
- 2026MUGEN: Interactive Panoramic World Exploration via Camera Control29 Sep 2026
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon28 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Video13 Sep 2026
- 2026World in World: Explore the World with World Models10 Sep 2026
- 2026Programmable World Model9 Sep 2026
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generation27 Aug 2026
- 2026WorldRover: A Scalable Synthetic Video Data Engine for World Exploration with Rich Annotations16 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026AlayaWorld: Long-Horizon and Playable Video World Generation
- 2026AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (v1.1)
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory
- 2026DreamX-World 1.0: A General-Purpose Interactive World Model
- 2025MagicWorld: Towards Long-Horizon Stability for Interactive Video World Exploration
- 2026LIVE: Long-horizon Interactive Video World Modeling
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
- 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory