AlayaWorld: Long-Horizon and Playable Video World Generation
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Game worlds have traditionally been built through labor-intensive production pipelines, making them costly to develop, difficult to customization, and expensive to modify after deployment. Recent advances in video world models offer a fundamentally different paradigm. Rather than explicitly authoring every component of a virtual environment, these models autoregressively synthesize future observations conditioned on the current world state and user interactions, enabling playable worlds to be generated online. Trained on both gameplay recordings and real-world videos, they can capture diverse visual appearances and physical dynamics, opening new opportunities for interactive applications beyond gaming, including embodied intelligence. In this paper, we present AlayaWorld, a full-stack open-source framework for building interactive generative worlds. AlayaWorld enables open-ended real-time interaction, allowing users to freely navigate and perform diverse actions such as combat, spell casting, and monster summoning. The framework unifies the complete development-from data preparation model architecture, model training, inference acceleration, and deployment-within a modular and extensible architecture. Alongside the framework, we release reproducible pipelines, reference implementations, evaluation tools, and comprehensive documentation, establishing a practical foundation for future research and real-time applications of generative world models.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 83 of its 95 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
83 of 95 references.
Closest ancestors · 27
Same direction, newest first
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds15 Apr
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb
- 2026Advancing Open-source World Models28 Jan
- 2025Unified Camera Positional Encoding for Controlled Video Generation8 Dec
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
- 2025EvoWorld: Evolving Panoramic World Generation with Explicit 3D Memory1 Oct
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025Yume: An Interactive World Generation Model23 Jul
- 2025Video World Models with Long-term Spatial Memory5 Jun
15 more
- 2025Long-Context State-Space Video World Models26 May
- 2025MAGI-1: Autoregressive Video Generation at Scale19 May
- 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
- 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft11 Apr
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2025GameFactory: Creating New Games with Generative Interactive Videos14 Jan
- 2024Open-Sora: Democratizing Efficient Video Production for All29 Dec
- 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
- 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
- 2024Genie: Generative Interactive Environments23 Feb
- 2024World Model on Million-Length Video And Language With Blockwise RingAttention13 Feb
- 2022Scalable Diffusion Models with Transformers19 Dec
Other references · 56
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2023Consistency Modelscited by 1,778
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
38 more
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
- 2024Training-free Camera Control for Video Generationcited by 119
- 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 115
- 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 115
- 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
- 2025Cameras as Relative Positional Encodingcited by 94
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
- 2023VideoLCM: Video Latent Consistency Modelcited by 90
- 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedbackcited by 84
- 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 79
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
- 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 71
- 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 68
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 68
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
- 2023Reuse and Diffuse: Iterative Denoising for Text-to-Video Generationcited by 49
- 2026Context Forcing: Consistent Autoregressive Video Generation with Long Contextcited by 47
- 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 44
- 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 43
- 2025VideoSSM: Autoregressive Long Video Generation with Hybrid State-Space Memorycited by 39
- 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
- 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
- 2024Playable Game Generationcited by 26
- 2023Promptable Game Models: Text-Guided Game Simulation via Masked Diffusion Modelscited by 22
- 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generationcited by 20
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Trainingcited by 1
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memorycited by 1
- 2026Oneira: From Open-Ended Generation to Open-World Interaction in Video World Modelscited by 1
- 2026MUGEN: Interactive Panoramic World Exploration via Camera Controlcited by 0
- 2026Oneira: From Open-Ended Generation to Open-World Interaction in Video World Models1 Oct 2026
- 2026MUGEN: Interactive Panoramic World Exploration via Camera Control29 Sep 2026
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory21 Sep 2026
- 2026IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Training31 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines
- 2026Programmable World Model
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
- 2026WildWorld: A Large-Scale Dataset for Dynamic World Modeling with Actions and Explicit State toward Generative ARPG
- 2026GameWAM: A World Action Model for Video Games
- 2025Matrix-Game: Interactive World Foundation Model
- 2025LatticeWorld: A Multimodal Large Language Model-Empowered Framework for Interactive Complex World Generation