mlsanityData to 7 Oct 2026

AlayaWorld: Long-Horizon and Playable Video World Generation

arXiv 2607.06291 ↗First posted 7 Jul 2026cs.CV cs.HCcited by 4

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Game worlds have traditionally been built through labor-intensive production pipelines, making them costly to develop, difficult to customization, and expensive to modify after deployment. Recent advances in video world models offer a fundamentally different paradigm. Rather than explicitly authoring every component of a virtual environment, these models autoregressively synthesize future observations conditioned on the current world state and user interactions, enabling playable worlds to be generated online. Trained on both gameplay recordings and real-world videos, they can capture diverse visual appearances and physical dynamics, opening new opportunities for interactive applications beyond gaming, including embodied intelligence. In this paper, we present AlayaWorld, a full-stack open-source framework for building interactive generative worlds. AlayaWorld enables open-ended real-time interaction, allowing users to freely navigate and perform diverse actions such as combat, spell casting, and monster summoning. The framework unifies the complete development-from data preparation model architecture, model training, inference acceleration, and deployment-within a modular and extensible architecture. Alongside the framework, we release reproducible pipelines, reference implementations, evaluation tools, and comprehensive documentation, establishing a practical foundation for future research and real-time applications of generative world models.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 83 of its 95 references that are in the map. First posted on arXiv 7 Jul 2026.

Builds on

83 of 95 references.

Closest ancestors · 27

Same direction, newest first

  1. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
  2. 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds15 Apr
  3. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
  4. 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb
  5. 2026Advancing Open-source World Models28 Jan
  6. 2025Unified Camera Positional Encoding for Controlled Video Generation8 Dec
  7. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
  8. 2025EvoWorld: Evolving Panoramic World Generation with Explicit 3D Memory1 Oct
  9. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
  10. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  11. 2025Yume: An Interactive World Generation Model23 Jul
  12. 2025Video World Models with Long-term Spatial Memory5 Jun
15 more
  1. 2025Long-Context State-Space Video World Models26 May
  2. 2025MAGI-1: Autoregressive Video Generation at Scale19 May
  3. 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
  4. 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft11 Apr
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  6. 2025GameFactory: Creating New Games with Generative Interactive Videos14 Jan
  7. 2024Open-Sora: Democratizing Efficient Video Production for All29 Dec
  8. 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
  9. 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
  10. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  12. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
  13. 2024Genie: Generative Interactive Environments23 Feb
  14. 2024World Model on Million-Length Video And Language With Blockwise RingAttention13 Feb
  15. 2022Scalable Diffusion Models with Transformers19 Dec

Other references · 56

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  3. 2023Consistency Modelscited by 1,778
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  5. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  6. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  7. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  8. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  9. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  10. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  11. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  12. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
38 more
  1. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  2. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  3. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  4. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  5. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
  6. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  7. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  8. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163
  9. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
  10. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
  11. 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
  12. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
  13. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
  14. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  15. 2024Training-free Camera Control for Video Generationcited by 119
  16. 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 115
  17. 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 115
  18. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
  19. 2025Cameras as Relative Positional Encodingcited by 94
  20. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
  21. 2023VideoLCM: Video Latent Consistency Modelcited by 90
  22. 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedbackcited by 84
  23. 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 79
  24. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
  25. 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 71
  26. 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 68
  27. 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 68
  28. 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
  29. 2023Reuse and Diffuse: Iterative Denoising for Text-to-Video Generationcited by 49
  30. 2026Context Forcing: Consistent Autoregressive Video Generation with Long Contextcited by 47
  31. 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 44
  32. 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 43
  33. 2025VideoSSM: Autoregressive Long Video Generation with Hybrid State-Space Memorycited by 39
  34. 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
  35. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
  36. 2024Playable Game Generationcited by 26
  37. 2023Promptable Game Models: Text-Guided Game Simulation via Masked Diffusion Modelscited by 22
  38. 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generationcited by 20

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
  2. 2026From Pixels to States: Rethinking Interactive World Models as Game Engines
  3. 2026Programmable World Model
  4. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
  5. 2026WildWorld: A Large-Scale Dataset for Dynamic World Modeling with Actions and Explicit State toward Generative ARPG
  6. 2026GameWAM: A World Action Model for Video Games
  7. 2025Matrix-Game: Interactive World Foundation Model
  8. 2025LatticeWorld: A Multimodal Large Language Model-Empowered Framework for Interactive Complex World Generation