mlsanityData to 14 Oct 2026

Position: Interactive Generative Video as Next-Generation Game Engine

arXiv 2503.17359 ↗First posted 21 Mar 2025cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

Modern game development faces significant challenges in creativity and cost due to predetermined content in traditional game engines. Recent breakthroughs in video generation models, capable of synthesizing realistic and interactive virtual environments, present an opportunity to revolutionize game creation. In this position paper, we propose Interactive Generative Video (IGV) as the foundation for Generative Game Engines (GGE), enabling unlimited novel content generation in next-generation gaming. GGE leverages IGV's unique strengths in unlimited high-quality content synthesis, physics-aware world modeling, user-controlled interactivity, long-term memory capabilities, and causal reasoning. We present a comprehensive framework detailing GGE's core modules and a hierarchical maturity roadmap (L0-L4) to guide its evolution. Our work charts a new course for game development in the AI era, envisioning a future where AI-powered generative systems fundamentally reshape how games are created and experienced.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 101 of its 130 references that are in the map. First posted on arXiv 21 Mar 2025.

Builds on

101 of 130 references.

References · 101

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2023Visual Instruction Tuningcited by 7,869
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2022Flow Matching for Generative Modelingcited by 5,702
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  12. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
38 more
  1. 2023Qwen Technical Reportcited by 3,344
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  4. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  5. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  6. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  7. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  8. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  9. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  10. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  11. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
  12. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  13. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  14. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  15. 2022A Generalist Agentcited by 808
  16. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  17. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  18. 2024Genie: Generative Interactive Environmentscited by 747
  19. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  20. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  21. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
  22. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  23. 2024Autoregressive Image Generation without Vector Quantizationcited by 651
  24. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  25. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  26. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  27. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  28. 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
  29. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  30. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  31. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
  32. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  33. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
  34. 2023Learning Interactive Real-World Simulatorscited by 458
  35. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  36. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 398
  37. 2022MAGVIT: Masked Generative Video Transformercited by 346
  38. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341

50 most cited of 101 All 101 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 5.

13 papers.

Sort:

By area:

  1. 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
  2. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
  3. 2025A Survey of Interactive Generative Videocited by 23
  4. 2025VIKI-R: Coordinating Embodied Multi-Agent Cooperation via Reinforcement Learningcited by 18
  5. 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
  6. 2026MemLearner: Learning to Query Context memory for Video World Modelscited by 9
  7. 2025CDP: Towards Robust Autoregressive Visuomotor Policy Learning via Causal Diffusioncited by 8
  8. 2026Marionette: Predicting World States, Rendering Geometry, Painting Appearancecited by 6
  9. 2026Aligning Agentic World Models via Knowledgeable Experience Learningcited by 5
  10. 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
  11. 2025VisionDirector: Vision-Language Guided Closed-Loop Refinement for Generative Image Synthesiscited by 3
  12. 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interactioncited by 3
1 more
  1. 2025GauDP: Reinventing Multi-Agent Collaboration through Gaussian-Image Synergy in Diffusion Policiescited by 2

Similar, not cited

Close in wording, no citation either way

  1. 2025GameFactory: Creating New Games with Generative Interactive Videos
  2. 2026AlayaWorld: Long-Horizon and Playable Video World Generation
  3. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model
  4. 2026Scalable Generative Game Engine: Breaking the Resolution Wall via Hardware-Algorithm Co-Design
  5. 2024Unbounded: A Generative Infinite Game of Character Life Simulation
  6. 2026GameCraft-Bench: Can Agents Build Playable Games End-to-End in a Real Game Engine?
  7. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model
  8. 2025Yan: Foundational Interactive Video Generation