mlsanityData to 14 Oct 2026

Yan: Foundational Interactive Video Generation

arXiv 2508.08601 ↗First posted 12 Aug 2025cs.CV cs.AIcited by 15

Not on the map. Why?

Abstract (arXiv)

We present Yan, a foundational framework for interactive video generation, covering the entire pipeline from simulation and generation to editing. Specifically, Yan comprises three core modules. AAA-level Simulation: We design a highly-compressed, low-latency 3D-VAE coupled with a KV-cache-based shift-window denoising inference process, achieving real-time 1080P/60FPS interactive simulation. Multi-Modal Generation: We introduce a hierarchical autoregressive caption method that injects game-specific knowledge into open-domain multi-modal video diffusion models (VDMs), then transforming the VDM into a frame-wise, action-controllable, real-time infinite interactive video generator. Notably, when the textual and visual prompts are sourced from different domains, the model demonstrates strong generalization, allowing it to blend and compose the style and mechanics across domains flexibly according to user prompts. Multi-Granularity Editing: We propose a hybrid model that explicitly disentangles interactive mechanics simulation from visual rendering, enabling multi-granularity video content editing during interaction through text. Collectively, Yan offers an integration of these modules, pushing interactive video generation beyond isolated capabilities toward a comprehensive AI-driven interactive creation paradigm, paving the way for the next generation of creative tools, media, and entertainment. The project page is: https://greatx3.github.io/Yan/.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 46 of its 54 references that are in the map. First posted on arXiv 12 Aug 2025.

Builds on

46 of 54 references.

References · 46

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2017Proximal Policy Optimization Algorithmscited by 15,215
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2025Qwen2.5-VL Technical Reportcited by 5,587
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  12. 2023A Survey of Large Language Modelscited by 2,576
34 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  3. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
  4. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  5. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  6. 2024Genie: Generative Interactive Environmentscited by 747
  7. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  8. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  9. 2023ModelScope Text-to-Video Technical Reportcited by 658
  10. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  11. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  12. 2025VACE: All-in-One Video Creation and Editingcited by 479
  13. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
  14. 2023Learning Interactive Real-World Simulatorscited by 458
  15. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  16. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
  17. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  18. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  19. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  20. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
  21. 2024Diffusion Models Are Real-Time Game Enginescited by 296
  22. 2024Navigation World Modelscited by 272
  23. 2024More Agents Is All You Needcited by 180
  24. 2016ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learningcited by 179
  25. 2025History-Guided Video Diffusioncited by 171
  26. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
  27. 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 130
  28. 2024GameGen-X: Interactive Open-world Game Video Generationcited by 128
  29. 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraftcited by 97
  30. 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 80
  31. 2025Goku: Flow Based Video Generative Foundation Modelscited by 67
  32. 2024Playable Game Generationcited by 26
  33. 2025A Survey of Interactive Generative Videocited by 23
  34. 2024Affordable Generative Agentscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 12.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflows
  2. 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing
  3. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model
  4. 2026StableWorld: Towards Stable and Consistent Long Interactive Video Generation
  5. 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
  6. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model
  7. 2025Pre-Trained Video Generative Models as World Simulators
  8. 2025Position: Interactive Generative Video as Next-Generation Game Engine