Yan: Foundational Interactive Video Generation
Not on the map. Why?
Abstract (arXiv)
We present Yan, a foundational framework for interactive video generation, covering the entire pipeline from simulation and generation to editing. Specifically, Yan comprises three core modules. AAA-level Simulation: We design a highly-compressed, low-latency 3D-VAE coupled with a KV-cache-based shift-window denoising inference process, achieving real-time 1080P/60FPS interactive simulation. Multi-Modal Generation: We introduce a hierarchical autoregressive caption method that injects game-specific knowledge into open-domain multi-modal video diffusion models (VDMs), then transforming the VDM into a frame-wise, action-controllable, real-time infinite interactive video generator. Notably, when the textual and visual prompts are sourced from different domains, the model demonstrates strong generalization, allowing it to blend and compose the style and mechanics across domains flexibly according to user prompts. Multi-Granularity Editing: We propose a hybrid model that explicitly disentangles interactive mechanics simulation from visual rendering, enabling multi-granularity video content editing during interaction through text. Collectively, Yan offers an integration of these modules, pushing interactive video generation beyond isolated capabilities toward a comprehensive AI-driven interactive creation paradigm, paving the way for the next generation of creative tools, media, and entertainment. The project page is: https://greatx3.github.io/Yan/.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 46 of its 54 references that are in the map. First posted on arXiv 12 Aug 2025.
Builds on
46 of 54 references.
References · 46
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023A Survey of Large Language Modelscited by 2,576
34 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024Genie: Generative Interactive Environmentscited by 747
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
- 2023Learning Interactive Real-World Simulatorscited by 458
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2023Pix2Video: Video Editing using Image Diffusioncited by 320
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2024Diffusion Models Are Real-Time Game Enginescited by 296
- 2024Navigation World Modelscited by 272
- 2024More Agents Is All You Needcited by 180
- 2016ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learningcited by 179
- 2025History-Guided Video Diffusioncited by 171
- 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
- 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 130
- 2024GameGen-X: Interactive Open-world Game Video Generationcited by 128
- 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraftcited by 97
- 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 80
- 2025Goku: Flow Based Video Generative Foundation Modelscited by 67
- 2024Playable Game Generationcited by 26
- 2025A Survey of Interactive Generative Videocited by 23
- 2024Affordable Generative Agentscited by 9
Built on by
Citing papers per year: 2025: 3; 2026: 12.
15 papers.
Sort:
By area:
- 2025World-in-World: World Models in a Closed-Loop Worldcited by 47
- 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Modelscited by 28
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Modelscited by 26
- 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generationcited by 24
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 22
- 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 15
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2026Efficient Video Diffusion Models: Advancements and Challengescited by 7
- 2025GeoWorld: Providing Full-frame Geometry Features to Facilitate 3D Scene Generationcited by 3
- 2026AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customizationcited by 3
- 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interactioncited by 3
- 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memorycited by 2
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interaction14 Jul 2026
- 2026AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customization5 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory29 May 2026
- 2026Efficient Video Diffusion Models: Advancements and Challenges17 Apr 2026
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models26 Mar 2026
- 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generation22 Mar 2026
- 2026Tri-Prompting: Video Diffusion with Unified Control over Scene, Subject, and Motion16 Mar 2026
- 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Models7 Mar 2026
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generation5 Mar 2026
- 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories16 Feb 2026
- 2025World-in-World: World Models in a Closed-Loop Worldcited by 47
- 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Modelscited by 28
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Modelscited by 26
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2026AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customizationcited by 3
- 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memorycited by 2
- 2025CustomX: Unified Character, Action, and Scene Customization in Video World Modelscited by 1
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?cited by 0
- 2026From Generation to Simulation: How Far Are World Models from Being True Simulators?24 Aug 2026
- 2026AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customization5 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory29 May 2026
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models26 Mar 2026
- 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Models7 Mar 2026
- 2025CustomX: Unified Character, Action, and Scene Customization in Video World Models18 Dec 2025
- 2025World-in-World: World Models in a Closed-Loop World20 Oct 2025
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 22
- 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 15
- 2025GeoWorld: Providing Full-frame Geometry Features to Facilitate 3D Scene Generationcited by 3
- 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interactioncited by 3
- 2026WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interaction14 Jul 2026
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generation5 Mar 2026
- 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories16 Feb 2026
- 2025GeoWorld: Providing Full-frame Geometry Features to Facilitate 3D Scene Generation28 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflows
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model
- 2026StableWorld: Towards Stable and Consistent Long Interactive Video Generation
- 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model
- 2025Pre-Trained Video Generative Models as World Simulators
- 2025Position: Interactive Generative Video as Next-Generation Game Engine