Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Condition
Not on the map. Why?
Cited by 68 in World models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Recent advances in diffusion-based and controllable video generation have enabled high-quality and temporally coherent video synthesis, laying the groundwork for immersive interactive gaming experiences. However, current methods face limitations in dynamics, generality, long-term consistency, and efficiency, which limit the ability to create various gameplay videos. To address these gaps, we introduce Hunyuan-GameCraft, a novel framework for high-dynamic interactive video generation in game environments. To achieve fine-grained action control, we unify standard keyboard and mouse inputs into a shared camera representation space, facilitating smooth interpolation between various camera and movement operations. Then we propose a hybrid history-conditioned training strategy that extends video sequences autoregressively while preserving game scene information. Additionally, to enhance inference efficiency and playability, we achieve model distillation to reduce computational overhead while maintaining consistency across long temporal sequences, making it suitable for real-time deployment in complex interactive environments. The model is trained on a large-scale dataset comprising over one million gameplay recordings across over 100 AAA games, ensuring broad coverage and diversity, then fine-tuned on a carefully annotated synthetic dataset to enhance precision and control. The curated game scene data significantly improves the visual fidelity, realism and action controllability. Extensive experiments demonstrate that Hunyuan-GameCraft significantly outperforms existing models, advancing the realism and playability of interactive game video generation.
Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). Builds on 26 of its 33 references that are in the map. First posted on arXiv 20 Jun 2025.
Builds on
26 of 33 references.
References · 26
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
14 more
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 300
- 2024Diffusion Models Are Real-Time Game Enginescited by 282
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 242
- 2024GameGen-X: Interactive Open-world Game Video Generationcited by 124
- 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 124
- 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 119
- 2025One-Minute Video Generation with Test-Time Trainingcited by 100
- 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
- 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 87
- 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 87
- 2024Phased Consistency Modelscited by 83
- 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 79
- 2024ViD-GPT: Introducing GPT-style Autoregressive Generation in Video Diffusion Modelscited by 33
- 2025Hunyuan-Game: Industrial-grade Intelligent Game Creation Modelcited by 4
Built on by
Citing papers per year: 2025: 18; 2026: 74.
92 papers.
Sort:
By area:
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 174
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 152
- 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 89
- 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulationcited by 74
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
- 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 71
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 46
- 2025World-in-World: World Models in a Closed-Loop Worldcited by 44
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memorycited by 37
- 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
38 more
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 34
- 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 29
- 2025Pack and Force Your Memory: Long-form and Consistent Video Generationcited by 26
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 26
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Modelscited by 24
- 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 22
- 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Modelscited by 20
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Modelscited by 20
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 18
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Modelscited by 17
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 15
- 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generationcited by 14
- 2025BAgger: Backwards Aggregation for Mitigating Drift in Autoregressive Video Diffusion Modelscited by 13
- 2026WildWorld: A Large-Scale Dataset for Dynamic World Modeling with Actions and Explicit State toward Generative ARPGcited by 13
- 2026Wonder: Video World Model Done Bettercited by 13
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless Worldcited by 13
- 2026StableWorld: Towards Stable and Consistent Long Interactive Video Generationcited by 12
- 2026Geometry-Aware Rotary Position Embedding for Consistent Video World Modelcited by 12
- 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Enginescited by 12
- 2026WorldCam: Interactive Autoregressive 3D Gaming Worlds with Camera Pose as a Unifying Geometric Representationcited by 12
- 2026LOME: Learning Human-Object Manipulation with Action-Conditioned Egocentric World Modelcited by 12
- 2025FG-CLIP 2: A Bilingual Fine-grained Vision-Language Alignment Modelcited by 11
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 10
- 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environmentscited by 10
- 2026EchoWM: Open and Enterable Omnimodal World Modelscited by 10
- 2025WorldWander: Bridging Egocentric and Exocentric Worlds in Video Generationcited by 9
- 2025LongVie 2: Multimodal Controllable Ultra-Long Video World Modelcited by 9
- 2026Plenoptic Video Generationcited by 9
- 2026ShareVerse: Multi-Agent Consistent Video Generation for Shared World Modelingcited by 9
- 2026Code World Model: Coding Agent as World Braincited by 9
- 2026Prisma-World: Camera-Controllable Multi-Agent Video World Modelcited by 8
- 2026Current World Models Lack a Persistent State Corecited by 8
- 2026Evolution of Video Generative Foundationscited by 6
- 2026Memorize When Needed: Decoupled Memory Control for Spatially Consistent Long-Horizon Video Generationcited by 6
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
- 2026RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulationcited by 6
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
50 most cited of 92 All 92 (JSON)
- 20264Director: Controlling Video World Models with Rigid 3D Geometry1 Oct 2026
- 2026HelixWorld: A Real-time Interactive Audio-Visual World Model29 Sep 2026
- 2026Waypoint-1.5: A Real-Time Video World Model for Consumer Hardware29 Sep 2026
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon28 Sep 2026
- 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generation28 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory21 Sep 2026
- 2026HappyWorld-Bench21 Sep 2026
- 2026OnlineWM: Causality-Aware Active Online Learning for Effective World Modeling20 Sep 2026
- 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control15 Sep 2026
- 2026World in World: Explore the World with World Models10 Sep 2026
38 more
- 2026Valerant: An Automatic Navigable Game Map Generator via Action-Conditioned World Model Exploration8 Sep 2026
- 2026WorldReward: Reward Modeling for Camera-Conditioned World Models3 Sep 2026
- 2026OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mapping3 Sep 2026
- 2026Code World Model: Coding Agent as World Brain26 Aug 2026
- 2026EchoWM: Open and Enterable Omnimodal World Models24 Aug 2026
- 2026Marionette: Predicting World States, Rendering Geometry, Painting Appearance14 Aug 2026
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives13 Aug 2026
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug 2026
- 2026Sekai2: From World Exploration to Interactive World Modeling10 Aug 2026
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Models5 Aug 2026
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug 2026
- 2026Wonder: Video World Model Done Better28 Jul 2026
- 2026Real-Time Human-Centric World Modeling for Upper-Body Human-Object Interaction26 Jul 2026
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines15 Jul 2026
- 2026AlayaWorld: Long-Horizon and Playable Video World Generation7 Jul 2026
- 2026Ink3D: Sculpting 3D Assets with Extremely Complex Textures via Video Generative Models1 Jul 2026
- 2026EMOSH: Expressive Motion and Shape Disentanglement for Human Animation26 Jun 2026
- 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environments25 Jun 2026
- 2026Current World Models Lack a Persistent State Core18 Jun 2026
- 2026Holo-World: Unified Camera, Object and Weather Control for Video World Model18 Jun 2026
- 2026EgoCS-400K: An Egocentric Gameplay Dataset for World Models16 Jun 2026
- 2026PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory15 Jun 2026
- 2026Prisma-World: Camera-Controllable Multi-Agent Video World Model8 Jun 2026
- 2026DisCo: World Models with Discrete Camera Motion Control6 Jun 2026
- 2026Streaming Video Generation with Streaming Force Control5 Jun 2026
- 2026From Zero to Hero: Training-Free Custom Concept Spawning in World Models1 Jun 2026
- 2026RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulation1 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory29 May 2026
- 2026Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generation29 May 2026
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May 2026
- 2026WorldCraft: From Camera Navigation to Object Manipulation in Interactive Video World Models24 May 2026
- 2026PROWL: Prioritized Regret-Driven Optimization for World Model Learning11 May 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models23 Apr 2026
- 2026Memorize When Needed: Decoupled Memory Control for Spatially Consistent Long-Horizon Video Generation20 Apr 2026
- 2026Lyra 2.0: Explorable Generative 3D Worlds14 Apr 2026
- 2026Evolution of Video Generative Foundations7 Apr 2026
50 newest of 92 All 92 (JSON)
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 174
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 152
- 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 89
- 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulationcited by 74
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 46
- 2025World-in-World: World Models in a Closed-Loop Worldcited by 44
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memorycited by 37
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 34
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 26
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Modelscited by 24
- 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 22
- 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Modelscited by 20
12 most cited of 68 All 68 (JSON)
- 20264Director: Controlling Video World Models with Rigid 3D Geometry1 Oct 2026
- 2026HelixWorld: A Real-time Interactive Audio-Visual World Model29 Sep 2026
- 2026Waypoint-1.5: A Real-Time Video World Model for Consumer Hardware29 Sep 2026
- 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon28 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026Code Plans, Diffusion Renders: Open-Ended Generative World Modeling22 Sep 2026
- 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory21 Sep 2026
- 2026HappyWorld-Bench21 Sep 2026
- 2026OnlineWM: Causality-Aware Active Online Learning for Effective World Modeling20 Sep 2026
- 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control15 Sep 2026
- 2026World in World: Explore the World with World Models10 Sep 2026
- 2026Valerant: An Automatic Navigable Game Map Generator via Action-Conditioned World Model Exploration8 Sep 2026
12 newest of 68 All 68 (JSON)
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 15
- 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generationcited by 14
- 2026Rotate Your Character: Revisiting Video Diffusion Models for High-Quality 3D Character Generationcited by 1
- 2026OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mappingcited by 0
- 2026OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mapping3 Sep 2026
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories2 Mar 2026
- 2026Rotate Your Character: Revisiting Video Diffusion Models for High-Quality 3D Character Generation9 Jan 2026
- 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generation22 Oct 2025
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generation2 Oct 2025
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 72
- 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 71
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
- 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
- 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 29
- 2025Pack and Force Your Memory: Long-form and Consistent Video Generationcited by 26
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 18
- 2026StableWorld: Towards Stable and Consistent Long Interactive Video Generationcited by 12
- 2025FG-CLIP 2: A Bilingual Fine-grained Vision-Language Alignment Modelcited by 11
- 2026Plenoptic Video Generationcited by 9
- 2026Memorize When Needed: Decoupled Memory Control for Spatially Consistent Long-Horizon Video Generationcited by 6
- 2025SoundReactor: Frame-level Online Video-to-Audio Generationcited by 4
12 most cited of 19 All 19 (JSON)
- 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generation28 Sep 2026
- 2026Ink3D: Sculpting 3D Assets with Extremely Complex Textures via Video Generative Models1 Jul 2026
- 2026EMOSH: Expressive Motion and Shape Disentanglement for Human Animation26 Jun 2026
- 2026PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory15 Jun 2026
- 2026Streaming Video Generation with Streaming Force Control5 Jun 2026
- 2026Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generation29 May 2026
- 2026Memorize When Needed: Decoupled Memory Control for Spatially Consistent Long-Horizon Video Generation20 Apr 2026
- 2026Lyra 2.0: Explorable Generative 3D Worlds14 Apr 2026
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generation5 Mar 2026
- 2026Helios: Real Real-Time Long Video Generation Model4 Mar 2026
- 2026LoL: Longer than Longer, Scaling Video Generation to Hour23 Jan 2026
- 2026StableWorld: Towards Stable and Consistent Long Interactive Video Generation21 Jan 2026
12 newest of 19 All 19 (JSON)