Model as a Game: On Numerical and Spatial Consistency for Generative Games
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Recent advances in generative models have significantly impacted game generation. However, despite producing high-quality graphics and adequately receiving player input, existing models often fail to maintain fundamental game properties such as numerical and spatial consistency. Numerical consistency ensures gameplay mechanics correctly reflect score changes and other quantitative elements, while spatial consistency prevents jarring scene transitions, providing seamless player experiences. In this paper, we revisit the paradigm of generative games to explore what truly constitutes a Model as a Game (MaaG) with a well-developed mechanism. We begin with an empirical study on ``Traveler'', a 2D game created by an LLM featuring minimalist rules yet challenging generative models in maintaining consistency. Based on the DiT architecture, we design two specialized modules: (1) a numerical module that integrates a LogicNet to determine event triggers, with calculations processed externally as conditions for image generation; and (2) a spatial module that maintains a map of explored areas, retrieving location-specific information during generation and linking new observations to ensure continuity. Experiments across three games demonstrate that our integrated modules significantly enhance performance on consistency metrics compared to baselines, while incurring minimal time overhead during inference.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 37 of its 46 references that are in the map. First posted on arXiv 27 Mar 2025.
Builds on
37 of 46 references.
Closest ancestors · 7
Same direction, newest first
- 2025GameFactory: Creating New Games with Generative Interactive Videos14 Jan
- 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
- 2024Unbounded: A Generative Infinite Game of Character Life Simulation24 Oct
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2024Genie: Generative Interactive Environments23 Feb
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 30
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
- 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 304
18 more
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
- 2024ControlNet++: Improving Conditional Controls with Efficient Consistency Feedbackcited by 154
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
- 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
- 2020Learning to Simulate Dynamic Environments with GameGANcited by 86
- 2023VideoControlNet: A Motion-Guided Video-to-Video Translation Framework by Using Diffusion Model with ControlNetcited by 83
- 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 80
- 2024World-consistent Video Diffusion with Explicit 3D Modelingcited by 65
- 2021Playable Video Generationcited by 64
- 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Modelscited by 64
- 2024TrackGo: A Flexible and Efficient Method for Controllable Video Generationcited by 39
- 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
- 2024Playable Game Generationcited by 26
- 2023Promptable Game Models: Text-Guided Game Simulation via Masked Diffusion Modelscited by 22
- 2024InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructionscited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025A Survey of Interactive Generative Videocited by 23
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
- 2026Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiversecited by 3
- 2026AI for Games in the Foundation Model Eracited by 3
- 2025Adapting Vision-Language Models for Evaluating World Modelscited by 1
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiverse11 May 2026
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap11 Nov 2025
- 2025Adapting Vision-Language Models for Evaluating World Models22 Jun 2025
- 2025A Survey of Interactive Generative Video30 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines
- 2026StatePlay: State-Aware Game World Models for Mechanics-Consistent Generation
- 2026Code2Games: Enabling Coding Agents for Gaming World Generation
- 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Models
- 2026MAGIC: Transition-Aware Generation of Navigable Multi-Scene Game Worlds with Large Language Models
- 2026GameCraft-Bench: Can Agents Build Playable Games End-to-End in a Real Game Engine?
- 2026All in One: Generative Modeling as Mean-Field Game Design
- 2025Toward Stable World Models: Measuring and Addressing World Instability in Generative Environments