ReactiveGWM: Steering NPC in Reactive Game World Models
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Existing game world models typically adopt role-specific interactions, where player and NPC roles are bound to fixed characters. This limits their flexibility in multi-character games, where different characters may receive external control while NPCs must react to interactions triggered by players. This setting raises two key challenges: how to flexibly assign control roles to individual characters, and how to support direct player control and reactive NPC behavior within a unified model. These challenges are particularly pronounced in shared-view 2D games, where multiple, potentially visually identical characters share the same viewpoint, making camera cues insufficient to distinguish their roles. To address these challenges, we introduce ReactiveGWM, a reactive game world model that flexibly assigns control modes at initialization and jointly simulates externally controlled players and reactive NPCs. Specifically, ReactiveGWM introduces Spatial Role Binding, which grounds learned character handles to their corresponding regions in the initial frame using instance masks. Building on these handles, Unified Agency Conditioning unifies heterogeneous control signals across characters by encoding player actions and conditional NPC rules into character-specific control-token groups. Each group is then bound to its corresponding character handle, enabling the model to apply each control signal to its designated character. Meanwhile, causal self-attention restricts temporal context to the current and preceding latent frames when generating player actions and NPC responses. Experiments on two multi-character 2D games demonstrate that ReactiveGWM supports flexible character control across different player/NPC role assignments while jointly generating accurate player-controlled behaviors and reactive NPC responses, enabling more configurable and richer multi-character interactions.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 9 of its 19 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
9 of 19 references.
Closest ancestors · 6
Same direction, newest first
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
- 2026ActionParty: Multi-Subject Action Binding in Generative Video Games2 Apr
- 2026Solaris: Building a Multiplayer Video World Model in Minecraft25 Feb
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2025GameFactory: Creating New Games with Generative Interactive Videos14 Jan
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
Other references · 3
- 2018World Modelscited by 1,513
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026StatePlay: State-Aware Game World Models for Mechanics-Consistent Generationcited by 6
- 2026Marionette: Predicting World States, Rendering Geometry, Painting Appearancecited by 6
- 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
- 2026H3-World: Turning Language Understanding into World Controlcited by 4
- 2026WorldMind: Decoupled Game World Model for State-Aware NPC Behaviorcited by 3
- 2026AI for Games in the Foundation Model Eracited by 3
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Modelscited by 1
- 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Modelscited by 1
- 2026LongLive-Plug: Once-for-All Distillation for Video Generationcited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generation29 Sep 2026
- 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Models22 Sep 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026H3-World: Turning Language Understanding into World Control1 Sep 2026
- 2026WorldMind: Decoupled Game World Model for State-Aware NPC Behavior18 Aug 2026
- 2026Marionette: Predicting World States, Rendering Geometry, Painting Appearance14 Aug 2026
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Models5 Aug 2026
- 2026StatePlay: State-Aware Game World Models for Mechanics-Consistent Generation29 Jul 2026
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines15 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026GameWAM: A World Action Model for Video Games
- 2026NitroGen: An Open Foundation Model for Generalist Gaming Agents
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model
- 2026Player-1: Learning to Play from Synthetic Experience
- 2026Mind-Studio: Executable World Models with Lookahead Evaluation for Partially Observable Games
- 2026Multiplayer Interactive World Models with Representation Autoencoders
- 2026COMBAT: Conditional World Models for Behavioral Agent Training
- 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Engines