mlsanityData to 7 Oct 2026

StatePlay: State-Aware Game World Models for Mechanics-Consistent Generation

arXiv 2607.26754 ↗First posted 29 Jul 2026cs.CVcited by 5

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Recent game world models can generate visually realistic and interactive environments conditioned on player actions. However, games are not defined by pixels alone; they are governed by explicit mechanics, namely state-dependent rules that control health reduction, skill activation, and game termination. These mechanics depend on precise internal states, such as health points, skill meters, and timers, which are tightly coupled with visual observations and determine how gameplay evolves. Without modeling these state dynamics, existing game world models may generate visually plausible rollouts but violate the underlying game rules. In this paper, we propose StatePlay, a novel state-aware game world model that jointly predicts visual content and game states to promote mechanics-consistent generation. StatePlay adopts a mixture-of-transformers (MoT)-style architecture that preserves specialized visual and state representations while enabling cross-modal interaction, allowing predicted states to guide frame generation. Each branch is further optimized with a distinct objective suited to its modality. Experiments show that StatePlay achieves an average normalized L1 distance below 0.06 for state prediction. Furthermore, compared with models without explicit state modeling, our method improves mechanics fidelity in generated game rollouts by 18.6%. Overall, our work highlights the importance of state-aware game world modeling and advances beyond pixel-level realism toward complete and mechanically faithful game generation.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 23 of its 32 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

23 of 32 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026From Pixels to States: Rethinking Interactive World Models as Game Engines15 Jul
  2. 2026SCOPE: Simulating Cross-game Operations in Playable Environments for FPS World Models22 May
  3. 2026Incantation: Natural Language as the Action Interface for Multi-Entity Video World Models18 May
  4. 2026ReactiveGWM: Steering NPC in Reactive Game World Models14 May
  5. 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Models20 Apr
  6. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
  7. 2026WildWorld: A Large-Scale Dataset for Dynamic World Modeling with Actions and Explicit State toward Generative ARPG24 Mar
  8. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar

Other references · 14

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  6. 2026World Action Models are Zero-shot Policiescited by 411
  7. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  8. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
  9. 2022Model-Based Imitation Learning for Urban Drivingcited by 149
  10. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 147
  11. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 142
  12. 2026World Model for Robot Learning: A Comprehensive Surveycited by 42
2 more
  1. 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
  2. 2026BagelVLA: Enhancing Long-Horizon Manipulation via Interleaved Vision-Language-Action Generationcited by 25

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026WorldMind: Decoupled Game World Model for State-Aware NPC Behavior
  2. 2026GameWAM: A World Action Model for Video Games
  3. 2026Programmable World Model
  4. 2025Model as a Game: On Numerical and Spatial Consistency for Generative Games
  5. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model
  6. 2025Matrix-Game: Interactive World Foundation Model
  7. 2026Mind-Studio: Executable World Models with Lookahead Evaluation for Partially Observable Games
  8. 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives