mlsanityData to 7 Oct 2026

AI for Games in the Foundation Model Era

arXiv 2609.16679 ↗First posted 15 Sep 2026cs.AIcited by 2

On the map: World models → World models for language agents

Abstract (arXiv)

Foundation models, alongside advances in learned game-world models, are reshaping AI across the game lifecycle. Beyond playing games, recent systems model players and game dynamics, support design and development, adapt player-facing experiences at runtime, and evaluate resulting artifacts. Yet these directions have evolved largely separately, obscuring which capabilities transfer across settings and which remain tied to particular games, engines, interfaces, or player populations. We organize the literature into six roles according to the immediate use of AI output: playing and acting; modeling players and games; designing games; building and maintaining games; generating and adapting at runtime; and testing and evaluating games. For each role, we examine what structure is supplied by the game or workflow, what AI learns or produces, which capabilities and artifacts transfer across settings and roles, and what evidence supports the claims. We identify cross-role connections: trajectories train world models, learned environments provide experience for agents, design specifications drive executable implementations, and play or testing feedback guides revision. However, control schemes, rules, engine interfaces, state representations, and player contexts often remain setting-specific, so downstream claims require validation in the target setting. Evaluation is most standardized for bounded game playing and selected learned environments, while persistent state in learned worlds, repeated software revision, validated player modeling, sustained runtime adaptation, and representative automated testing remain less established. The central challenge is to reuse or transfer outputs and capabilities across roles while re-establishing evidence for effectiveness in the game-specific contexts where they are used.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 255 of its 419 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

255 of 419 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026Twin: Playing an Unknown Game with a Test-Time Digital Twin14 Aug
  2. 2026Distilling Game Code World Model Generation into Lightweight Large Language Models23 May
  3. 2025Agent2World: Learning to Generate Symbolic World Models via Adaptive Multi-Agent Feedback26 Dec
  4. 2025Code World Models for General Game Playing6 Oct
  5. 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society12 Feb
  6. 2024Project Sid: Many-agent simulations toward AI civilization31 Oct
  7. 2024Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Search24 May
  8. 2024MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Control18 Mar
  9. 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment19 Feb
  10. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolf9 Sep
  11. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
  12. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge17 Jun

Other references · 243

  1. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  2. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
  3. 2018World Modelscited by 1,444
  4. 2024A Survey on LLM-as-a-Judgecited by 1,384
  5. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  6. 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,084
  7. 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 903
  8. 2022A Generalist Agentcited by 802
  9. 2021Deep Reinforcement Learning at the Edge of the Statistical Precipicecited by 781
  10. 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 748
  11. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  12. 2020MOPO: Model-based Offline Policy Optimizationcited by 630
38 more
  1. 2019The StarCraft Multi-Agent Challengecited by 589
  2. 2020MOReL : Model-Based Offline Reinforcement Learningcited by 582
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  4. 2019Model-Based Reinforcement Learning for Ataricited by 495
  5. 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
  6. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  7. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  8. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  9. 2020Planning to Explore via Self-Supervised World Modelscited by 365
  10. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
  11. 2024Justice or Prejudice? Quantifying Biases in LLM-as-a-Judgecited by 354
  12. 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 338
  13. 2022Transformers are Sample-Efficient World Modelscited by 317
  14. 2018TextWorld: A Learning Environment for Text-based Gamescited by 304
  15. 2024JudgeBench: A Benchmark for Evaluating LLM-based Judgescited by 294
  16. 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
  17. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
  18. 2024Diffusion Models Are Real-Time Game Enginescited by 282
  19. 2017A Unified Game-Theoretic Approach to Multiagent Reinforcement Learningcited by 265
  20. 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 223
  21. 2018Machine Theory of Mindcited by 222
  22. 2017Learning with Opponent-Learning Awarenesscited by 218
  23. 2022Multi-Game Decision Transformerscited by 212
  24. 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 202
  25. 2020The NetHack Learning Environmentcited by 196
  26. 2021Benchmarking the Spectrum of Agent Capabilitiescited by 193
  27. 2021Open-Ended Learning Leads to Generally Capable Agentscited by 177
  28. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 174
  29. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
  30. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
  31. 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 152
  32. 2023Language Agents with Reinforcement Learning for Strategic Play in the Werewolf Gamecited by 148
  33. 2026Advancing Open-source World Modelscited by 144
  34. 2024BALROG: Benchmarking Agentic LLM and VLM Reasoning On Gamescited by 141
  35. 2021Collaborating with Humans without Human Datacited by 139
  36. 2017Procedural Content Generation via Machine Learning (PCGML)cited by 136
  37. 2017Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problemscited by 126
  38. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126

50 most cited of 243 All 243 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Assessing Adaptive World Models in Machines with Novel Games
  2. 2026GameBoyWorlds: A Testbed for Self-Improvement in Embodied Video Games
  3. 2026Tycho: Active Abstraction with Programmatic World Models for ARC-AGI-3
  4. 2025Fly, Fail, Fix: Iterative Game Repair with Reinforcement Learning and Large Multimodal Models
  5. 2026Co-Evolving LLM Decision and Skill Bank Agents for Long-Horizon Tasks
  6. 2026AI Gamestore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games
  7. 2026Learn2Play Bench: How Well Do LLM Agents Learn from Experience in Unfamiliar Environments?
  8. 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond