AI for Games in the Foundation Model Era
On the map: World models → World models for language agents
Abstract (arXiv)
Foundation models, alongside advances in learned game-world models, are reshaping AI across the game lifecycle. Beyond playing games, recent systems model players and game dynamics, support design and development, adapt player-facing experiences at runtime, and evaluate resulting artifacts. Yet these directions have evolved largely separately, obscuring which capabilities transfer across settings and which remain tied to particular games, engines, interfaces, or player populations. We organize the literature into six roles according to the immediate use of AI output: playing and acting; modeling players and games; designing games; building and maintaining games; generating and adapting at runtime; and testing and evaluating games. For each role, we examine what structure is supplied by the game or workflow, what AI learns or produces, which capabilities and artifacts transfer across settings and roles, and what evidence supports the claims. We identify cross-role connections: trajectories train world models, learned environments provide experience for agents, design specifications drive executable implementations, and play or testing feedback guides revision. However, control schemes, rules, engine interfaces, state representations, and player contexts often remain setting-specific, so downstream claims require validation in the target setting. Evaluation is most standardized for bounded game playing and selected learned environments, while persistent state in learned worlds, repeated software revision, validated player modeling, sustained runtime adaptation, and representative automated testing remain less established. The central challenge is to reuse or transfer outputs and capabilities across roles while re-establishing evidence for effectiveness in the game-specific contexts where they are used.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 255 of its 419 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
255 of 419 references.
Closest ancestors · 12
Same direction, newest first
- 2026Twin: Playing an Unknown Game with a Test-Time Digital Twin14 Aug
- 2026Distilling Game Code World Model Generation into Lightweight Large Language Models23 May
- 2025Agent2World: Learning to Generate Symbolic World Models via Adaptive Multi-Agent Feedback26 Dec
- 2025Code World Models for General Game Playing6 Oct
- 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society12 Feb
- 2024Project Sid: Many-agent simulations toward AI civilization31 Oct
- 2024Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Search24 May
- 2024MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Control18 Mar
- 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment19 Feb
- 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolf9 Sep
- 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge17 Jun
Other references · 243
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
- 2018World Modelscited by 1,444
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,084
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 903
- 2022A Generalist Agentcited by 802
- 2021Deep Reinforcement Learning at the Edge of the Statistical Precipicecited by 781
- 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 748
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2020MOPO: Model-based Offline Policy Optimizationcited by 630
38 more
- 2019The StarCraft Multi-Agent Challengecited by 589
- 2020MOReL : Model-Based Offline Reinforcement Learningcited by 582
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2019Model-Based Reinforcement Learning for Ataricited by 495
- 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2020Planning to Explore via Self-Supervised World Modelscited by 365
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
- 2024Justice or Prejudice? Quantifying Biases in LLM-as-a-Judgecited by 354
- 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 338
- 2022Transformers are Sample-Efficient World Modelscited by 317
- 2018TextWorld: A Learning Environment for Text-based Gamescited by 304
- 2024JudgeBench: A Benchmark for Evaluating LLM-based Judgescited by 294
- 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
- 2024Diffusion Models Are Real-Time Game Enginescited by 282
- 2017A Unified Game-Theoretic Approach to Multiagent Reinforcement Learningcited by 265
- 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 223
- 2018Machine Theory of Mindcited by 222
- 2017Learning with Opponent-Learning Awarenesscited by 218
- 2022Multi-Game Decision Transformerscited by 212
- 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 202
- 2020The NetHack Learning Environmentcited by 196
- 2021Benchmarking the Spectrum of Agent Capabilitiescited by 193
- 2021Open-Ended Learning Leads to Generally Capable Agentscited by 177
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 174
- 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
- 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 152
- 2023Language Agents with Reinforcement Learning for Strategic Play in the Werewolf Gamecited by 148
- 2026Advancing Open-source World Modelscited by 144
- 2024BALROG: Benchmarking Agentic LLM and VLM Reasoning On Gamescited by 141
- 2021Collaborating with Humans without Human Datacited by 139
- 2017Procedural Content Generation via Machine Learning (PCGML)cited by 136
- 2017Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problemscited by 126
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
50 most cited of 243 All 243 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Assessing Adaptive World Models in Machines with Novel Games
- 2026GameBoyWorlds: A Testbed for Self-Improvement in Embodied Video Games
- 2026Tycho: Active Abstraction with Programmatic World Models for ARC-AGI-3
- 2025Fly, Fail, Fix: Iterative Game Repair with Reinforcement Learning and Large Multimodal Models
- 2026Co-Evolving LLM Decision and Skill Bank Agents for Long-Horizon Tasks
- 2026AI Gamestore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games
- 2026Learn2Play Bench: How Well Do LLM Agents Learn from Experience in Unfamiliar Environments?
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond