Beyond Playtesting: A Generative Multi-Agent Simulation System for Massively Multiplayer Online Games
On the map: LLM agents and tool use → Reinforcement learning for LLM agents
Abstract (arXiv)
Optimizing numerical systems and mechanism design is crucial for enhancing player experience in Massively Multiplayer Online (MMO) games. Traditional optimization approaches rely on large-scale online experiments or parameter tuning over predefined statistical models, which are costly, time-consuming, and may disrupt player experience. Although simplified offline simulation systems are often adopted as alternatives, their limited fidelity prevents agents from accurately mimicking real player reasoning and reactions to interventions. To address these limitations, we propose a generative agent-based MMO simulation system empowered by Large Language Models (LLMs). By applying Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) on large-scale real player behavioral data, we adapt LLMs from general priors to game-specific domains, enabling realistic and interpretable player decision-making. In parallel, a data-driven environment model trained on real gameplay logs reconstructs dynamic in-game systems. Experiments demonstrate strong consistency with real-world player behaviors and plausible causal responses under interventions, providing a reliable, interpretable, and cost-efficient framework for data-driven numerical design optimization.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 4 of its 7 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
4 of 7 references.
Closest ancestors · 1
Same direction, newest first
Other references · 3
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Societycited by 186
- 2023CompeteAI: Understanding the Competition Dynamics in Large Language Model-based Agentscited by 65
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026AI for Games in the Foundation Model Eracited by 3
- 2026AI for Games in the Foundation Model Era15 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025Orak: A Foundational Benchmark for Training and Evaluating LLM Agents on Diverse Video Games
- 2024Large Language Models as Agents in Two-Player Games
- 2024A Survey on Large Language Model-Based Game Agents
- 2025Agents Play Thousands of 3D Video Games
- 2025Learning Game-Playing Agents with Generative Code Optimization
- 2026Player-1: Learning to Play from Synthetic Experience
- 2024Massively Multiagent Minigames for Training Generalist Agents
- 2025Leveraging LLM Agents for Automated Video Game Testing