A Multi-Agent Pokemon Tournament for Evaluating Strategic Reasoning of Large Language Models
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
This research presents LLM Pokemon League, a competitive tournament system that leverages Large Language Models (LLMs) as intelligent agents to simulate strategic decision-making in Pok'emon battles. The platform is designed to analyze and compare the reasoning, adaptability, and tactical depth exhibited by different LLMs in a type-based, turn-based combat environment. By structuring the competition as a single-elimination tournament involving diverse AI trainers, the system captures detailed decision logs, including team-building rationale, action selection strategies, and switching decisions. The project enables rich exploration into comparative AI behavior, battle psychology, and meta-strategy development in constrained, rule-based game environments. Through this system, we investigate how modern LLMs understand, adapt, and optimize decisions under uncertainty, making Pok'emon League a novel benchmark for AI research in strategic reasoning and competitive learning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 1 of its 9 references that are in the map. First posted on arXiv 3 Aug 2025.
Builds on
1 of 9 references.
Closest ancestors · 1
Same direction, newest first
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Large Language Models as Pok'emon Battle Agents: Strategic Play and Content Generation
- 2024GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluations
- 2025Pok'eAI: A Goal-Generating, Battle-Optimizing Multi-agent System for Pokemon Red
- 2025Game Reasoning Arena: A Framework and Benchmark for Assessing Reasoning Capabilities of Large Language Models via Game Play
- 2026Beyond Scaling: Assessing Strategic Reasoning and Rapid Decision-Making Capability of LLMs in Zero-sum Environments
- 2023Strategic Reasoning with Language Models
- 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models
- 2024STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making