mlsanityData to 14 Oct 2026

A Multi-Agent Pokemon Tournament for Evaluating Strategic Reasoning of Large Language Models

arXiv 2508.01623 ↗First posted 3 Aug 2025cs.AIcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

This research presents LLM Pokemon League, a competitive tournament system that leverages Large Language Models (LLMs) as intelligent agents to simulate strategic decision-making in Pok'emon battles. The platform is designed to analyze and compare the reasoning, adaptability, and tactical depth exhibited by different LLMs in a type-based, turn-based combat environment. By structuring the competition as a single-elimination tournament involving diverse AI trainers, the system captures detailed decision logs, including team-building rationale, action selection strategies, and switching decisions. The project enables rich exploration into comparative AI behavior, battle psychology, and meta-strategy development in constrained, rule-based game environments. Through this system, we investigate how modern LLMs understand, adapt, and optimize decisions under uncertainty, making Pok'emon League a novel benchmark for AI research in strategic reasoning and competitive learning.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 1 of its 9 references that are in the map. First posted on arXiv 3 Aug 2025.

Builds on

1 of 9 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Tracing LLM Reasoning Processes with Strategic Games: A Framework for Planning, Revision, and Resource-Constrained Decision Making13 Jun

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Large Language Models as Pok'emon Battle Agents: Strategic Play and Content Generation
  2. 2024GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluations
  3. 2025Pok'eAI: A Goal-Generating, Battle-Optimizing Multi-agent System for Pokemon Red
  4. 2025Game Reasoning Arena: A Framework and Benchmark for Assessing Reasoning Capabilities of Large Language Models via Game Play
  5. 2026Beyond Scaling: Assessing Strategic Reasoning and Rapid Decision-Making Capability of LLMs in Zero-sum Environments
  6. 2023Strategic Reasoning with Language Models
  7. 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models
  8. 2024STRIDE: A Tool-Assisted LLM Agent Framework for Strategic and Interactive Decision-Making