mlsanityData to 7 Oct 2026

PokaiTrainer: Scaling Equilibrium Search to Competitive Pok'emon VGC

arXiv 2608.29197 ↗First posted 29 Aug 2026cs.LG cs.AI cs.GTcited by 0

Not on the map. Why?

Abstract (arXiv)

Decision-time equilibrium search carried poker to superhuman play, but it has so far relied on tractable subgames: a handful of actions per decision, chance confined to card deals, one player moving at a time. Competitive Pok'emon in its official doubles format (VGC) breaks all three assumptions at once. Both players act simultaneously from joint menus in the hundreds, each joint action resolves to hundreds of stochastic outcomes, and the opponent's reserves and stat allocations are hidden. No prior Pok'emon agent performs equilibrium search, and whether it scales to this regime was open; we show that it does, and report what it took. PokaiEngine, our Rust battle engine, enumerates a joint action's full weighted outcome distribution in one pass, at ~99% parity with Pok'emon Showdown and a fraction of the cost of sampling it. PokaiTrainer adapts Student of Games to this scale and trains it by self-play over hundreds of human teams. Each decision is solved by counterfactual regret minimization as a Bayesian matrix game over public belief states, subgames grow under an explicit compute budget, and value targets are harvested from the interior of every solve and grounded by realized outcomes. The strength is in the search. The network's policy alone loses even to a shallow heuristic search. PokaiTrainer is, to our knowledge, the first VGC agent rated on the live Showdown ladder. Under open team sheets it wins 59% of 150 best-of-three sets against a human field averaging ~1320 Elo, holds a 1350-1400 Elo band, and at its peak reached 1492 Elo, entering the format's top 500.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 41 references that are in the map. First posted on arXiv 29 Aug 2026.

Builds on

13 of 41 references.

References · 13

  1. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
  2. 2017DeepStack: Expert-Level Artificial Intelligence in No-Limit Pokercited by 228
  3. 2022Mastering the Game of Stratego with Model-Free Multiagent Reinforcement Learningcited by 129
  4. 2020Combining Deep Reinforcement Learning and Search for Imperfect-Information Gamescited by 110
  5. 2018Solving Imperfect-Information Games via Discounted Regret Minimizationcited by 68
  6. 2020Human-Level Performance in No-Press Diplomacy via Equilibrium Searchcited by 41
  7. 2017Safe and Nested Subgame Solving for Imperfect-Information Gamescited by 39
  8. 2024PokeLLMon: A Human-Parity Agent for Pokemon Battles with Large Language Modelscited by 25
  9. 2021Student of Games: A unified learning algorithm for both perfect and imperfect information gamescited by 22
  10. 2025Pok'eChamp: an Expert-level Minimax Language Agentcited by 16
  11. 2025Human-Level Competitive Pok'emon via Scalable Offline Reinforcement Learning with Transformerscited by 4
  12. 2025VGC-Bench: Towards Mastering Diverse Team Strategies in Competitive Pok'emoncited by 3
1 more
  1. 2013Convergence of Monte Carlo Tree Search in Simultaneous Move Gamescited by 2

Built on by

Not cited yet.