mlsanityData to 14 Oct 2026

Super-Exponential Regret for UCT, AlphaGo and Variants

arXiv 2405.04407 ↗First posted 7 May 2024cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

We improve the proofs of the lower bounds of Coquelin and Munos (2007) that demonstrate that UCT can have exp(dotsexp(1)dots) regret (with Omega(D) exp terms) on the D-chain environment, and that a `polynomial' UCT variant has exp2(exp2(D - O(log D))) regret on the same environment -- the original proofs contain an oversight for rewards bounded in [0, 1], which we fix in the present draft. We also adapt the proofs to AlphaGo's MCTS and its descendants (e.g., AlphaZero, Leela Zero) to also show exp2(exp2(D - O(log D))) regret.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 2 of its 5 references that are in the map. First posted on arXiv 7 May 2024.

Builds on

2 of 5 references.

References · 2

  1. 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 734
  2. 2014Bandit Algorithms for Tree Searchcited by 25

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.