Does 1/2-Tsallis-INF Also Work Well for Best-Arm Identification?
Not on the map. Why?
Abstract (arXiv)
Regret minimization (RM) and best-arm identification (BAI) are two fundamental objectives in multi-armed bandits. Among regret-minimizing algorithms, 1/2-Tsallis-INF is a canonical best-of-both-worlds FTRL algorithm: it achieves logarithmic pseudo-regret in stochastic bandits while retaining minimax-optimal regret in adversarial bandits, without knowing the environment in advance. This raises a natural question: can the same algorithm, without additional exploration, also identify the best arm reliably? We study this question in stochastic bandits by analyzing the failure probability operatornameErrt, defined as the probability that the empirical best arm determined by the cumulative importance-weighted loss estimates of 1/2-Tsallis-INF differs from the true optimal arm. The main difficulty is that, at the logarithmic-regret scale, suboptimal arms are sampled with probability heuristically of order 1/t. Consequently, importance weighting causes the cumulative estimator to fluctuate on the same linear scale as its mean separation. To overcome this obstacle, guided by a diffusion toy model, we construct a Lyapunov function for the gap process between the estimated cumulative loss of the optimal arm and that of the best competing arm. This leads to polynomial upper bounds on operatornameErrt: for learning rate ηt=α/√ t, operatornameErrt decays at rate t^-2+α2μi_*/4+ρ for any ρ>0, where μi_* denotes the mean loss of the true optimal arm. We also establish a lower bound Omega(t-2-varepsilon) for any varepsilon>0, showing that the exponent 2 is essentially tight.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 25 references that are in the map. First posted on arXiv 15 Aug 2026.
Builds on
12 of 25 references.
References · 12
- 2018Tsallis-INF: An Optimal Algorithm for Stochastic and Adversarial Banditscited by 123
- 2019Beating Stochastic and Adversarial Semi-bandits Optimally and Simultaneouslycited by 53
- 2022Revisiting Simple Regret: Fast Rates for Returning a Good Armcited by 25
- 2022Minimax Optimal Algorithms for Fixed-Budget Best Arm Identificationcited by 20
- 2022Information-Directed Selection for Top-Two Algorithmscited by 15
- 2021Achieving the Pareto Frontier of Regret Minimization and Best Arm Identification in Multi-Armed Banditscited by 13
- 2023Best Arm Identification with Fixed Budget: A Large Deviation Perspectivecited by 12
- 2025Heavy-tailed Linear Bandits: Adversarial Robustness, Best-of-both-worlds, and Beyondcited by 4
- 2024Optimal Top-Two Method for Best Arm Identification and Fluid Analysiscited by 2
- 2025Last-Iterate Analyses of FTRL with the 1/2-Tsallis Entropy in Stochastic Banditscited by 1
- 2025Rate-optimal Design for Anytime Best Arm Identificationcited by 1
- 2026Best-of-Both-Worlds for Heavy-Tailed Markov Decision Processescited by 1
Built on by
Not cited yet.