Asymptotically Optimal Linear Best Feasible Arm Identification with Fixed Budget
Not on the map. Why?
Abstract (arXiv)
The challenge of identifying the best feasible arm within a fixed budget has attracted considerable interest in recent years. However, a notable gap remains in the literature: the exact exponential rate at which the error probability approaches zero has yet to be established, even in the relatively simple setting of K-armed bandits with Gaussian noise. In this paper, we address this gap by examining the problem within the context of linear bandits. We introduce a novel algorithm for best feasible arm identification that guarantees an exponential decay in the error probability. Remarkably, the decay rate -- characterized by the exponent -- matches the theoretical lower bound derived using information-theoretic principles. Our approach leverages a posterior sampling framework embedded within a game-based sampling rule involving a min-learner and a max-learner. This strategy shares its foundations with Thompson sampling, but is specifically tailored to optimize the identification process under fixed-budget constraints. Furthermore, we validate the effectiveness of our algorithm through comprehensive empirical evaluations across various problem instances with different levels of complexity. The results corroborate our theoretical findings and demonstrate that our method outperforms several benchmark algorithms in terms of both accuracy and efficiency.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 32 references that are in the map. First posted on arXiv 3 Jun 2025.
Builds on
18 of 32 references.
References · 18
- 2016Simple Bayesian Algorithms for Best Arm Identificationcited by 117
- 2019Linear Stochastic Bandits Under Safety Constraintscited by 90
- 2020Optimal Best-arm Identification in Linear Banditscited by 71
- 2013Follow the Leader If You Can, Hedge If You Mustcited by 70
- 2014Algorithms for multi-armed bandit problemscited by 64
- 2016The End of Optimism? An Asymptotic Analysis of Finite-Armed Linear Banditscited by 49
- 2019A Survey on Practical Applications of Multi-Armed and Contextual Banditscited by 45
- 2019Safe Linear Thompson Sampling with Side Informationcited by 37
- 2022On Kernelized Multi-Armed Bandits with Constraintscited by 23
- 2021Fixed-Budget Best-Arm Identification in Structured Banditscited by 22
- 2022Almost Optimal Variance-Constrained Best Arm Identificationcited by 16
- 2022Active Learning with Safety Constraintscited by 16
6 more
- 2024Contextual Bandits with Stage-wise Constraintscited by 12
- 2022Constrained Pure Exploration Multi-Armed Bandits with a Fixed Budgetcited by 9
- 2019Polynomial-time Algorithms for Multiple-arm Identification with Full-bandit Feedbackcited by 8
- 2023Price of Safety in Linear Best Arm Identificationcited by 4
- 2023Optimal Exploration is no harder than Thompson Samplingcited by 3
- 2024Pure Exploration for Constrained Best Mixed Arm Identification with a Fixed Budgetcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.