Optimal Best Arm Identification with Fixed Confidence
Not on the map. Why?
Abstract (arXiv)
We give a complete characterization of the complexity of best-arm identification in one-parameter bandit problems. We prove a new, tight lower bound on the sample complexity. We propose the `Track-and-Stop' strategy, which we prove to be asymptotically optimal. It consists in a new sampling rule (which tracks the optimal proportions of arm draws highlighted by the lower bound) and in a stopping rule named after Chernoff, for which we give a new analysis.
Key facts. Cited by 233 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Feb 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 35; 2023: 37; 2024: 39; 2025: 46; 2026: 48.
233 papers.
Sort:
By area:
- 2021Beyond No Regret: Instance-Dependent PAC Reinforcement Learningcited by 41
- 2024Efficient Prompt Optimization Through the Lens of Best Arm Identificationcited by 35
- 2021Minimax Optimal Fixed-Budget Best Arm Identification in Linear Banditscited by 32
- 2021Navigating to the Best Policy in Markov Decision Processescited by 28
- 2022Revisiting Simple Regret: Fast Rates for Returning a Good Armcited by 25
- 2022Minimax Optimal Algorithms for Fixed-Budget Best Arm Identificationcited by 20
- 2021Efficient Pure Exploration for Combinatorial Bandits with Semi-Bandit Feedbackcited by 19
- 2023On the Existence of a Complexity in Fixed Budget Bandit Identificationcited by 19
- 2022Near-Optimal Collaborative Learning in Banditscited by 18
- 2023Open Problem: Optimal Best Arm Identification with Fixed Budgetcited by 18
- 2021A/B/n Testing with Control in the Presence of Subpopulationscited by 17
- 2022Near Instance-Optimal PAC Reinforcement Learning for Deterministic MDPscited by 17
38 more
- 2022Almost Optimal Variance-Constrained Best Arm Identificationcited by 16
- 2022Optimal Clustering with Bandit Feedbackcited by 15
- 2022Information-Directed Selection for Top-Two Algorithmscited by 15
- 2024On Speeding Up Language Model Evaluationcited by 14
- 2021Pure Exploration in Kernel and Neural Banditscited by 13
- 2022Bregman Deviations of Generic Exponential Familiescited by 13
- 2022Dealing with Unknown Variances in Best-Arm Identificationcited by 13
- 2023Adaptive Algorithms for Relaxed Pareto Set Identificationcited by 13
- 2023Bandit Pareto Set Identification: the Fixed Budget Settingcited by 13
- 2025Sequential Learning of the Pareto Front for Multi-objective Banditscited by 13
- 2023Best Arm Identification with Fixed Budget: A Large Deviation Perspectivecited by 12
- 2024Cost Aware Best Arm Identificationcited by 12
- 2024Active Adaptive Experimental Design for Treatment Effect Estimation with Covariate Choicescited by 12
- 2021Dealing With Misspecification In Fixed-Confidence Linear Top-m Identificationcited by 11
- 2022Non-Asymptotic Analysis of a UCB-based Top Two Algorithmcited by 11
- 2021Vector Optimization with Stochastic Bandit Feedbackcited by 10
- 2023Pure Exploration in Bandits with Linear Constraintscited by 10
- 2023Fast and Regret Optimal Best Arm Identification: Fundamental Limits and Low-Complexity Algorithmscited by 10
- 2023Practical Bandits: An Industry Perspectivecited by 9
- 2024Optimizing Adaptive Experiments: A Unified Approach to Regret Minimization and Best-Arm Identificationcited by 9
- 2021The Role of Contextual Information in Best Arm Identificationcited by 8
- 2021Best-Arm Identification in Correlated Multi-Armed Banditscited by 8
- 2021Breaking the Moments Condition Barrier: No-Regret Algorithm for Bandits with Super Heavy-Tailed Payoffscited by 8
- 2022On Elimination Strategies for Bandit Fixed-Confidence Identificationcited by 8
- 2022On Best-Arm Identification with a Fixed Budget in Non-Parametric Multi-Armed Banditscited by 8
- 2022Federated Best Arm Identification with Heterogeneous Clientscited by 8
- 2023Best Arm Identification with Fairness Constraints on Subpopulationscited by 8
- 2023Optimal Batched Best Arm Identificationcited by 8
- 2024Optimal Multi-Fidelity Best-Arm Identificationcited by 8
- 2021Diffusion Approximations for a Class of Sequential Testing Problemscited by 7
- 2021A Non-asymptotic Approach to Best-Arm Identification for Gaussian Banditscited by 7
- 2021Bandit Quickest Changepoint Detectioncited by 7
- 2021On Slowly-varying Non-stationary Banditscited by 7
- 2021Max-Min Grouped Banditscited by 7
- 2022Residual Bootstrap Exploration for Stochastic Linear Banditcited by 7
- 2024Query-Efficient Correlation Clustering with Noisy Oraclecited by 7
- 2024Optimal Batched Linear Banditscited by 7
- 2024A General Framework for Clustering and Distribution Matching with Bandit Feedbackcited by 7
50 most cited of 233 All 233 (JSON)
- 2026Sharp Non-Asymptotic Analysis of the Penalized Challenger in β-EB-TCI for Bernoulli Bandits1 Oct 2026
- 2026Adaptive Self-Consistency: From Black-Box Sampling to Distribution-Valued Feedback30 Sep 2026
- 2026Bandits with Multiple Optimal Arms: Minimax Regret and Non-Adaptivity29 Sep 2026
- 2026Distinguish or Homogenize: Last-Chance Policy Identification and Risk-Budgeted Recovery under Irreversible Resource Depletion29 Sep 2026
- 2026Same Winners, Different Success Rates: Evaluating How LLM Agents Recover from Failures28 Sep 2026
- 2026ICMAPE: In-Context Multiagent Pure Exploration27 Sep 2026
- 2026Quantum Monte Carlo Tree Search with Fixed Confidence27 Sep 2026
- 2026FOCUS: Fixed-Confidence Online Causal Learning Using Sequential Adaptive Interventions26 Sep 2026
- 2026Cost-Aware Best-LLM Identification using Dueling Feedback24 Sep 2026
- 2026Gap Entropy and Almost Instance-Wise Optimal Best-Arm Identification12 Sep 2026
- 2026A positive resolution of the gap-entropy conjecture9 Sep 2026
- 2026Where Does the Union Bound Go? Best-Arm Identification and Strong FWER Control20 Aug 2026
38 more
- 2026An Irreducible Quantum Advantage in Aligning World Models with Reality20 Aug 2026
- 2026LENS: In-Context Search via Latent Evidence Exploration over Dynamic Raw Documents17 Aug 2026
- 2026The Cost of Adaptivity: Matching Lower Bounds Across Learning Problems9 Aug 2026
- 2026Fundamental Limitations of Fixed-Budget Best-Arm Identification13 Jul 2026
- 2026Optimal Top-k Identification from Pairwise Comparisons9 Jul 2026
- 2026Best-Arm Identification with Generative Proxy8 Jul 2026
- 2026Probably Correct Optimal Stable Matching under Two-Sided Uncertainty6 Jul 2026
- 2026Fixed-Confidence Best-Arm Identification for Causal Mediation Analysis5 Jul 2026
- 2026Uncertainty-gated selection for block-sparse attention4 Jul 2026
- 2026Ranking-and-Selection with Multiple Correct Answers and Non-Answerable Estimates20 Jun 2026
- 2026On Response-Adaptive Targeting Strategies for Multi-Treatment Experiments16 Jun 2026
- 2026Anytime-valid Optimal Policy Identification16 Jun 2026
- 2026Annealed Entropic Allocation for Ranking and Selection9 Jun 2026
- 2026Two-Fidelity Best-Action Identification for Stochastic Minimax Tree1 Jun 2026
- 2026Optimal Design for Multinomial Logit Model with Applications to Best Assortment Identification25 May 2026
- 2026The Sample Complexity of Multiple Change Point Identification under Bandit Feedback13 May 2026
- 2026The Context Gathering Decision Process: A POMDP Framework for Agentic Search7 May 2026
- 2026Best Arm Identification in Generalized Linear Bandits via Hybrid Feedback7 May 2026
- 2026On the Optimal Sample Complexity of Offline Multi-Armed Bandits with KL Regularization4 May 2026
- 2026Finite-Sample Analysis of Elimination in Active Hypothesis Testing1 May 2026
- 2026Best of both worlds: Stochastic & adversarial best-arm identification16 Apr 2026
- 2026Multi-Drafter Speculative Decoding with Alignment Feedback7 Apr 2026
- 2026Best-Arm Identification with Noisy Actuation2 Apr 2026
- 2026Multi-Armed Sequential Hypothesis Testing by Betting18 Mar 2026
- 2026Few Batches or Little Memory, But Not Both: Simultaneous Space and Adaptivity Constraints in Stochastic Bandits14 Mar 2026
- 2026Lookahead identification in adversarial bandits: accuracy and memory bounds28 Feb 2026
- 2026Adaptive Combinatorial Experimental Design: Pareto Optimality for Decision-Making and Inference27 Feb 2026
- 2026The Cost of Learning Under Multiple Change Points11 Feb 2026
- 2026GAAVI: Global Asymptotic Anytime Valid Inference for the Conditional Mean Function8 Feb 2026
- 2026Almost Asymptotically Optimal Active Clustering Through Pairwise Observations5 Feb 2026
- 2026Fixed Budget is No Harder Than Fixed Confidence in Best-Arm Identification up to Logarithmic Factors3 Feb 2026
- 2026An Efficient Algorithm for Thresholding Monte Carlo Tree Search30 Jan 2026
- 2026Best Arm Identification with LLM Judges and Limited Human29 Jan 2026
- 2026Certificate-Guided Pruning for Stochastic Lipschitz Optimization28 Jan 2026
- 2026Active Hypothesis Testing for Correlated Combinatorial Anomaly Detection24 Jan 2026
- 2026Probably Approximately Correct Maximum A Posteriori Inference22 Jan 2026
- 2025Stopping Rules for Stochastic Gradient Descent via Anytime-Valid Confidence Sequences15 Dec 2025
- 2025Minimax and Bayes Optimal Adaptive Experimental Design for Treatment Choice9 Dec 2025
50 newest of 233 All 233 (JSON)
- 2021Beyond No Regret: Instance-Dependent PAC Reinforcement Learningcited by 41
- 2024Efficient Prompt Optimization Through the Lens of Best Arm Identificationcited by 35
- 2021Minimax Optimal Fixed-Budget Best Arm Identification in Linear Banditscited by 32
- 2021Navigating to the Best Policy in Markov Decision Processescited by 28
- 2022Revisiting Simple Regret: Fast Rates for Returning a Good Armcited by 25
- 2022Minimax Optimal Algorithms for Fixed-Budget Best Arm Identificationcited by 20
- 2021Efficient Pure Exploration for Combinatorial Bandits with Semi-Bandit Feedbackcited by 19
- 2023On the Existence of a Complexity in Fixed Budget Bandit Identificationcited by 19
- 2022Near-Optimal Collaborative Learning in Banditscited by 18
- 2023Open Problem: Optimal Best Arm Identification with Fixed Budgetcited by 18
- 2021A/B/n Testing with Control in the Presence of Subpopulationscited by 17
- 2022Near Instance-Optimal PAC Reinforcement Learning for Deterministic MDPscited by 17
12 most cited of 224 All 224 (JSON)
- 2026Sharp Non-Asymptotic Analysis of the Penalized Challenger in β-EB-TCI for Bernoulli Bandits1 Oct 2026
- 2026Bandits with Multiple Optimal Arms: Minimax Regret and Non-Adaptivity29 Sep 2026
- 2026Distinguish or Homogenize: Last-Chance Policy Identification and Risk-Budgeted Recovery under Irreversible Resource Depletion29 Sep 2026
- 2026ICMAPE: In-Context Multiagent Pure Exploration27 Sep 2026
- 2026Quantum Monte Carlo Tree Search with Fixed Confidence27 Sep 2026
- 2026FOCUS: Fixed-Confidence Online Causal Learning Using Sequential Adaptive Interventions26 Sep 2026
- 2026Cost-Aware Best-LLM Identification using Dueling Feedback24 Sep 2026
- 2026Gap Entropy and Almost Instance-Wise Optimal Best-Arm Identification12 Sep 2026
- 2026A positive resolution of the gap-entropy conjecture9 Sep 2026
- 2026Where Does the Union Bound Go? Best-Arm Identification and Strong FWER Control20 Aug 2026
- 2026The Cost of Adaptivity: Matching Lower Bounds Across Learning Problems9 Aug 2026
- 2026Fundamental Limitations of Fixed-Budget Best-Arm Identification13 Jul 2026
12 newest of 224 All 224 (JSON)