Risk-Averse Best Arm Set Identification with Fixed Budget and Fixed Confidence
Not on the map. Why?
Abstract (arXiv)
Decision making under uncertain environments in the maximization of expected reward while minimizing its risk is one of the ubiquitous problems in many subjects. Here, we introduce a novel problem setting in stochastic bandit optimization that jointly addresses two critical aspects of decision-making: maximizing expected reward and minimizing associated uncertainty, quantified via the mean-variance(MV) criterion. Unlike traditional bandit formulations that focus solely on expected returns, our objective is to efficiently and accurately identify the Pareto-optimal set of arms that strikes the best trade-off between expected performance and risk. We propose a unified meta-algorithmic framework capable of operating under both fixed-confidence and fixed-budget regimes, achieved through adaptive design of confidence intervals tailored to each scenario using the same sample exploration strategy. We provide theoretical guarantees on the correctness of the returned solutions in both settings. To complement this theoretical analysis, we conduct extensive empirical evaluations across synthetic benchmarks, demonstrating that our approach outperforms existing methods in terms of both accuracy and sample efficiency, highlighting its broad applicability to risk-aware decision-making tasks in uncertain environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 36 references that are in the map. First posted on arXiv 27 Jun 2025.
Builds on
8 of 36 references.
References · 8
- 2019Being Optimistic to Be Conservative: Quickly Learning a CVaR Policycited by 63
- 2019Efficient Computation of Expected Hypervolume Improvement Using Box Decomposition Algorithmscited by 24
- 2022Almost Optimal Variance-Constrained Best Arm Identificationcited by 16
- 2022Strategies for Safe Multi-Armed Bandits with Logarithmic Regret and Riskcited by 15
- 2023Adaptive Algorithms for Relaxed Pareto Set Identificationcited by 15
- 2023Bandit Pareto Set Identification: the Fixed Budget Settingcited by 14
- 2021Continuous Mean-Covariance Banditscited by 2
- 2022Risk-Averse Multi-Armed Bandits with Unobserved Confounders: A Case Study in Emotion Regulation in Mobile Healthcited by 2
Built on by
Not cited yet.