Risk-Averse Multi-Armed Bandit Problems under Mean-Variance Measure
Not on the map. Why?
Abstract (arXiv)
The multi-armed bandit problems have been studied mainly under the measure of expected total reward accrued over a horizon of length T. In this paper, we address the issue of risk in multi-armed bandit problems and develop parallel results under the measure of mean-variance, a commonly adopted risk measure in economics and mathematical finance. We show that the model-specific regret and the model-independent regret in terms of the mean-variance of the reward process are lower bounded by Omega(log T) and Omega(T2/3), respectively. We then show that variations of the UCB policy and the DSEE policy developed for the classic risk-neutral MAB achieve these lower bounds.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Apr 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 8; 2023: 3; 2024: 0; 2025: 2; 2026: 3.
20 papers.
Sort:
- 2021The Fragility of Optimized Bandit Algorithmscited by 17
- 2022Almost Optimal Variance-Constrained Best Arm Identificationcited by 16
- 2022Constrained Pure Exploration Multi-Armed Bandits with a Fixed Budgetcited by 9
- 2022Federated Multi-Armed Bandits Under Byzantine Attackscited by 6
- 2021ESCADA: Efficient Safety and Context Aware Dose Allocation for Precision Medicinecited by 5
- 2022The Survival Bandit Problemcited by 4
- 2025Risk-sensitive Bandits: Arm Mixture Optimality and Regret-efficient Algorithmscited by 3
- 2021Continuous Mean-Covariance Banditscited by 2
- 2021Thompson Sampling for Gaussian Entropic Risk Banditscited by 2
- 2022Risk-Averse Multi-Armed Bandits with Unobserved Confounders: A Case Study in Emotion Regulation in Mobile Healthcited by 2
- 2022Conditionally Risk-Averse Contextual Banditscited by 2
- 2022Risk-averse Contextual Multi-armed Bandit Problem with Linear Payoffscited by 1
8 more
- 2022Risk-Aware Linear Bandits: Theory and Applications in Smart Order Routingcited by 1
- 2023Probably Anytime-Safe Stochastic Combinatorial Semi-Banditscited by 1
- 2023Balancing Risk and Reward: An Automated Phased Release Strategycited by 0
- 2023A Risk-Averse Framework for Non-Stationary Stochastic Multi-Armed Banditscited by 0
- 2025Conformal bandits: bringing statistical validity and reward efficiency under weak arm separabilitycited by 0
- 2026Risk-Averse Wasserstein Distributionally Robust Online Learningcited by 0
- 2026Softmax gradient policy for variance minimization and risk-averse multi armed banditscited by 0
- 2026Dominant Arm Identification with Mixing and Recycling Observed Samplescited by 0
- 2026Dominant Arm Identification with Mixing and Recycling Observed Samples2 Aug 2026
- 2026Softmax gradient policy for variance minimization and risk-averse multi armed bandits31 Mar 2026
- 2026Risk-Averse Wasserstein Distributionally Robust Online Learning23 Feb 2026
- 2025Conformal bandits: bringing statistical validity and reward efficiency under weak arm separability10 Dec 2025
- 2025Risk-sensitive Bandits: Arm Mixture Optimality and Regret-efficient Algorithms11 Mar 2025
- 2023A Risk-Averse Framework for Non-Stationary Stochastic Multi-Armed Bandits24 Oct 2023
- 2023Balancing Risk and Reward: An Automated Phased Release Strategy16 May 2023
- 2023Probably Anytime-Safe Stochastic Combinatorial Semi-Bandits31 Jan 2023
- 2022Constrained Pure Exploration Multi-Armed Bandits with a Fixed Budget27 Nov 2022
- 2022Conditionally Risk-Averse Contextual Bandits24 Oct 2022
- 2022Risk-Averse Multi-Armed Bandits with Unobserved Confounders: A Case Study in Emotion Regulation in Mobile Health9 Sep 2022
- 2022Risk-Aware Linear Bandits: Theory and Applications in Smart Order Routing4 Aug 2022
8 more
- 2022Risk-averse Contextual Multi-armed Bandit Problem with Linear Payoffs24 Jun 2022
- 2022The Survival Bandit Problem7 Jun 2022
- 2022Federated Multi-Armed Bandits Under Byzantine Attacks9 May 2022
- 2022Almost Optimal Variance-Constrained Best Arm Identification25 Jan 2022
- 2021ESCADA: Efficient Safety and Context Aware Dose Allocation for Precision Medicine26 Nov 2021
- 2021The Fragility of Optimized Bandit Algorithms28 Sep 2021
- 2021Thompson Sampling for Gaussian Entropic Risk Bandits14 May 2021
- 2021Continuous Mean-Covariance Bandits24 Feb 2021
- 2021The Fragility of Optimized Bandit Algorithmscited by 17
- 2022Almost Optimal Variance-Constrained Best Arm Identificationcited by 16
- 2022Constrained Pure Exploration Multi-Armed Bandits with a Fixed Budgetcited by 9
- 2022Federated Multi-Armed Bandits Under Byzantine Attackscited by 6
- 2021ESCADA: Efficient Safety and Context Aware Dose Allocation for Precision Medicinecited by 5
- 2022The Survival Bandit Problemcited by 4
- 2025Risk-sensitive Bandits: Arm Mixture Optimality and Regret-efficient Algorithmscited by 3
- 2021Continuous Mean-Covariance Banditscited by 2
- 2021Thompson Sampling for Gaussian Entropic Risk Banditscited by 2
- 2022Risk-Averse Multi-Armed Bandits with Unobserved Confounders: A Case Study in Emotion Regulation in Mobile Healthcited by 2
- 2022Conditionally Risk-Averse Contextual Banditscited by 2
- 2022Risk-averse Contextual Multi-armed Bandit Problem with Linear Payoffscited by 1
12 most cited of 20 All 20 (JSON)
- 2026Dominant Arm Identification with Mixing and Recycling Observed Samples2 Aug 2026
- 2026Softmax gradient policy for variance minimization and risk-averse multi armed bandits31 Mar 2026
- 2026Risk-Averse Wasserstein Distributionally Robust Online Learning23 Feb 2026
- 2025Conformal bandits: bringing statistical validity and reward efficiency under weak arm separability10 Dec 2025
- 2025Risk-sensitive Bandits: Arm Mixture Optimality and Regret-efficient Algorithms11 Mar 2025
- 2023A Risk-Averse Framework for Non-Stationary Stochastic Multi-Armed Bandits24 Oct 2023
- 2023Balancing Risk and Reward: An Automated Phased Release Strategy16 May 2023
- 2023Probably Anytime-Safe Stochastic Combinatorial Semi-Bandits31 Jan 2023
- 2022Constrained Pure Exploration Multi-Armed Bandits with a Fixed Budget27 Nov 2022
- 2022Conditionally Risk-Averse Contextual Bandits24 Oct 2022
- 2022Risk-Averse Multi-Armed Bandits with Unobserved Confounders: A Case Study in Emotion Regulation in Mobile Health9 Sep 2022
- 2022Risk-Aware Linear Bandits: Theory and Applications in Smart Order Routing4 Aug 2022
12 newest of 20 All 20 (JSON)