Risk-averse learning with delayed feedback
Not on the map. Why?
Abstract (arXiv)
In real-world scenarios, risk-averse learning is valuable for mitigating potential adverse outcomes. However, the delayed feedback makes it challenging to assess and manage risk effectively. In this paper, we investigate risk-averse learning using Conditional Value at Risk (CVaR) as risk measure, while incorporating feedback with random but bounded delays. We develop two risk-averse learning algorithms that rely on one-point and two-point zeroth-order optimization approaches, respectively. The dynamic regrets of the algorithms are analyzed in terms of the cumulative delay and the number of total samplings. In the absence of delay, the regret bounds match the established bounds of zeroth-order stochastic gradient methods for risk-averse learning. Furthermore, the two-point risk-averse learning outperforms the one-point algorithm by achieving a smaller regret bound. We provide numerical experiments on a dynamic pricing problem to demonstrate the performance of the algorithms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 28 references that are in the map. First posted on arXiv 25 Sep 2024.
Builds on
14 of 28 references.
References · 14
- 2013Non-stationary Stochastic Optimizationcited by 175
- 2013Online Learning under Delayed Feedbackcited by 141
- 2015An Optimal Algorithm for Bandit and Zero-Order Convex Optimization with Two-Point Feedbackcited by 111
- 2014Optimizing the CVaR via Samplingcited by 99
- 2022Efficient Risk-Averse Reinforcement Learningcited by 43
- 2019Bandit Convex Optimization in Non-stationary Environmentscited by 41
- 2022Decision-Dependent Risk Minimization in Geometrically Decaying Dynamic Environmentscited by 32
- 2022Delayed Feedback in Generalised Linear Bandits Revisitedcited by 23
- 2018Bandit Online Learning with Unknown Delayscited by 18
- 2020A New One-Point Residual-Feedback Oracle For Black-Box Learning and Controlcited by 14
- 2018Risk-Averse Stochastic Convex Banditcited by 13
- 2022A Zeroth-Order Momentum Method for Risk-Averse Online Convex Gamescited by 3
Built on by
Not cited yet.