An Improved Parametrization and Analysis of the EXP3++ Algorithm for Stochastic and Adversarial Bandits
Not on the map. Why?
Abstract (arXiv)
We present a new strategy for gap estimation in randomized algorithms for multiarmed bandits and combine it with the EXP3++ algorithm of Seldin and Slivkins (2014). In the stochastic regime the strategy reduces dependence of regret on a time horizon from (ln t)3 to (ln t)2 and eliminates an additive factor of order Delta e1/Delta2, where Delta is the minimal gap of a problem instance. In the adversarial regime regret guarantee remains unchanged.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 13; 2023: 10; 2024: 8; 2025: 2; 2026: 2.
43 papers.
Sort:
By area:
- 2022Nearly Optimal Algorithms for Linear Contextual Bandits with Adversarial Corruptionscited by 51
- 2021Achieving Near Instance-Optimality and Minimax-Optimality in Stochastic and Adversarial Linear Bandits Simultaneouslycited by 48
- 2021A Model Selection Approach for Corruption Robust Reinforcement Learningcited by 45
- 2021The best of both worlds: stochastic and adversarial episodic MDPs with unknown transitioncited by 40
- 2023A Blackbox Approach to Best of Both Worlds in Bandits and Beyondcited by 29
- 2022Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback Graphscited by 26
- 2022A Best-of-Both-Worlds Algorithm for Bandits with Delayed Feedbackcited by 23
- 2021Linear Contextual Bandits with Adversarial Corruptionscited by 21
- 2021On Optimal Robustness to Adversarial Corruption in Online Decision Problemscited by 20
- 2022Best-of-Both-Worlds Algorithms for Partial Monitoringcited by 19
- 2021An Algorithm for Stochastic and Adversarial Bandits with Switching Costscited by 18
- 2023Improved Best-of-Both-Worlds Guarantees for Multi-Armed Bandits: FTRL with General Regularizers and Multiple Optimal Armscited by 18
31 more
- 2022Adaptive Best-of-Both-Worlds Algorithm for Heavy-Tailed Multi-Armed Banditscited by 17
- 2022A Near-Optimal Best-of-Both-Worlds Algorithm for Online Learning with Feedback Graphscited by 17
- 2023Best of Both Worlds Policy Optimizationcited by 17
- 2021Improved Analysis of the Tsallis-INF Algorithm in Stochastically Constrained Adversarial Bandits and Stochastic Bandits with Adversarial Corruptionscited by 15
- 2023Stability-penalty-adaptive follow-the-regularized-leader: Sparsity, game-dependency, and best-of-both-worldscited by 15
- 2022Better Best of Both Worlds Bounds for Bandits with Switching Costscited by 13
- 2022Adversarially Robust Multi-Armed Bandit Algorithm with Variance-Dependent Regret Boundscited by 12
- 2022Best of Both Worlds Model Selectioncited by 11
- 2022Pareto Regret Analyses in Multi-objective Multi-armed Banditcited by 11
- 2023Best-of-three-worlds Analysis for Linear Bandits with Follow-the-regularized-leader Algorithmcited by 11
- 2023Best-of-Both-Worlds Algorithms for Linear Contextual Banditscited by 10
- 2024Beyond Primal-Dual Methods in Bandits with Stochastic and Adversarial Constraintscited by 10
- 2024Follow-the-Perturbed-Leader with Fr'echet-type Tail Distributions: Optimality in Adversarial Bandits and Best-of-Both-Worldscited by 9
- 2024Nearly Optimal Algorithms for Contextual Dueling Bandits from Adversarial Feedbackcited by 9
- 2024uniINF: Best-of-Both-Worlds Algorithm for Parameter-Free Heavy-Tailed MABscited by 7
- 2022Simultaneously Learning Stochastic and Adversarial Bandits with General Graph Feedbackcited by 6
- 2024Corruption-Robust Linear Bandits: Minimax Optimality and Gap-Dependent Misspecificationcited by 6
- 2021Simple Combinatorial Algorithms for Combinatorial Bandits: Corruptions and Approximationscited by 4
- 2024LC-Tsallis-INF: Generalized Best-of-Both-Worlds Linear Contextual Banditscited by 4
- 2022Simultaneously Learning Stochastic and Adversarial Bandits under the Position-Based Modelcited by 2
- 2023A/B Testing and Best-arm Identification for Linear Bandits with Robustness to Non-stationaritycited by 2
- 2023CRIMED: Lower and Upper Bounds on Regret for Bandits with Unbounded Stochastic Corruptioncited by 2
- 2023Best-of-Both-Worlds Linear Contextual Banditscited by 2
- 2024Decentralized and Uncoordinated Learning of Stable Matchings: A Game-Theoretic Approachcited by 2
- 2025Improved Best-of-Both-Worlds Regret for Bandits with Delayed Feedbackcited by 2
- 2022SLOPT: Bandit Optimization Framework for Mutation-Based Fuzzingcited by 1
- 2024Stochastic Bandits Robust to Adversarial Attackscited by 1
- 2026Best of both worlds: Stochastic & adversarial best-arm identificationcited by 1
- 2023Allocating Divisible Resources on Arms with Unknown and Random Rewardscited by 0
- 2025Hierarchical Adversarial Bandits for Online Configuration Optimizationcited by 0
- 2026Adaptive Learning Rates with Surrogate Probability for Follow-the-Perturbed-Leadercited by 0
- 2026Adaptive Learning Rates with Surrogate Probability for Follow-the-Perturbed-Leader4 Jun 2026
- 2026Best of both worlds: Stochastic & adversarial best-arm identification16 Apr 2026
- 2025Improved Best-of-Both-Worlds Regret for Bandits with Delayed Feedback30 May 2025
- 2025Hierarchical Adversarial Bandits for Online Configuration Optimization25 May 2025
- 2024Corruption-Robust Linear Bandits: Minimax Optimality and Gap-Dependent Misspecification10 Oct 2024
- 2024uniINF: Best-of-Both-Worlds Algorithm for Parameter-Free Heavy-Tailed MABs4 Oct 2024
- 2024Stochastic Bandits Robust to Adversarial Attacks16 Aug 2024
- 2024Decentralized and Uncoordinated Learning of Stable Matchings: A Game-Theoretic Approach31 Jul 2024
- 2024Beyond Primal-Dual Methods in Bandits with Stochastic and Adversarial Constraints25 May 2024
- 2024Nearly Optimal Algorithms for Contextual Dueling Bandits from Adversarial Feedback16 Apr 2024
- 2024Follow-the-Perturbed-Leader with Fr'echet-type Tail Distributions: Optimality in Adversarial Bandits and Best-of-Both-Worlds8 Mar 2024
- 2024LC-Tsallis-INF: Generalized Best-of-Both-Worlds Linear Contextual Bandits5 Mar 2024
31 more
- 2023Best-of-Both-Worlds Linear Contextual Bandits27 Dec 2023
- 2023Best-of-Both-Worlds Algorithms for Linear Contextual Bandits24 Dec 2023
- 2023CRIMED: Lower and Upper Bounds on Regret for Bandits with Unbounded Stochastic Corruption28 Sep 2023
- 2023A/B Testing and Best-arm Identification for Linear Bandits with Robustness to Non-stationarity27 Jul 2023
- 2023Allocating Divisible Resources on Arms with Unknown and Random Rewards28 Jun 2023
- 2023Stability-penalty-adaptive follow-the-regularized-leader: Sparsity, game-dependency, and best-of-both-worlds26 May 2023
- 2023Best-of-three-worlds Analysis for Linear Bandits with Follow-the-regularized-leader Algorithm13 Mar 2023
- 2023Improved Best-of-Both-Worlds Guarantees for Multi-Armed Bandits: FTRL with General Regularizers and Multiple Optimal Arms27 Feb 2023
- 2023A Blackbox Approach to Best of Both Worlds in Bandits and Beyond20 Feb 2023
- 2023Best of Both Worlds Policy Optimization18 Feb 2023
- 2022Pareto Regret Analyses in Multi-objective Multi-armed Bandit1 Dec 2022
- 2022SLOPT: Bandit Optimization Framework for Mutation-Based Fuzzing7 Nov 2022
- 2022Best-of-Both-Worlds Algorithms for Partial Monitoring29 Jul 2022
- 2022Simultaneously Learning Stochastic and Adversarial Bandits under the Position-Based Model12 Jul 2022
- 2022Best of Both Worlds Model Selection29 Jun 2022
- 2022A Best-of-Both-Worlds Algorithm for Bandits with Delayed Feedback29 Jun 2022
- 2022Simultaneously Learning Stochastic and Adversarial Bandits with General Graph Feedback16 Jun 2022
- 2022Adversarially Robust Multi-Armed Bandit Algorithm with Variance-Dependent Regret Bounds14 Jun 2022
- 2022Better Best of Both Worlds Bounds for Bandits with Switching Costs7 Jun 2022
- 2022Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback Graphs2 Jun 2022
- 2022A Near-Optimal Best-of-Both-Worlds Algorithm for Online Learning with Feedback Graphs1 Jun 2022
- 2022Nearly Optimal Algorithms for Linear Contextual Bandits with Adversarial Corruptions13 May 2022
- 2022Adaptive Best-of-Both-Worlds Algorithm for Heavy-Tailed Multi-Armed Bandits28 Jan 2022
- 2021Linear Contextual Bandits with Adversarial Corruptions25 Oct 2021
- 2021A Model Selection Approach for Corruption Robust Reinforcement Learning7 Oct 2021
- 2021On Optimal Robustness to Adversarial Corruption in Online Decision Problems22 Sep 2021
- 2021Simple Combinatorial Algorithms for Combinatorial Bandits: Corruptions and Approximations12 Jun 2021
- 2021The best of both worlds: stochastic and adversarial episodic MDPs with unknown transition8 Jun 2021
- 2021Improved Analysis of the Tsallis-INF Algorithm in Stochastically Constrained Adversarial Bandits and Stochastic Bandits with Adversarial Corruptions23 Mar 2021
- 2021An Algorithm for Stochastic and Adversarial Bandits with Switching Costs19 Feb 2021
- 2021Achieving Near Instance-Optimality and Minimax-Optimality in Stochastic and Adversarial Linear Bandits Simultaneously11 Feb 2021
- 2022Nearly Optimal Algorithms for Linear Contextual Bandits with Adversarial Corruptionscited by 51
- 2021Achieving Near Instance-Optimality and Minimax-Optimality in Stochastic and Adversarial Linear Bandits Simultaneouslycited by 48
- 2021A Model Selection Approach for Corruption Robust Reinforcement Learningcited by 45
- 2021The best of both worlds: stochastic and adversarial episodic MDPs with unknown transitioncited by 40
- 2023A Blackbox Approach to Best of Both Worlds in Bandits and Beyondcited by 29
- 2022Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback Graphscited by 26
- 2022A Best-of-Both-Worlds Algorithm for Bandits with Delayed Feedbackcited by 23
- 2021Linear Contextual Bandits with Adversarial Corruptionscited by 21
- 2021On Optimal Robustness to Adversarial Corruption in Online Decision Problemscited by 20
- 2022Best-of-Both-Worlds Algorithms for Partial Monitoringcited by 19
- 2021An Algorithm for Stochastic and Adversarial Bandits with Switching Costscited by 18
- 2023Improved Best-of-Both-Worlds Guarantees for Multi-Armed Bandits: FTRL with General Regularizers and Multiple Optimal Armscited by 18
12 most cited of 42 All 42 (JSON)
- 2026Adaptive Learning Rates with Surrogate Probability for Follow-the-Perturbed-Leader4 Jun 2026
- 2026Best of both worlds: Stochastic & adversarial best-arm identification16 Apr 2026
- 2025Improved Best-of-Both-Worlds Regret for Bandits with Delayed Feedback30 May 2025
- 2025Hierarchical Adversarial Bandits for Online Configuration Optimization25 May 2025
- 2024Corruption-Robust Linear Bandits: Minimax Optimality and Gap-Dependent Misspecification10 Oct 2024
- 2024uniINF: Best-of-Both-Worlds Algorithm for Parameter-Free Heavy-Tailed MABs4 Oct 2024
- 2024Stochastic Bandits Robust to Adversarial Attacks16 Aug 2024
- 2024Decentralized and Uncoordinated Learning of Stable Matchings: A Game-Theoretic Approach31 Jul 2024
- 2024Beyond Primal-Dual Methods in Bandits with Stochastic and Adversarial Constraints25 May 2024
- 2024Follow-the-Perturbed-Leader with Fr'echet-type Tail Distributions: Optimality in Adversarial Bandits and Best-of-Both-Worlds8 Mar 2024
- 2024LC-Tsallis-INF: Generalized Best-of-Both-Worlds Linear Contextual Bandits5 Mar 2024
- 2023Best-of-Both-Worlds Linear Contextual Bandits27 Dec 2023
12 newest of 42 All 42 (JSON)