mlsanityData to 14 Oct 2026

Efficient Best-of-Both-Worlds Algorithms for Contextual Combinatorial Semi-Bandits

arXiv 2508.18768 ↗First posted 26 Aug 2025stat.ML cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

We introduce the first best-of-both-worlds algorithm for contextual combinatorial semi-bandits that simultaneously guarantees widetildeO(√T) regret in the adversarial regime and widetildeO(ln T) regret in the corrupted stochastic regime. Our approach builds on the Follow-the-Regularized-Leader (FTRL) framework equipped with a Shannon entropy regularizer, yielding a flexible method that admits efficient implementations. Beyond regret bounds, we tackle the practical bottleneck in FTRL (or, equivalently, Online Stochastic Mirror Descent) arising from the high-dimensional projection step encountered in each round of interaction. By leveraging the Karush-Kuhn-Tucker conditions, we transform the K-dimensional convex projection problem into a single-variable root-finding problem, dramatically accelerating each round. Empirical evaluations demonstrate that this combined strategy not only attains the attractive regret bounds of best-of-both-worlds algorithms but also delivers substantial per-round speed-ups, making it well-suited for large-scale, real-time applications.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 42 references that are in the map. First posted on arXiv 26 Aug 2025.

Builds on

19 of 42 references.

References · 19

  1. 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 641
  2. 2018Tsallis-INF: An Optimal Algorithm for Stochastic and Adversarial Banditscited by 124
  3. 2021Adapting to Misspecification in Contextual Banditscited by 81
  4. 2018Thompson Sampling for Combinatorial Semi-Banditscited by 78
  5. 2018Real-Time Bidding with Multi-Agent Reinforcement Learning in Display Advertisingcited by 65
  6. 2019Beating Stochastic and Adversarial Semi-bandits Optimally and Simultaneouslycited by 53
  7. 2021Achieving Near Instance-Optimality and Minimax-Optimality in Stochastic and Adversarial Linear Bandits Simultaneouslycited by 48
  8. 2020Efficient and Robust Algorithms for Adversarial Linear Contextual Banditscited by 43
  9. 2023A Blackbox Approach to Best of Both Worlds in Bandits and Beyondcited by 30
  10. 2020Practical Data Poisoning Attack against Next-Item Recommendationcited by 29
  11. 2015First-order regret bounds for combinatorial semi-banditscited by 26
  12. 2022Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback Graphscited by 26
7 more
  1. 2023Bypassing the Simulator: Near-Optimal Adversarial Linear Contextual Banditscited by 19
  2. 2015Importance weighting without importance weights: An efficient algorithm for combinatorial semi-banditscited by 16
  3. 2023Best-of-three-worlds Analysis for Linear Bandits with Follow-the-regularized-leader Algorithmcited by 12
  4. 2022Best of Both Worlds Model Selectioncited by 11
  5. 2023Best-of-Both-Worlds Algorithms for Linear Contextual Banditscited by 11
  6. 2021Near-Optimal Regret Bounds for Contextual Combinatorial Semi-Bandits with Linear Payoff Functionscited by 9
  7. 2024Optimism in the Face of Ambiguity Principle for Multi-Armed Banditscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.