mlsanityData to 14 Oct 2026

Near-Optimal Regret for Efficient Stochastic Combinatorial Semi-Bandits

arXiv 2508.06247 ↗First posted 8 Aug 2025cs.LG cs.DS stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

The combinatorial multi-armed bandit (CMAB) is a cornerstone of sequential decision-making framework, dominated by two algorithmic families: UCB-based and adversarial methods such as follow the regularized leader (FTRL) and online mirror descent (OMD). However, prominent UCB-based approaches like CUCB suffer from additional regret factor log T that is detrimental over long horizons, while adversarial methods such as EXP3.M and HYBRID impose significant computational overhead. To resolve this trade-off, we introduce the Combinatorial Minimax Optimal Strategy in the Stochastic setting (CMOSS). CMOSS is a computationally efficient algorithm that achieves an instance-independent regret of Obig( (log k)√kmTbig ) when k≤ fracm2 and Obig((m-k)√log klog(m-k)Tbig ) when k>fracm2 under semi-bandit feedback, where m is the number of arms and k is the maximum cardinality of a feasible action. Crucially, this result eliminates the dependency on log T and matches the established lower bounds of Omegabig(√kmTbig) when k≤ fracm2 and Omegabig((m-k)√log (fracmm-k) Tbig) when k>fracm2 up to logarithmic terms of k and m. We then extend our analysis to show that CMOSS is also applicable to cascading feedback. Experiments on synthetic and real-world datasets validate that CMOSS consistently outperforms benchmark algorithms in both regret and runtime efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 32 references that are in the map. First posted on arXiv 8 Aug 2025.

Builds on

15 of 32 references.

References · 15

  1. 2018Thompson Sampling for Combinatorial Semi-Banditscited by 78
  2. 2015Cascading Bandits: Learning to Rank in the Cascade Modelcited by 77
  3. 2016Combinatorial Multi-Armed Bandit with General Reward Functionscited by 56
  4. 2019Beating Stochastic and Adversarial Semi-bandits Optimally and Simultaneouslycited by 53
  5. 2017Improving Regret Bounds for Combinatorial Semi-Bandits with Probabilistically Triggered Arms and Its Applicationscited by 45
  6. 2015Combinatorial Cascading Banditscited by 40
  7. 2019Improved Algorithm on Online Clustering of Banditscited by 38
  8. 2014Matroid Bandits: Fast Combinatorial Optimization with Learningcited by 30
  9. 2017A minimax and asymptotically optimal algorithm for stochastic banditscited by 27
  10. 2017Efficient-UCBV: An Almost Optimal Algorithm using Variance Estimatescited by 20
  11. 2023Contextual Combinatorial Bandits with Probabilistically Triggered Armscited by 18
  12. 2022Batch-Size Independent Regret Bounds for Combinatorial Semi-Bandits with Probabilistically Triggered Arms or Independent Armscited by 15
3 more
  1. 2015Optimally Confident UCB: Improved Regret for Finite-Armed Banditscited by 7
  2. 2024Combinatorial Multivariant Multi-Armed Bandits with Applications to Episodic Reinforcement Learning and Beyondcited by 7
  3. 2015Networked Stochastic Multi-Armed Bandits with Combinatorial Strategiescited by 3

Built on by

Not cited yet.