Near-Optimal Regret for Efficient Stochastic Combinatorial Semi-Bandits
Not on the map. Why?
Abstract (arXiv)
The combinatorial multi-armed bandit (CMAB) is a cornerstone of sequential decision-making framework, dominated by two algorithmic families: UCB-based and adversarial methods such as follow the regularized leader (FTRL) and online mirror descent (OMD). However, prominent UCB-based approaches like CUCB suffer from additional regret factor log T that is detrimental over long horizons, while adversarial methods such as EXP3.M and HYBRID impose significant computational overhead. To resolve this trade-off, we introduce the Combinatorial Minimax Optimal Strategy in the Stochastic setting (CMOSS). CMOSS is a computationally efficient algorithm that achieves an instance-independent regret of Obig( (log k)√kmTbig ) when k≤ fracm2 and Obig((m-k)√log klog(m-k)Tbig ) when k>fracm2 under semi-bandit feedback, where m is the number of arms and k is the maximum cardinality of a feasible action. Crucially, this result eliminates the dependency on log T and matches the established lower bounds of Omegabig(√kmTbig) when k≤ fracm2 and Omegabig((m-k)√log (fracmm-k) Tbig) when k>fracm2 up to logarithmic terms of k and m. We then extend our analysis to show that CMOSS is also applicable to cascading feedback. Experiments on synthetic and real-world datasets validate that CMOSS consistently outperforms benchmark algorithms in both regret and runtime efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 32 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
15 of 32 references.
References · 15
- 2018Thompson Sampling for Combinatorial Semi-Banditscited by 78
- 2015Cascading Bandits: Learning to Rank in the Cascade Modelcited by 77
- 2016Combinatorial Multi-Armed Bandit with General Reward Functionscited by 56
- 2019Beating Stochastic and Adversarial Semi-bandits Optimally and Simultaneouslycited by 53
- 2017Improving Regret Bounds for Combinatorial Semi-Bandits with Probabilistically Triggered Arms and Its Applicationscited by 45
- 2015Combinatorial Cascading Banditscited by 40
- 2019Improved Algorithm on Online Clustering of Banditscited by 38
- 2014Matroid Bandits: Fast Combinatorial Optimization with Learningcited by 30
- 2017A minimax and asymptotically optimal algorithm for stochastic banditscited by 27
- 2017Efficient-UCBV: An Almost Optimal Algorithm using Variance Estimatescited by 20
- 2023Contextual Combinatorial Bandits with Probabilistically Triggered Armscited by 18
- 2022Batch-Size Independent Regret Bounds for Combinatorial Semi-Bandits with Probabilistically Triggered Arms or Independent Armscited by 15
Built on by
Not cited yet.