A Batch Sequential Halving Algorithm without Performance Degradation
Not on the map. Why?
Abstract (arXiv)
In this paper, we investigate the problem of pure exploration in the context of multi-armed bandits, with a specific focus on scenarios where arms are pulled in fixed-size batches. Batching has been shown to enhance computational efficiency, but it can potentially lead to a degradation compared to the original sequential algorithm's performance due to delayed feedback and reduced adaptability. We introduce a simple batch version of the Sequential Halving (SH) algorithm (Karnin et al., 2013) and provide theoretical evidence that batching does not degrade the performance of the original algorithm under practical conditions. Furthermore, we empirically validate our claim through experiments, demonstrating the robust nature of the SH algorithm in fixed-size batch settings.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 1 Jun 2024.
Builds on
20 of 41 references.
References · 20
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
- 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 699
- 2021Brax -- A Differentiable Physics Engine for Large Scale Rigid Body Simulationcited by 407
- 2015Non-stochastic Best Arm Identification and Hyperparameter Optimizationcited by 221
- 2018A System for Massively Parallel Hyperparameter Tuningcited by 202
- 2023Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Researchcited by 160
- 2019Batched Multi-armed Bandits Problemcited by 98
- 2024Craftax: A Lightning-Fast Benchmark for Open-Ended Reinforcement Learningcited by 88
- 2023JaxMARL: Multi-Agent RL Environments and Algorithms in JAXcited by 63
- 2023Jumanji: a Diverse Suite of Scalable Reinforcement Learning Environments in JAXcited by 58
- 2023XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAXcited by 55
- 2023Pgx: Hardware-Accelerated Parallel Game Simulators for Reinforcement Learningcited by 51
8 more
- 2019Regret Bounds for Batched Banditscited by 49
- 2018Best arm identification in multi-armed bandits with delayed feedbackcited by 29
- 2022Revisiting Simple Regret: Fast Rates for Returning a Good Armcited by 25
- 2020Double Explore-then-Commit: Asymptotic Optimality and Beyondcited by 24
- 2021Parallelizing Thompson Samplingcited by 20
- 2021Batched Thompson Samplingcited by 19
- 2013On Finding the Largest Mean Among Manycited by 9
- 2022The Impact of Batch Learning in Stochastic Linear Banditscited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025Top-k Feature Importance Rankingcited by 1
- 2025Top-k Feature Importance Ranking18 Sep 2025