Randomized Exploration for Linear Bandits via Absolute Perturbations
Not on the map. Why?
Abstract (arXiv)
In stochastic linear bandits, the canonical Upper Confidence Bound (UCB) algorithm admits a simple frequentist regret analysis but can be computationally demanding, while Thompson Sampling (TS) is computationally attractive yet typically harder to analyze due to its non-optimistic nature. We propose Absolute Thompson Sampling (ATS), a simple modification of TS that ensures optimism in expectation by replacing the signed exploration noise with its absolute value. This preserves the computational efficiency of TS while avoiding the technically involved anti-concentration arguments common in TS analyses, enabling a simple UCB-style regret analysis. We show that ATS achieves tildeO(d3/2√K) regret, matching existing bounds for TS in linear bandits. We further introduce Ensemble Absolute Thompson Sampling (EATS), which takes the maximum over multiple absolute perturbations with normalization by the ensemble size. As the ensemble size grows, EATS converges to the UCB objective, recovering UCB behavior in the limit. Experiments show that moderate ensemble sizes already yield strong performance. Our results point to a bridge between randomized exploration and deterministic optimism both in theory and practice.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 15 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
7 of 15 references.
References · 7
- 2019Frequentist Regret Bounds for Randomized Least-Squares Value Iterationcited by 101
- 2019Randomized Exploration in Generalized Linear Banditscited by 70
- 2021Feel-Good Thompson Sampling for Contextual Bandits and Reinforcement Learningcited by 66
- 2020Near-optimal Regret Bounds for Stochastic Shortest Pathcited by 50
- 2019Old Dog Learns New Tricks: Randomized UCB for Bandit Problemscited by 21
- 2025When and why randomised exploration works (in linear bandits)cited by 8
- 2023Ensemble sampling for linear bandits: small ensembles sufficecited by 7
Built on by
Not cited yet.