Randomized Exploration in Generalized Linear Bandits
Not on the map. Why?
Abstract (arXiv)
We study two randomized algorithms for generalized linear bandits. The first, GLM-TSL, samples a generalized linear model (GLM) from the Laplace approximation to the posterior distribution. The second, GLM-FPL, fits a GLM to a randomly perturbed history of past rewards. We analyze both algorithms and derive tildeO(d √n log K) upper bounds on their n-round regret, where d is the number of features and K is the number of arms. The former improves on prior work while the latter is the first for Gaussian noise perturbations in non-linear models. We empirically evaluate both GLM-TSL and GLM-FPL in logistic bandits, and apply GLM-FPL to neural network bandits. Our work showcases the role of randomization, beyond posterior sampling, in exploration.
Key facts. Cited by 70 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 16; 2023: 10; 2024: 16; 2025: 14; 2026: 7.
70 papers.
Sort:
By area:
- 2021Randomized Exploration for Reinforcement Learning with General Value Function Approximationcited by 49
- 2022Jointly Efficient and Optimal Algorithms for Logistic Banditscited by 41
- 2022A Provably Efficient Model-Free Posterior Sampling Method for Episodic Reinforcement Learningcited by 31
- 2024A Unified Confidence Sequence for Generalized Linear Models, with Applications to Banditscited by 29
- 2021Metadata-based Multi-Task Bandits with Bayesian Hierarchical Modelscited by 24
- 2023Random Boxes Are Open-world Object Detectorscited by 24
- 2023Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversioncited by 24
- 2021Fixed-Budget Best-Arm Identification in Structured Banditscited by 22
- 2022Langevin Monte Carlo for Contextual Banditscited by 22
- 2021Multinomial Logit Contextual Bandits: Provable Optimality and Practicalitycited by 21
- 2024Nearly Minimax Optimal Regret for Multinomial Logistic Banditcited by 20
- 2021Understanding the Eluder Dimensioncited by 19
38 more
- 2022Lifting the Information Ratio: An Information-Theoretic Analysis of Thompson Sampling for Contextual Banditscited by 19
- 2022Learning Neural Contextual Bandits Through Perturbed Rewardscited by 17
- 2022Active Learning with Safety Constraintscited by 16
- 2022Model-Based Reinforcement Learning with Multinomial Logistic Function Approximationcited by 13
- 2023Exploration via linearly perturbed loss minimisationcited by 13
- 2021Diffusion Approximations for Thompson Sampling in the Small Gap Regimecited by 12
- 2022Towards Scalable and Robust Structured Bandits: A Meta-Learning Frameworkcited by 11
- 2025Active Learning for Direct Preference Optimizationcited by 10
- 2022Residual Bootstrap Exploration for Stochastic Linear Banditcited by 8
- 2025When and why randomised exploration works (in linear bandits)cited by 8
- 2025Posterior Behavioral Cloning: Pretraining BC Policies for Efficient RL Finetuningcited by 8
- 2024Causal Bandits with General Causal Models and Interventionscited by 7
- 2023VITS : Variational Inference Thompson Sampling for contextual banditscited by 6
- 2024Active Preference Learning for Ordering Items In- and Out-of-samplecited by 6
- 2024Random Latent Exploration for Deep Reinforcement Learningcited by 6
- 2024Improved Regret of Linear Ensemble Samplingcited by 6
- 2025Neural Logistic Banditscited by 6
- 2025Single Index Bandits: Generalized Linear Contextual Bandits with Unknown Reward Functionscited by 6
- 2024Diffusion Models Meet Contextual Banditscited by 5
- 2024Conversational Dueling Bandits in Generalized Linear Modelscited by 5
- 2022Speed Up the Cold-Start Learning in Two-Sided Bandits with Many Armscited by 4
- 2024Prior-Dependent Allocations for Bayesian Fixed-Budget Best-Arm Identification in Structured Banditscited by 4
- 2024AxiomVision: Accuracy-Guaranteed Adaptive Visual Model Selection for Perspective-Aware Video Analyticscited by 4
- 2025Feel-Good Thompson Sampling for Contextual Bandits: a Markov Chain Monte Carlo Showdowncited by 4
- 2025No-Regret Thompson Sampling for Finite-Horizon Markov Decision Processes with Gaussian Processescited by 4
- 2022IMO3: Interactive Multi-Objective Off-Policy Optimizationcited by 3
- 2023Multiplier Bootstrap-based Explorationcited by 3
- 2023Does Sparsity Help in Learning Misspecified Linear Bandits?cited by 3
- 2024Variance-Aware Linear UCB with Deep Representation for Neural Contextual Banditscited by 3
- 2022Reward-Biased Maximum Likelihood Estimation for Neural Contextual Banditscited by 2
- 2023Thompson sampling for zero-inflated count outcomes with an application to the Drink Less mobile health studycited by 2
- 2023Fair Active Learning in Low-Data Regimescited by 2
- 2024Online Posterior Sampling with a Diffusion Priorcited by 2
- 2025Neural Variance-aware Dueling Bandits with Deep Representation and Shallow Explorationcited by 2
- 2025Provable Anytime Ensemble Sampling Algorithms in Nonlinear Contextual Banditscited by 2
- 2026DAK-UCB: Diversity-Aware Prompt Routing for LLMs and Generative Modelscited by 2
- 2021An Efficient Algorithm for Deep Stochastic Contextual Banditscited by 1
- 2022Truncated LinUCB for Stochastic Linear Banditscited by 1
50 most cited of 70 All 70 (JSON)
- 2026Linear Ensemble Sampling with Smaller Ensembles12 Sep 2026
- 2026Randomized Exploration for Linear Bandits via Absolute Perturbations26 Jun 2026
- 2026Variance-sensitive Thompson sampling for generalised linear bandits, revisited29 May 2026
- 2026DAK-UCB: Diversity-Aware Prompt Routing for LLMs and Generative Models24 Mar 2026
- 2026A Practical Algorithm for Feature-Rich, Non-Stationary Bandit Problems17 Mar 2026
- 2026Combinatorial Allocation Bandits with Nonlinear Arm Utility7 Mar 2026
- 2026Learning Contextual Runtime Monitors for Safe AI-Based Autonomy28 Jan 2026
- 2025Posterior Behavioral Cloning: Pretraining BC Policies for Efficient RL Finetuning18 Dec 2025
- 2025No-Regret Thompson Sampling for Finite-Horizon Markov Decision Processes with Gaussian Processes23 Oct 2025
- 2025Exploration via Feature Perturbation in Contextual Bandits20 Oct 2025
- 2025Provable Anytime Ensemble Sampling Algorithms in Nonlinear Contextual Bandits12 Oct 2025
- 2025Rethinking Langevin Thompson Sampling from A Stochastic Approximation Perspective6 Oct 2025
38 more
- 2025Stochastic Matching Bandits with Rare Optimization Updates4 Sep 2025
- 2025Feel-Good Thompson Sampling for Contextual Bandits: a Markov Chain Monte Carlo Showdown21 Jul 2025
- 2025Single Index Bandits: Generalized Linear Contextual Bandits with Unknown Reward Functions15 Jun 2025
- 2025Neural Variance-aware Dueling Bandits with Deep Representation and Shallow Exploration2 Jun 2025
- 2025Neural Logistic Bandits4 May 2025
- 2025Exploiting Concavity Information in Gaussian Process Contextual Bandit Optimization13 Mar 2025
- 2025Active Learning for Direct Preference Optimization3 Mar 2025
- 2025When and why randomised exploration works (in linear bandits)13 Feb 2025
- 2025DAL: A Practical Prior-Free Black-Box Framework for Piecewise Stationary Bandits31 Jan 2025
- 2024An Information-Theoretic Analysis of Thompson Sampling for Logistic Bandits3 Dec 2024
- 2024Variance-Aware Linear UCB with Deep Representation for Neural Contextual Bandits8 Nov 2024
- 2024Improved Regret of Linear Ensemble Sampling6 Nov 2024
- 2024Online Posterior Sampling with a Diffusion Prior4 Oct 2024
- 2024AxiomVision: Accuracy-Guaranteed Adaptive Visual Model Selection for Perspective-Aware Video Analytics29 Jul 2024
- 2024Conversational Dueling Bandits in Generalized Linear Models26 Jul 2024
- 2024A Unified Confidence Sequence for Generalized Linear Models, with Applications to Bandits19 Jul 2024
- 2024Random Latent Exploration for Deep Reinforcement Learning18 Jul 2024
- 2024Bayesian Bandit Algorithms with Approximate Inference in Stochastic Linear Bandits20 Jun 2024
- 2024Graph Neural Thompson Sampling15 Jun 2024
- 2024Nearly Minimax Optimal Regret for Multinomial Logistic Bandit16 May 2024
- 2024Active Preference Learning for Ordering Items In- and Out-of-sample5 May 2024
- 2024ε-Neural Thompson Sampling of Deep Brain Stimulation for Parkinson Disease Treatment11 Mar 2024
- 2024Causal Bandits with General Causal Models and Interventions1 Mar 2024
- 2024Diffusion Models Meet Contextual Bandits15 Feb 2024
- 2024Prior-Dependent Allocations for Bayesian Fixed-Budget Best-Arm Identification in Structured Bandits8 Feb 2024
- 2023Zero-Inflated Bandits25 Dec 2023
- 2023Fair Active Learning in Low-Data Regimes13 Dec 2023
- 2023Thompson sampling for zero-inflated count outcomes with an application to the Drink Less mobile health study24 Nov 2023
- 2023Exploration via linearly perturbed loss minimisation13 Nov 2023
- 2023Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversion28 Oct 2023
- 2023VITS : Variational Inference Thompson Sampling for contextual bandits19 Jul 2023
- 2023Random Boxes Are Open-world Object Detectors17 Jul 2023
- 2023Does Sparsity Help in Learning Misspecified Linear Bandits?29 Mar 2023
- 2023Online Continuous Hyperparameter Optimization for Generalized Linear Contextual Bandits18 Feb 2023
- 2023Multiplier Bootstrap-based Exploration3 Feb 2023
- 2022Model-Based Reinforcement Learning with Multinomial Logistic Function Approximation27 Dec 2022
- 2022Speed Up the Cold-Start Learning in Two-Sided Bandits with Many Arms1 Oct 2022
- 2022Advertising Media and Target Audience Optimization via High-dimensional Bandits17 Sep 2022
50 newest of 70 All 70 (JSON)
- 2024Diffusion Models Meet Contextual Banditscited by 5
- 2024Online Posterior Sampling with a Diffusion Priorcited by 2
- 2024Online Posterior Sampling with a Diffusion Prior4 Oct 2024
- 2024Diffusion Models Meet Contextual Bandits15 Feb 2024
- 2025Active Learning for Direct Preference Optimizationcited by 10
- 2025Active Learning for Direct Preference Optimization3 Mar 2025
- 2021Randomized Exploration for Reinforcement Learning with General Value Function Approximationcited by 49
- 2022Jointly Efficient and Optimal Algorithms for Logistic Banditscited by 41
- 2022A Provably Efficient Model-Free Posterior Sampling Method for Episodic Reinforcement Learningcited by 31
- 2024A Unified Confidence Sequence for Generalized Linear Models, with Applications to Banditscited by 29
- 2021Metadata-based Multi-Task Bandits with Bayesian Hierarchical Modelscited by 24
- 2023Random Boxes Are Open-world Object Detectorscited by 24
- 2023Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversioncited by 24
- 2021Fixed-Budget Best-Arm Identification in Structured Banditscited by 22
- 2022Langevin Monte Carlo for Contextual Banditscited by 22
- 2021Multinomial Logit Contextual Bandits: Provable Optimality and Practicalitycited by 21
- 2024Nearly Minimax Optimal Regret for Multinomial Logistic Banditcited by 20
- 2021Understanding the Eluder Dimensioncited by 19
12 most cited of 64 All 64 (JSON)
- 2026Linear Ensemble Sampling with Smaller Ensembles12 Sep 2026
- 2026Randomized Exploration for Linear Bandits via Absolute Perturbations26 Jun 2026
- 2026Variance-sensitive Thompson sampling for generalised linear bandits, revisited29 May 2026
- 2026DAK-UCB: Diversity-Aware Prompt Routing for LLMs and Generative Models24 Mar 2026
- 2026A Practical Algorithm for Feature-Rich, Non-Stationary Bandit Problems17 Mar 2026
- 2026Combinatorial Allocation Bandits with Nonlinear Arm Utility7 Mar 2026
- 2026Learning Contextual Runtime Monitors for Safe AI-Based Autonomy28 Jan 2026
- 2025Exploration via Feature Perturbation in Contextual Bandits20 Oct 2025
- 2025Provable Anytime Ensemble Sampling Algorithms in Nonlinear Contextual Bandits12 Oct 2025
- 2025Rethinking Langevin Thompson Sampling from A Stochastic Approximation Perspective6 Oct 2025
- 2025Stochastic Matching Bandits with Rare Optimization Updates4 Sep 2025
- 2025Feel-Good Thompson Sampling for Contextual Bandits: a Markov Chain Monte Carlo Showdown21 Jul 2025
12 newest of 64 All 64 (JSON)