A Simple Unified Framework for High Dimensional Bandit Problems
Not on the map. Why?
Abstract (arXiv)
Stochastic high dimensional bandit problems with low dimensional structures are useful in different applications such as online advertising and drug discovery. In this work, we propose a simple unified algorithm for such problems and present a general analysis framework for the regret upper bound of our algorithm. We show that under some mild unified assumptions, our algorithm can be applied to different high dimensional bandit problems. Our framework utilizes the low dimensional structure to guide the parameter estimation in the problem, therefore our algorithm achieves the comparable regret bounds in the LASSO bandit, as well as novel bounds in the low-rank matrix bandit, the group sparse matrix bandit, and in a new problem: the multi-agent LASSO bandit.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 10 of its 39 references that are in the map. First posted on arXiv 18 Feb 2021.
Builds on
10 of 39 references.
References · 10
- 2020High-Dimensional Sparse Linear Banditscited by 61
- 2019Bilinear Bandits with Low-rank Structurecited by 54
- 2019Doubly-Robust Lasso Banditcited by 49
- 2020Low-Rank Generalized Linear Bandit Problemscited by 48
- 2020Sparsity-Agnostic Lasso Banditcited by 44
- 2017Stochastic Low-Rank Banditscited by 28
- 2016Stochastic Rank-1 Banditscited by 23
- 2019Solving Bernoulli Rank-One Bandits with Unimodal Thompson Samplingcited by 23
- 2017Bernoulli Rank-1 Bandits for Click Feedbackcited by 11
- 2016Structured Stochastic Linear Banditscited by 6
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 6; 2024: 5; 2025: 5; 2026: 1.
21 papers.
Sort:
By area:
- 2023Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversioncited by 24
- 2024Efficient Frameworks for Generalized Low-Rank Matrix Bandit Problemscited by 19
- 2022Thompson Sampling for High-Dimensional Sparse Linear Contextual Banditscited by 16
- 2024Efficient Low-Rank Matrix Estimation, Experimental Design, and Arm-Set-Dependent Low-Rank Banditscited by 9
- 2021Model Selection for Generic Contextual Banditscited by 7
- 2023Anytime Model Selection in Linear Banditscited by 6
- 2025Single Index Bandits: Generalized Linear Contextual Bandits with Unknown Reward Functionscited by 6
- 2023High-dimensional Contextual Bandit Problem without Sparsitycited by 5
- 2026Provably Efficient Regularized Online RLHF with Generalized Bilinear Preferencescited by 5
- 2022Federated Online Sparse Decision Makingcited by 3
- 2023High-dimensional Linear Bandits with Knapsackscited by 3
- 2024Sparsity-Agnostic Linear Bandits with Adaptive Adversariescited by 2
9 more
- 2022Advertising Media and Target Audience Optimization via High-dimensional Banditscited by 1
- 2023Fixed-Budget Best-Arm Identification in Sparse Linear Banditscited by 1
- 2023Efficient Generalized Low-Rank Tensor Contextual Banditscited by 1
- 2025A Unified Regularization Approach to High-Dimensional Generalized Tensor Banditscited by 1
- 2025High-dimensional Nonparametric Contextual Bandit Problemcited by 1
- 2025On the necessity of adaptive regularisation:Optimal anytime online learning on boldsymbolℓp-ballscited by 1
- 2024Differentially Private High Dimensional Banditscited by 0
- 2024Sparse Linear Bandits with Blocking Constraintscited by 0
- 2025Navigating Sparsities in High-Dimensional Linear Contextual Banditscited by 0
- 2026Provably Efficient Regularized Online RLHF with Generalized Bilinear Preferences26 Feb 2026
- 2025Navigating Sparsities in High-Dimensional Linear Contextual Bandits9 Oct 2025
- 2025On the necessity of adaptive regularisation:Optimal anytime online learning on boldsymbolℓp-balls24 Jun 2025
- 2025Single Index Bandits: Generalized Linear Contextual Bandits with Unknown Reward Functions15 Jun 2025
- 2025High-dimensional Nonparametric Contextual Bandit Problem20 May 2025
- 2025A Unified Regularization Approach to High-Dimensional Generalized Tensor Bandits18 Jan 2025
- 2024Sparse Linear Bandits with Blocking Constraints26 Oct 2024
- 2024Sparsity-Agnostic Linear Bandits with Adaptive Adversaries3 Jun 2024
- 2024Efficient Low-Rank Matrix Estimation, Experimental Design, and Arm-Set-Dependent Low-Rank Bandits17 Feb 2024
- 2024Differentially Private High Dimensional Bandits6 Feb 2024
- 2024Efficient Frameworks for Generalized Low-Rank Matrix Bandit Problems14 Jan 2024
- 2023Efficient Generalized Low-Rank Tensor Contextual Bandits3 Nov 2023
9 more
- 2023High-dimensional Linear Bandits with Knapsacks2 Nov 2023
- 2023Fixed-Budget Best-Arm Identification in Sparse Linear Bandits1 Nov 2023
- 2023Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversion28 Oct 2023
- 2023Anytime Model Selection in Linear Bandits24 Jul 2023
- 2023High-dimensional Contextual Bandit Problem without Sparsity19 Jun 2023
- 2022Thompson Sampling for High-Dimensional Sparse Linear Contextual Bandits11 Nov 2022
- 2022Advertising Media and Target Audience Optimization via High-dimensional Bandits17 Sep 2022
- 2022Federated Online Sparse Decision Making27 Feb 2022
- 2021Model Selection for Generic Contextual Bandits7 Jul 2021
- 2023Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversioncited by 24
- 2024Efficient Frameworks for Generalized Low-Rank Matrix Bandit Problemscited by 19
- 2022Thompson Sampling for High-Dimensional Sparse Linear Contextual Banditscited by 16
- 2024Efficient Low-Rank Matrix Estimation, Experimental Design, and Arm-Set-Dependent Low-Rank Banditscited by 9
- 2021Model Selection for Generic Contextual Banditscited by 7
- 2023Anytime Model Selection in Linear Banditscited by 6
- 2025Single Index Bandits: Generalized Linear Contextual Bandits with Unknown Reward Functionscited by 6
- 2023High-dimensional Contextual Bandit Problem without Sparsitycited by 5
- 2022Federated Online Sparse Decision Makingcited by 3
- 2023High-dimensional Linear Bandits with Knapsackscited by 3
- 2024Sparsity-Agnostic Linear Bandits with Adaptive Adversariescited by 2
- 2022Advertising Media and Target Audience Optimization via High-dimensional Banditscited by 1
12 most cited of 20 All 20 (JSON)
- 2025Navigating Sparsities in High-Dimensional Linear Contextual Bandits9 Oct 2025
- 2025On the necessity of adaptive regularisation:Optimal anytime online learning on boldsymbolℓp-balls24 Jun 2025
- 2025Single Index Bandits: Generalized Linear Contextual Bandits with Unknown Reward Functions15 Jun 2025
- 2025High-dimensional Nonparametric Contextual Bandit Problem20 May 2025
- 2025A Unified Regularization Approach to High-Dimensional Generalized Tensor Bandits18 Jan 2025
- 2024Sparse Linear Bandits with Blocking Constraints26 Oct 2024
- 2024Sparsity-Agnostic Linear Bandits with Adaptive Adversaries3 Jun 2024
- 2024Efficient Low-Rank Matrix Estimation, Experimental Design, and Arm-Set-Dependent Low-Rank Bandits17 Feb 2024
- 2024Differentially Private High Dimensional Bandits6 Feb 2024
- 2024Efficient Frameworks for Generalized Low-Rank Matrix Bandit Problems14 Jan 2024
- 2023Efficient Generalized Low-Rank Tensor Contextual Bandits3 Nov 2023
- 2023High-dimensional Linear Bandits with Knapsacks2 Nov 2023
12 newest of 20 All 20 (JSON)