On Context-Dependent Clustering of Bandits
Not on the map. Why?
Abstract (arXiv)
We investigate a novel cluster-of-bandit algorithm CAB for collaborative recommendation tasks that implements the underlying feedback sharing mechanism by estimating the neighborhood of users in a context-dependent manner. CAB makes sharp departures from the state of the art by incorporating collaborative effects into inference as well as learning processes in a manner that seamlessly interleaving explore-exploit tradeoffs and collaborative steps. We prove regret bounds under various assumptions on the data, which exhibit a crisp dependence on the expected number of clusters over the users, a natural measure of the statistical difficulty of the learning task. Experiments on production and real-world datasets show that CAB offers significantly increased prediction performance against a representative pool of state-of-the-art methods.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Aug 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 9; 2023: 14; 2024: 6; 2025: 5; 2026: 1.
43 papers.
Sort:
- 2021RL for Latent MDPs: Regret Guarantees and a Lower Boundcited by 69
- 2021Federated Linear Contextual Banditscited by 61
- 2021Hierarchical Bayesian Banditscited by 33
- 2021Local Clustering in Contextual Multi-Armed Banditscited by 29
- 2021Multi-facet Contextual Bandits: A Neural Network Perspectivecited by 20
- 2023Graph Neural Banditscited by 20
- 2023Online Clustering of Bandits with Misspecified User Modelscited by 12
- 2023Optimal Algorithms for Latent Bandits with Cluster Structurecited by 11
- 2022Federated Online Clustering of Banditscited by 10
- 2023Neural Contextual Bandits for Personalized Recommendationcited by 10
- 2022Private and Byzantine-Proof Cooperative Decision-Makingcited by 9
- 2022Neural Bandit with Arm Group Graphcited by 8
31 more
- 2022Neural Collaborative Filtering Bandits via Meta Learningcited by 7
- 2023Evaluating Online Bandit Exploration In Large-Scale Recommender Systemcited by 7
- 2023Optimal Multitask Linear Regression and Contextual Bandits under Sparse Heterogeneitycited by 7
- 2024GPT4Rec: Graph Prompt Tuning for Streaming Recommendationcited by 7
- 2022Breaking the √T Barrier: Instance-Independent Logarithmic Regret in Stochastic Contextual Linear Banditscited by 5
- 2024RL in Latent MDPs is Tractable: Online Guarantees via Off-Policy Evaluationcited by 5
- 2024Linear Contextual Bandits with Hybrid Payoff: Revisitedcited by 5
- 2021Adaptive Clustering and Personalization in Multi-Agent Stochastic Linear Banditscited by 4
- 2022Coordinated Attacks against Contextual Bandits: Fundamental Limits and Defense Mechanismscited by 4
- 2023Prospective Side Information for Latent MDPscited by 4
- 2025Generalized Low-Rank Matrix Contextual Bandits with Graph Informationcited by 4
- 2023Context-lumpable stochastic banditscited by 3
- 2024Expert with Clustering: Hierarchical Online Preference Learning Frameworkcited by 3
- 2024Federated Linear Contextual Bandits with Heterogeneous Clientscited by 3
- 2025Demystifying Online Clustering of Bandits: Enhanced Exploration Under Stochastic and Smoothed Adversarial Contextscited by 3
- 2023Leveraging heterogeneous spillover in maximizing contextual bandit rewardscited by 2
- 2023Blocked Collaborative Bandits: Online Collaborative Filtering with Per-Item Budget Constraintscited by 2
- 2025Online Clustering of Dueling Banditscited by 2
- 2022A Scalable Recommendation Engine for New Users and Itemscited by 1
- 2022Anonymous Bandits for Multi-User Systemscited by 1
- 2023Adaptive Sample Sharing for Multi Agent Linear Banditscited by 1
- 2024Comparative Performance of Collaborative Bandit Algorithms: Effect of Sparsity and Exploration Intensitycited by 1
- 2025Revisiting Clustering of Neural Bandits: Selective Reinitialization for Mitigating Loss of Plasticitycited by 1
- 2021When and Whom to Collaborate with in a Changing Environment: A Collaborative Dynamic Bandit Solutioncited by 0
- 2021Margin-Independent Online Multiclass Learning via Convex Geometrycited by 0
- 2022Demystifying Advertising Campaign Bid Recommendation: A Constraint target CPA Goal Optimizationcited by 0
- 2023Stochastic Contextual Bandits with Graph-based Contextscited by 0
- 2023Clustered Linear Contextual Bandits with Knapsackscited by 0
- 2023Adaptive Interventions with User-Defined Goals for Health Behavior Changecited by 0
- 2025CoCoB: Adaptive Collaborative Combinatorial Bandits for Online Recommendationcited by 0
- 2026Spectral banditscited by 0
- 2026Spectral bandits28 Apr 2026
- 2025Generalized Low-Rank Matrix Contextual Bandits with Graph Information23 Jul 2025
- 2025Revisiting Clustering of Neural Bandits: Selective Reinitialization for Mitigating Loss of Plasticity14 Jun 2025
- 2025CoCoB: Adaptive Collaborative Combinatorial Bandits for Online Recommendation5 May 2025
- 2025Online Clustering of Dueling Bandits4 Feb 2025
- 2025Demystifying Online Clustering of Bandits: Enhanced Exploration Under Stochastic and Smoothed Adversarial Contexts1 Jan 2025
- 2024Comparative Performance of Collaborative Bandit Algorithms: Effect of Sparsity and Exploration Intensity15 Oct 2024
- 2024Linear Contextual Bandits with Hybrid Payoff: Revisited14 Jun 2024
- 2024GPT4Rec: Graph Prompt Tuning for Streaming Recommendation12 Jun 2024
- 2024RL in Latent MDPs is Tractable: Online Guarantees via Off-Policy Evaluation3 Jun 2024
- 2024Federated Linear Contextual Bandits with Heterogeneous Clients29 Feb 2024
- 2024Expert with Clustering: Hierarchical Online Preference Learning Framework26 Jan 2024
31 more
- 2023Neural Contextual Bandits for Personalized Recommendation21 Dec 2023
- 2023Adaptive Interventions with User-Defined Goals for Health Behavior Change16 Nov 2023
- 2023Blocked Collaborative Bandits: Online Collaborative Filtering with Per-Item Budget Constraints31 Oct 2023
- 2023Leveraging heterogeneous spillover in maximizing contextual bandit rewards16 Oct 2023
- 2023Prospective Side Information for Latent MDPs11 Oct 2023
- 2023Online Clustering of Bandits with Misspecified User Models4 Oct 2023
- 2023Adaptive Sample Sharing for Multi Agent Linear Bandits15 Sep 2023
- 2023Graph Neural Bandits21 Aug 2023
- 2023Clustered Linear Contextual Bandits with Knapsacks21 Aug 2023
- 2023Context-lumpable stochastic bandits22 Jun 2023
- 2023Optimal Multitask Linear Regression and Contextual Bandits under Sparse Heterogeneity9 Jun 2023
- 2023Stochastic Contextual Bandits with Graph-based Contexts2 May 2023
- 2023Evaluating Online Bandit Exploration In Large-Scale Recommender System5 Apr 2023
- 2023Optimal Algorithms for Latent Bandits with Cluster Structure17 Jan 2023
- 2022Demystifying Advertising Campaign Bid Recommendation: A Constraint target CPA Goal Optimization26 Dec 2022
- 2022Anonymous Bandits for Multi-User Systems21 Oct 2022
- 2022A Scalable Recommendation Engine for New Users and Items6 Sep 2022
- 2022Federated Online Clustering of Bandits31 Aug 2022
- 2022Neural Bandit with Arm Group Graph8 Jun 2022
- 2022Private and Byzantine-Proof Cooperative Decision-Making27 May 2022
- 2022Breaking the √T Barrier: Instance-Independent Logarithmic Regret in Stochastic Contextual Linear Bandits19 May 2022
- 2022Neural Collaborative Filtering Bandits via Meta Learning31 Jan 2022
- 2022Coordinated Attacks against Contextual Bandits: Fundamental Limits and Defense Mechanisms30 Jan 2022
- 2021Margin-Independent Online Multiclass Learning via Convex Geometry15 Nov 2021
- 2021Hierarchical Bayesian Bandits12 Nov 2021
- 2021Federated Linear Contextual Bandits27 Oct 2021
- 2021Adaptive Clustering and Personalization in Multi-Agent Stochastic Linear Bandits15 Jun 2021
- 2021Multi-facet Contextual Bandits: A Neural Network Perspective6 Jun 2021
- 2021When and Whom to Collaborate with in a Changing Environment: A Collaborative Dynamic Bandit Solution14 Apr 2021
- 2021Local Clustering in Contextual Multi-Armed Bandits26 Feb 2021
- 2021RL for Latent MDPs: Regret Guarantees and a Lower Bound9 Feb 2021
- 2021RL for Latent MDPs: Regret Guarantees and a Lower Boundcited by 69
- 2021Federated Linear Contextual Banditscited by 61
- 2021Hierarchical Bayesian Banditscited by 33
- 2021Local Clustering in Contextual Multi-Armed Banditscited by 29
- 2021Multi-facet Contextual Bandits: A Neural Network Perspectivecited by 20
- 2023Graph Neural Banditscited by 20
- 2023Online Clustering of Bandits with Misspecified User Modelscited by 12
- 2023Optimal Algorithms for Latent Bandits with Cluster Structurecited by 11
- 2022Federated Online Clustering of Banditscited by 10
- 2023Neural Contextual Bandits for Personalized Recommendationcited by 10
- 2022Private and Byzantine-Proof Cooperative Decision-Makingcited by 9
- 2022Neural Bandit with Arm Group Graphcited by 8
12 most cited of 43 All 43 (JSON)
- 2026Spectral bandits28 Apr 2026
- 2025Generalized Low-Rank Matrix Contextual Bandits with Graph Information23 Jul 2025
- 2025Revisiting Clustering of Neural Bandits: Selective Reinitialization for Mitigating Loss of Plasticity14 Jun 2025
- 2025CoCoB: Adaptive Collaborative Combinatorial Bandits for Online Recommendation5 May 2025
- 2025Online Clustering of Dueling Bandits4 Feb 2025
- 2025Demystifying Online Clustering of Bandits: Enhanced Exploration Under Stochastic and Smoothed Adversarial Contexts1 Jan 2025
- 2024Comparative Performance of Collaborative Bandit Algorithms: Effect of Sparsity and Exploration Intensity15 Oct 2024
- 2024Linear Contextual Bandits with Hybrid Payoff: Revisited14 Jun 2024
- 2024GPT4Rec: Graph Prompt Tuning for Streaming Recommendation12 Jun 2024
- 2024RL in Latent MDPs is Tractable: Online Guarantees via Off-Policy Evaluation3 Jun 2024
- 2024Federated Linear Contextual Bandits with Heterogeneous Clients29 Feb 2024
- 2024Expert with Clustering: Hierarchical Online Preference Learning Framework26 Jan 2024
12 newest of 43 All 43 (JSON)