Online Clustering of Contextual Cascading Bandits
Not on the map. Why?
Abstract (arXiv)
We consider a new setting of online clustering of contextual cascading bandits, an online learning problem where the underlying cluster structure over users is unknown and needs to be learned from a random prefix feedback. More precisely, a learning agent recommends an ordered list of items to a user, who checks the list and stops at the first satisfactory item, if any. We propose an algorithm of CLUB-cascade for this setting and prove a T-step regret bound of order tildeO(√T). Previous work corresponds to the degenerate case of only one cluster, and our general regret bound in this special case also significantly improves theirs. We conduct experiments on both synthetic and real data, and demonstrate the effectiveness of our algorithm and the advantage of incorporating online clustering method.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 6; 2024: 4; 2025: 7; 2026: 2.
24 papers.
Sort:
By area:
- 2021Local Clustering in Contextual Multi-Armed Banditscited by 29
- 2021Metadata-based Multi-Task Bandits with Bayesian Hierarchical Modelscited by 24
- 2023Combinatorial Neural Banditscited by 16
- 2023Efficient Explorative Key-term Selection Strategies for Conversational Contextual Banditscited by 12
- 2023Online Clustering of Bandits with Misspecified User Modelscited by 12
- 2022Minimax Regret for Cascading Banditscited by 10
- 2022Federated Online Clustering of Banditscited by 10
- 2024Federated Contextual Cascading Bandits with Asynchronous Communication and Heterogeneous Userscited by 6
- 2024Cascading Reinforcement Learningcited by 4
- 2024AxiomVision: Accuracy-Guaranteed Adaptive Visual Model Selection for Perspective-Aware Video Analyticscited by 4
- 2023Online Corrupted User Detection and Regret Minimizationcited by 3
- 2025Demystifying Online Clustering of Bandits: Enhanced Exploration Under Stochastic and Smoothed Adversarial Contextscited by 3
12 more
- 2025Online Clustering of Dueling Banditscited by 3
- 2025Heterogeneous Multi-agent Multi-armed Bandits on Stochastic Block Modelscited by 2
- 2023Adaptive Sample Sharing for Multi Agent Linear Banditscited by 1
- 2024Misalignment, Learning, and Ranking: Harnessing Users Limited Attentioncited by 1
- 2025Revisiting Clustering of Neural Bandits: Selective Reinitialization for Mitigating Loss of Plasticitycited by 1
- 2021On Learning to Rank Long Sequences with Contextual Banditscited by 0
- 2023Clustered Linear Contextual Bandits with Knapsackscited by 0
- 2025CoCoB: Adaptive Collaborative Combinatorial Bandits for Online Recommendationcited by 0
- 2025Offline Clustering of Preference Learning with Active-data Augmentationcited by 0
- 2025Online Learning to Rank under Corruption: A Robust Cascading Bandits Approachcited by 0
- 2026Steering Frozen LLMs: Adaptive Social Alignment via Online Prompt Routingcited by 0
- 2026DCM Bandits: Multiplayer Information Asymmetric Cascading Bandits for Multiple Clickscited by 0
- 2026DCM Bandits: Multiplayer Information Asymmetric Cascading Bandits for Multiple Clicks12 Aug 2026
- 2026Steering Frozen LLMs: Adaptive Social Alignment via Online Prompt Routing4 Mar 2026
- 2025Online Learning to Rank under Corruption: A Robust Cascading Bandits Approach4 Nov 2025
- 2025Offline Clustering of Preference Learning with Active-data Augmentation30 Oct 2025
- 2025Revisiting Clustering of Neural Bandits: Selective Reinitialization for Mitigating Loss of Plasticity14 Jun 2025
- 2025CoCoB: Adaptive Collaborative Combinatorial Bandits for Online Recommendation5 May 2025
- 2025Heterogeneous Multi-agent Multi-armed Bandits on Stochastic Block Models11 Feb 2025
- 2025Online Clustering of Dueling Bandits4 Feb 2025
- 2025Demystifying Online Clustering of Bandits: Enhanced Exploration Under Stochastic and Smoothed Adversarial Contexts1 Jan 2025
- 2024AxiomVision: Accuracy-Guaranteed Adaptive Visual Model Selection for Perspective-Aware Video Analytics29 Jul 2024
- 2024Federated Contextual Cascading Bandits with Asynchronous Communication and Heterogeneous Users26 Feb 2024
- 2024Misalignment, Learning, and Ranking: Harnessing Users Limited Attention21 Feb 2024
12 more
- 2024Cascading Reinforcement Learning17 Jan 2024
- 2023Online Corrupted User Detection and Regret Minimization7 Oct 2023
- 2023Online Clustering of Bandits with Misspecified User Models4 Oct 2023
- 2023Adaptive Sample Sharing for Multi Agent Linear Bandits15 Sep 2023
- 2023Clustered Linear Contextual Bandits with Knapsacks21 Aug 2023
- 2023Combinatorial Neural Bandits31 May 2023
- 2023Efficient Explorative Key-term Selection Strategies for Conversational Contextual Bandits1 Mar 2023
- 2022Federated Online Clustering of Bandits31 Aug 2022
- 2022Minimax Regret for Cascading Bandits23 Mar 2022
- 2021Metadata-based Multi-Task Bandits with Bayesian Hierarchical Models13 Aug 2021
- 2021On Learning to Rank Long Sequences with Contextual Bandits7 Jun 2021
- 2021Local Clustering in Contextual Multi-Armed Bandits26 Feb 2021
- 2024Cascading Reinforcement Learningcited by 4
- 2024Cascading Reinforcement Learning17 Jan 2024
- 2021Local Clustering in Contextual Multi-Armed Banditscited by 29
- 2021Metadata-based Multi-Task Bandits with Bayesian Hierarchical Modelscited by 24
- 2023Combinatorial Neural Banditscited by 16
- 2023Efficient Explorative Key-term Selection Strategies for Conversational Contextual Banditscited by 12
- 2023Online Clustering of Bandits with Misspecified User Modelscited by 12
- 2022Minimax Regret for Cascading Banditscited by 10
- 2022Federated Online Clustering of Banditscited by 10
- 2024Federated Contextual Cascading Bandits with Asynchronous Communication and Heterogeneous Userscited by 6
- 2024AxiomVision: Accuracy-Guaranteed Adaptive Visual Model Selection for Perspective-Aware Video Analyticscited by 4
- 2023Online Corrupted User Detection and Regret Minimizationcited by 3
- 2025Demystifying Online Clustering of Bandits: Enhanced Exploration Under Stochastic and Smoothed Adversarial Contextscited by 3
- 2025Online Clustering of Dueling Banditscited by 3
12 most cited of 21 All 21 (JSON)
- 2026DCM Bandits: Multiplayer Information Asymmetric Cascading Bandits for Multiple Clicks12 Aug 2026
- 2025Online Learning to Rank under Corruption: A Robust Cascading Bandits Approach4 Nov 2025
- 2025Revisiting Clustering of Neural Bandits: Selective Reinitialization for Mitigating Loss of Plasticity14 Jun 2025
- 2025CoCoB: Adaptive Collaborative Combinatorial Bandits for Online Recommendation5 May 2025
- 2025Heterogeneous Multi-agent Multi-armed Bandits on Stochastic Block Models11 Feb 2025
- 2025Online Clustering of Dueling Bandits4 Feb 2025
- 2025Demystifying Online Clustering of Bandits: Enhanced Exploration Under Stochastic and Smoothed Adversarial Contexts1 Jan 2025
- 2024AxiomVision: Accuracy-Guaranteed Adaptive Visual Model Selection for Perspective-Aware Video Analytics29 Jul 2024
- 2024Federated Contextual Cascading Bandits with Asynchronous Communication and Heterogeneous Users26 Feb 2024
- 2024Misalignment, Learning, and Ranking: Harnessing Users Limited Attention21 Feb 2024
- 2023Online Corrupted User Detection and Regret Minimization7 Oct 2023
- 2023Online Clustering of Bandits with Misspecified User Models4 Oct 2023
12 newest of 21 All 21 (JSON)