Latent Contextual Bandits and their Application to Personalized Recommendations for New Users
Not on the map. Why?
Abstract (arXiv)
Personalized recommendations for new users, also known as the cold-start problem, can be formulated as a contextual bandit problem. Existing contextual bandit algorithms generally rely on features alone to capture user variability. Such methods are inefficient in learning new users' interests. In this paper we propose Latent Contextual Bandits. We consider both the benefit of leveraging a set of learned latent user classes for new users, and how we can learn such latent classes from prior users. We show that our approach achieves a better regret bound than existing algorithms. We also demonstrate the benefit of our approach using a large real world dataset and a preliminary user study.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Apr 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 1; 2023: 4; 2024: 4; 2025: 2; 2026: 2.
18 papers.
Sort:
- 2021Thompson Sampling with a Mixture Priorcited by 15
- 2023Optimal Algorithms for Latent Bandits with Cluster Structurecited by 11
- 2021Analysis of Thompson Sampling for Partially Observable Contextual Multi-Armed Banditscited by 10
- 2021Interaction-Grounded Learningcited by 9
- 2021Combining Online Learning and Offline Learning for Contextual Bandits with Deficient Supportcited by 7
- 2024Partially Observable Contextual Bandits with Linear Payoffscited by 5
- 2023Online learning in bandits with predicted contextcited by 4
- 2025Transfer Learning in Latent Contextual Bandits with Covariate Shift Through Causal Transportabilitycited by 4
- 2024Non-Stationary Latent Auto-Regressive Banditscited by 3
- 2022Information-Gathering in Latent Banditscited by 2
- 2024The Importance of Causality in Decision Making: A Perspective on Recommender Systemscited by 1
- 2025A Classification View on Meta Learning Banditscited by 1
6 more
- 2021The Use of Bandit Algorithms in Intelligent Interactive Recommender Systemscited by 0
- 2023Bounded (O(1)) Regret Recommendation Learning via Synthetic Controls Oraclecited by 0
- 2023Adaptive Interventions with User-Defined Goals for Health Behavior Changecited by 0
- 2024Identifiable Latent Bandits: Leveraging observational data for personalized decision-makingcited by 0
- 2026The Bandit's Blind Spot: The Critical Role of User State Representation in Recommender Systemscited by 0
- 2026CUPID in the Model Zoo: Online Matchmaking for Selecting Your Dream LLMcited by 0
- 2026CUPID in the Model Zoo: Online Matchmaking for Selecting Your Dream LLM30 May 2026
- 2026The Bandit's Blind Spot: The Critical Role of User State Representation in Recommender Systems29 Apr 2026
- 2025A Classification View on Meta Learning Bandits6 Apr 2025
- 2025Transfer Learning in Latent Contextual Bandits with Covariate Shift Through Causal Transportability27 Feb 2025
- 2024Partially Observable Contextual Bandits with Linear Payoffs17 Sep 2024
- 2024The Importance of Causality in Decision Making: A Perspective on Recommender Systems16 Sep 2024
- 2024Identifiable Latent Bandits: Leveraging observational data for personalized decision-making23 Jul 2024
- 2024Non-Stationary Latent Auto-Regressive Bandits5 Feb 2024
- 2023Adaptive Interventions with User-Defined Goals for Health Behavior Change16 Nov 2023
- 2023Online learning in bandits with predicted context26 Jul 2023
- 2023Bounded (O(1)) Regret Recommendation Learning via Synthetic Controls Oracle29 Jan 2023
- 2023Optimal Algorithms for Latent Bandits with Cluster Structure17 Jan 2023
6 more
- 2022Information-Gathering in Latent Bandits8 Jul 2022
- 2021Analysis of Thompson Sampling for Partially Observable Contextual Multi-Armed Bandits23 Oct 2021
- 2021Combining Online Learning and Offline Learning for Contextual Bandits with Deficient Support24 Jul 2021
- 2021The Use of Bandit Algorithms in Intelligent Interactive Recommender Systems1 Jul 2021
- 2021Thompson Sampling with a Mixture Prior10 Jun 2021
- 2021Interaction-Grounded Learning9 Jun 2021
- 2021Thompson Sampling with a Mixture Priorcited by 15
- 2023Optimal Algorithms for Latent Bandits with Cluster Structurecited by 11
- 2021Analysis of Thompson Sampling for Partially Observable Contextual Multi-Armed Banditscited by 10
- 2021Interaction-Grounded Learningcited by 9
- 2021Combining Online Learning and Offline Learning for Contextual Bandits with Deficient Supportcited by 7
- 2024Partially Observable Contextual Bandits with Linear Payoffscited by 5
- 2023Online learning in bandits with predicted contextcited by 4
- 2025Transfer Learning in Latent Contextual Bandits with Covariate Shift Through Causal Transportabilitycited by 4
- 2024Non-Stationary Latent Auto-Regressive Banditscited by 3
- 2022Information-Gathering in Latent Banditscited by 2
- 2024The Importance of Causality in Decision Making: A Perspective on Recommender Systemscited by 1
- 2025A Classification View on Meta Learning Banditscited by 1
12 most cited of 18 All 18 (JSON)
- 2026CUPID in the Model Zoo: Online Matchmaking for Selecting Your Dream LLM30 May 2026
- 2026The Bandit's Blind Spot: The Critical Role of User State Representation in Recommender Systems29 Apr 2026
- 2025A Classification View on Meta Learning Bandits6 Apr 2025
- 2025Transfer Learning in Latent Contextual Bandits with Covariate Shift Through Causal Transportability27 Feb 2025
- 2024Partially Observable Contextual Bandits with Linear Payoffs17 Sep 2024
- 2024The Importance of Causality in Decision Making: A Perspective on Recommender Systems16 Sep 2024
- 2024Identifiable Latent Bandits: Leveraging observational data for personalized decision-making23 Jul 2024
- 2024Non-Stationary Latent Auto-Regressive Bandits5 Feb 2024
- 2023Adaptive Interventions with User-Defined Goals for Health Behavior Change16 Nov 2023
- 2023Online learning in bandits with predicted context26 Jul 2023
- 2023Bounded (O(1)) Regret Recommendation Learning via Synthetic Controls Oracle29 Jan 2023
- 2023Optimal Algorithms for Latent Bandits with Cluster Structure17 Jan 2023
12 newest of 18 All 18 (JSON)