Is Meta-Learning the Right Approach for the Cold-Start Problem in Recommender Systems?
Not on the map. Why?
Abstract (arXiv)
Recommender systems have become fundamental building blocks of modern online products and services, and have a substantial impact on user experience. In the past few years, deep learning methods have attracted a lot of research, and are now heavily used in modern real-world recommender systems. Nevertheless, dealing with recommendations in the cold-start setting, e.g., when a user has done limited interactions in the system, is a problem that remains far from solved. Meta-learning techniques, and in particular optimization-based meta-learning, have recently become the most popular approaches in the academic research literature for tackling the cold-start problem in deep learning models for recommender systems. However, current meta-learning approaches are not practical for real-world recommender systems, which have billions of users and items, and strict latency requirements. In this paper we show that it is possible to obtaining similar, or higher, performance on commonly used benchmarks for the cold-start problem without using meta-learning techniques. In more detail, we show that, when tuned correctly, standard and widely adopted deep learning models perform just as well as newer meta-learning models. We further show that an extremely simple modular approach using common representation learning techniques, can perform comparably to meta-learning techniques specifically designed for the cold-start setting while being much more easily deployable in real-world applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 104 references that are in the map. First posted on arXiv 16 Aug 2023.
Builds on
45 of 104 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2017Deep Setscited by 1,421
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2016Wide & Deep Learning for Recommender Systemscited by 747
- 2019A Closer Look at Few-shot Classificationcited by 684
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
- 2019Meta-Learning with Implicit Gradientscited by 525
33 more
- 2020Graph Neural Networks in Recommender Systems: A Surveycited by 494
- 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 437
- 2019Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLcited by 359
- 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
- 2018How to train your MAMLcited by 309
- 2018Meta-Learning: A Surveycited by 256
- 2019SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learningcited by 195
- 2018Recasting Gradient-Based Meta-Learning as Hierarchical Bayescited by 180
- 2020Meta-Baseline: Exploring Simple Meta-Learning for Few-Shot Learningcited by 179
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
- 2018RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systemscited by 138
- 2020RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithmscited by 138
- 2018Meta-Reinforcement Learning of Structured Exploration Strategiescited by 130
- 2017Few-Shot Image Recognition by Predicting Parameters from Activationscited by 122
- 2019MeLU: Meta-Learned User Preference Estimator for Cold-Start Recommendationcited by 121
- 2017Natural Language Processing: State of The Art, Current Trends and Challengescited by 114
- 2020Incremental Few-Shot Object Detectioncited by 102
- 2022KuaiRec: A Fully-observed Dataset and Insights for Evaluating Recommender Systemscited by 96
- 2019Warm Up Cold-start Advertisements: Improving CTR Predictions via Learning to Learn ID Embeddingscited by 66
- 2020MAMO: Memory-Augmented Meta-Optimization for Cold-start Recommendationcited by 39
- 2022RecBole 2.0: Towards a More Up-to-Date Recommendation Librarycited by 39
- 2021Learning to Warm Up Cold Item Embeddings for Cold-start Recommendation with Meta Scaling and Shifting Networkscited by 37
- 2018Natural Language to Structured Query Generation via Meta-Learningcited by 33
- 2019From Zero-Shot Learning to Cold-Start Recommendationcited by 29
- 2019Sequential Scenario-Specific Meta Learner for Online Recommendationcited by 28
- 2020Neural Interactive Collaborative Filteringcited by 24
- 2020Learning from Few Samples: A Surveycited by 23
- 2021A Semi-Personalized System for User Cold Start Recommendation on Music Streaming Appscited by 21
- 2021Long Short-Term Temporal Meta-learning in Online Recommendationcited by 6
- 2022Deep Meta-learning in Recommendation Systems: A Surveycited by 5
- 2022A Brief History of Recommender Systemscited by 4
- 2022Recent Advances in RecBole: Extensions with more Practical Considerationscited by 4
- 2022A Dynamic Meta-Learning Model for Time-Sensitive Cold-Start Recommendationscited by 3
Built on by
Not cited yet.