General Item Representation Learning for Cold-start Content Recommendations
Not on the map. Why?
Abstract (arXiv)
Cold-start item recommendation is a long-standing challenge in recommendation systems. A common remedy is to use a content-based approach, but rich information from raw contents in various forms has not been fully utilized. In this paper, we propose a domain/data-agnostic item representation learning framework for cold-start recommendations, naturally equipped with multimodal alignment among various features by adopting a Transformer-based architecture. Our proposed model is end-to-end trainable completely free from classification labels, not just costly to collect but suboptimal for recommendation-purpose representation learning. From extensive experiments on real-world movie and news recommendation benchmarks, we verify that our approach better preserves fine-grained user taste than state-of-the-art baselines, universally applicable to multiple domains at large scale.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 81 references that are in the map. First posted on arXiv 22 Apr 2024.
Builds on
38 of 81 references.
References · 38
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
26 more
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
- 2017Neural Collaborative Filteringcited by 1,108
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 946
- 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 916
- 2020Graph Neural Networks in Recommender Systems: A Surveycited by 493
- 2021VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Textcited by 427
- 2020Keystroke Dynamics as Part of Lifeloggingcited by 334
- 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
- 2020MovieNet: A Holistic Dataset for Movie Understandingcited by 206
- 2018DKN: Deep Knowledge-Aware Network for News Recommendationcited by 137
- 2019MeLU: Meta-Learned User Preference Estimator for Cold-Start Recommendationcited by 119
- 2019A Tensorized Transformer for Language Modelingcited by 85
- 2021Contrastive Learning for Cold-Start Recommendationcited by 77
- 2019Warm Up Cold-start Advertisements: Improving CTR Predictions via Learning to Learn ID Embeddingscited by 65
- 2021Empowering News Recommendation with Pre-trained Language Modelscited by 63
- 2019Neural News Recommendation with Attentive Multi-View Learningcited by 59
- 2013Empirical Analysis of Predictive Algorithms for Collaborative Filteringcited by 47
- 2020Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systemscited by 38
- 2021Learning to Warm Up Cold Item Embeddings for Cold-start Recommendation with Meta Scaling and Shifting Networkscited by 37
- 2019Research Commentary on Recommendations with Side Information: A Survey and Research Directionscited by 23
- 2021Contrastive Learning for Recommender Systemcited by 16
- 2019Recommender Systems with Heterogeneous Side Informationcited by 11
- 2021Cold Item Integration in Deep Hybrid Recommenders via Tunable Stochastic Gatescited by 8
- 2022Improving Item Cold-start Recommendation via Model-agnostic Conditional Variational Autoencodercited by 8
- 2017Representation Learning of Music Using Artist Labelscited by 7
Built on by
Not cited yet.