mlsanityData to 7 Oct 2026

General Item Representation Learning for Cold-start Content Recommendations

arXiv 2404.13808 ↗First posted 22 Apr 2024cs.IR cs.LG cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Cold-start item recommendation is a long-standing challenge in recommendation systems. A common remedy is to use a content-based approach, but rich information from raw contents in various forms has not been fully utilized. In this paper, we propose a domain/data-agnostic item representation learning framework for cold-start recommendations, naturally equipped with multimodal alignment among various features by adopting a Transformer-based architecture. Our proposed model is end-to-end trainable completely free from classification labels, not just costly to collect but suboptimal for recommendation-purpose representation learning. From extensive experiments on real-world movie and news recommendation benchmarks, we verify that our approach better preserves fine-grained user taste than state-of-the-art baselines, universally applicable to multiple domains at large scale.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 81 references that are in the map. First posted on arXiv 22 Apr 2024.

Builds on

38 of 81 references.

References · 38

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  7. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  8. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  9. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  10. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  11. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
  12. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
26 more
  1. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  2. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
  3. 2017Neural Collaborative Filteringcited by 1,108
  4. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 946
  5. 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 916
  6. 2020Graph Neural Networks in Recommender Systems: A Surveycited by 493
  7. 2021VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Textcited by 427
  8. 2020Keystroke Dynamics as Part of Lifeloggingcited by 334
  9. 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
  10. 2020MovieNet: A Holistic Dataset for Movie Understandingcited by 206
  11. 2018DKN: Deep Knowledge-Aware Network for News Recommendationcited by 137
  12. 2019MeLU: Meta-Learned User Preference Estimator for Cold-Start Recommendationcited by 119
  13. 2019A Tensorized Transformer for Language Modelingcited by 85
  14. 2021Contrastive Learning for Cold-Start Recommendationcited by 77
  15. 2019Warm Up Cold-start Advertisements: Improving CTR Predictions via Learning to Learn ID Embeddingscited by 65
  16. 2021Empowering News Recommendation with Pre-trained Language Modelscited by 63
  17. 2019Neural News Recommendation with Attentive Multi-View Learningcited by 59
  18. 2013Empirical Analysis of Predictive Algorithms for Collaborative Filteringcited by 47
  19. 2020Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systemscited by 38
  20. 2021Learning to Warm Up Cold Item Embeddings for Cold-start Recommendation with Meta Scaling and Shifting Networkscited by 37
  21. 2019Research Commentary on Recommendations with Side Information: A Survey and Research Directionscited by 23
  22. 2021Contrastive Learning for Recommender Systemcited by 16
  23. 2019Recommender Systems with Heterogeneous Side Informationcited by 11
  24. 2021Cold Item Integration in Deep Hybrid Recommenders via Tunable Stochastic Gatescited by 8
  25. 2022Improving Item Cold-start Recommendation via Model-agnostic Conditional Variational Autoencodercited by 8
  26. 2017Representation Learning of Music Using Artist Labelscited by 7

Built on by

Not cited yet.