mlsanityData to 7 Oct 2026

Improving Content Recommendation: Knowledge Graph-Based Semantic Contrastive Learning for Diversity and Cold-Start Users

arXiv 2403.18667 ↗First posted 27 Mar 2024cs.IR cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Addressing the challenges related to data sparsity, cold-start problems, and diversity in recommendation systems is both crucial and demanding. Many current solutions leverage knowledge graphs to tackle these issues by combining both item-based and user-item collaborative signals. A common trend in these approaches focuses on improving ranking performance at the cost of escalating model complexity, reducing diversity, and complicating the task. It is essential to provide recommendations that are both personalized and diverse, rather than solely relying on achieving high rank-based performance, such as Click-through Rate, Recall, etc. In this paper, we propose a hybrid multi-task learning approach, training on user-item and item-item interactions. We apply item-based contrastive learning on descriptive text, sampling positive and negative pairs based on item metadata. Our approach allows the model to better understand the relationships between entities within the knowledge graph by utilizing semantic information from text. It leads to more accurate, relevant, and diverse user recommendations and a benefit that extends even to cold-start users who have few interactions with items. We perform extensive experiments on two widely used datasets to validate the effectiveness of our approach. Our findings demonstrate that jointly training user-item interactions and item-based signals using synopsis text is highly effective. Furthermore, our results provide evidence that item-based contrastive learning enhances the quality of entity embeddings, as indicated by metrics such as uniformity and alignment.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 38 of its 70 references that are in the map. First posted on arXiv 27 Mar 2024.

Builds on

38 of 70 references.

References · 38

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  7. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  8. 2017Inductive Representation Learning on Large Graphscited by 6,284
  9. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  10. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  11. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
  12. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
26 more
  1. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  2. 2017Neural Collaborative Filteringcited by 1,108
  3. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
  4. 2016Wide & Deep Learning for Recommender Systemscited by 745
  5. 2019How to Fine-Tune BERT for Text Classification?cited by 409
  6. 2023A Survey on Large Language Models for Recommendationcited by 378
  7. 2019KGAT: Knowledge Graph Attention Network for Recommendationcited by 342
  8. 2020Keystroke Dynamics as Part of Lifeloggingcited by 334
  9. 2017Efficient Natural Language Response Suggestion for Smart Replycited by 228
  10. 2018Explainable Recommendation: A Survey and New Perspectivescited by 210
  11. 2019End-to-End Open-Domain Question Answering with BERTserinicited by 152
  12. 2018DKN: Deep Knowledge-Aware Network for News Recommendationcited by 137
  13. 2018RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systemscited by 136
  14. 2019Learning Dense Representations for Entity Retrievalcited by 122
  15. 2019Knowledge Graph Convolutional Networks for Recommender Systemscited by 121
  16. 2019Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systemscited by 107
  17. 2021Learning Intents behind Interactions with Knowledge Graph for Recommendationcited by 94
  18. 2019Fine-Grained Spoiler Detection from Large-Scale Review Corporacited by 76
  19. 2017On Sampling Strategies for Neural Network-based Collaborative Filteringcited by 71
  20. 2021Empowering News Recommendation with Pre-trained Language Modelscited by 63
  21. 2020What does BERT know about books, movies and music? Probing BERT for Conversational Recommendationcited by 36
  22. 2022Don't Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention Poolingcited by 12
  23. 2020CO-Search: COVID-19 Information Retrieval with Semantic Search, Question Answering, and Abstractive Summarizationcited by 11
  24. 2020IR-BERT: Leveraging BERT for Semantic Search in Background Linking for News Articlescited by 7
  25. 2022Exploiting Negative Preference in Content-based Music Recommendation with Contrastive Learningcited by 4
  26. 2017Joint Topic-Semantic-aware Social Recommendation for Online Votingcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.