mlsanityData to 14 Oct 2026

A Comprehensive Survey on Self-Supervised Learning for Recommendation

arXiv 2404.03354 ↗First posted 4 Apr 2024cs.IR cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Recommender systems play a crucial role in tackling the challenge of information overload by delivering personalized recommendations based on individual user preferences. Deep learning techniques, such as RNNs, GNNs, and Transformer architectures, have significantly propelled the advancement of recommender systems by enhancing their comprehension of user behaviors and preferences. However, supervised learning methods encounter challenges in real-life scenarios due to data sparsity, resulting in limitations in their ability to learn representations effectively. To address this, self-supervised learning (SSL) techniques have emerged as a solution, leveraging inherent data structures to generate supervision signals without relying solely on labeled data. By leveraging unlabeled data and extracting meaningful representations, recommender systems utilizing SSL can make accurate predictions and recommendations even when confronted with data sparsity. In this paper, we provide a comprehensive review of self-supervised learning frameworks designed for recommender systems, encompassing a thorough analysis of over 170 papers. We conduct an exploration of nine distinct scenarios, enabling a comprehensive understanding of SSL-enhanced recommenders in different contexts. For each domain, we elaborate on different self-supervised learning paradigms, namely contrastive learning, generative learning, and adversarial learning, so as to present technical details of how SSL enhances recommender systems in various contexts. We consistently maintain the related open-source materials at https://github.com/HKUDS/Awesome-SSLRec-Papers.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 136 of its 220 references that are in the map. First posted on arXiv 4 Apr 2024.

Builds on

136 of 220 references.

References · 136

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  8. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  9. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
  10. 2018Self-Attentive Sequential Recommendationcited by 1,184
  11. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
  12. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
38 more
  1. 2020Self-supervised Learning: Generative or Contrastivecited by 694
  2. 2018MINE: Mutual Information Neural Estimationcited by 683
  3. 2019Neural Graph Collaborative Filteringcited by 661
  4. 2020A Survey on Contrastive Self-supervised Learningcited by 554
  5. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 520
  6. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
  7. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
  8. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  9. 2018Variational Autoencoders for Collaborative Filteringcited by 310
  10. 2020Self-supervised Graph Learning for Recommendationcited by 305
  11. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 304
  12. 2021Graph Self-Supervised Learning: A Surveycited by 289
  13. 2018Explainable Recommendation: A Survey and New Perspectivescited by 210
  14. 2020A Review on Generative Adversarial Networks: Algorithms, Theory, and Applicationscited by 209
  15. 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
  16. 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
  17. 2023Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approachcited by 168
  18. 2023Representation Learning with Large Language Models for Recommendationcited by 155
  19. 2021Self-supervised Learning on Graphs: Contrastive, Generative,or Predictivecited by 136
  20. 2022ROLAND: Graph Learning Framework for Dynamic Graphscited by 132
  21. 2021Contrastive Learning for Representation Degeneration Problem in Sequential Recommendationcited by 121
  22. 2019Learning Disentangled Representations for Recommendationcited by 110
  23. 2021Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendationcited by 101
  24. 2020A Survey on Generative Adversarial Networks: Variants, Applications, and Trainingcited by 97
  25. 2022Self-Supervised Learning for Recommender Systems: A Surveycited by 95
  26. 2021Learning Intents behind Interactions with Knowledge Graph for Recommendationcited by 94
  27. 2022Intent Contrastive Learning for Sequential Recommendationcited by 91
  28. 2022Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learningcited by 86
  29. 2022What's Behind the Mask: Understanding Masked Graph Modeling for Graph Autoencoderscited by 82
  30. 2024OpenGraph: Towards Open Graph Foundation Modelscited by 78
  31. 2017IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Modelscited by 75
  32. 2020Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendationcited by 75
  33. 2023LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendationcited by 72
  34. 2022Knowledge Graph Contrastive Learning for Recommendationcited by 70
  35. 2021SimpleX: A Simple and Strong Baseline for Collaborative Filteringcited by 65
  36. 2019RecVAE: a New Variational Autoencoder for Top-N Recommendations with Implicit Feedbackcited by 63
  37. 2022Hypergraph Contrastive Collaborative Filteringcited by 63
  38. 2022Towards Representation Alignment and Uniformity in Collaborative Filteringcited by 57

50 most cited of 136 All 136 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 2; 2026: 1.

6 papers.