A Comprehensive Survey on Self-Supervised Learning for Recommendation
Not on the map. Why?
Abstract (arXiv)
Recommender systems play a crucial role in tackling the challenge of information overload by delivering personalized recommendations based on individual user preferences. Deep learning techniques, such as RNNs, GNNs, and Transformer architectures, have significantly propelled the advancement of recommender systems by enhancing their comprehension of user behaviors and preferences. However, supervised learning methods encounter challenges in real-life scenarios due to data sparsity, resulting in limitations in their ability to learn representations effectively. To address this, self-supervised learning (SSL) techniques have emerged as a solution, leveraging inherent data structures to generate supervision signals without relying solely on labeled data. By leveraging unlabeled data and extracting meaningful representations, recommender systems utilizing SSL can make accurate predictions and recommendations even when confronted with data sparsity. In this paper, we provide a comprehensive review of self-supervised learning frameworks designed for recommender systems, encompassing a thorough analysis of over 170 papers. We conduct an exploration of nine distinct scenarios, enabling a comprehensive understanding of SSL-enhanced recommenders in different contexts. For each domain, we elaborate on different self-supervised learning paradigms, namely contrastive learning, generative learning, and adversarial learning, so as to present technical details of how SSL enhances recommender systems in various contexts. We consistently maintain the related open-source materials at https://github.com/HKUDS/Awesome-SSLRec-Papers.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 136 of its 220 references that are in the map. First posted on arXiv 4 Apr 2024.
Builds on
136 of 220 references.
References · 136
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
38 more
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
- 2018MINE: Mutual Information Neural Estimationcited by 683
- 2019Neural Graph Collaborative Filteringcited by 661
- 2020A Survey on Contrastive Self-supervised Learningcited by 554
- 2022DiGress: Discrete Denoising diffusion for graph generationcited by 520
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
- 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
- 2018Variational Autoencoders for Collaborative Filteringcited by 310
- 2020Self-supervised Graph Learning for Recommendationcited by 305
- 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 304
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2018Explainable Recommendation: A Survey and New Perspectivescited by 210
- 2020A Review on Generative Adversarial Networks: Algorithms, Theory, and Applicationscited by 209
- 2021Self-Supervised Learning of Graph Neural Networks: A Unified Reviewcited by 184
- 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
- 2023Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approachcited by 168
- 2023Representation Learning with Large Language Models for Recommendationcited by 155
- 2021Self-supervised Learning on Graphs: Contrastive, Generative,or Predictivecited by 136
- 2022ROLAND: Graph Learning Framework for Dynamic Graphscited by 132
- 2021Contrastive Learning for Representation Degeneration Problem in Sequential Recommendationcited by 121
- 2019Learning Disentangled Representations for Recommendationcited by 110
- 2021Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendationcited by 101
- 2020A Survey on Generative Adversarial Networks: Variants, Applications, and Trainingcited by 97
- 2022Self-Supervised Learning for Recommender Systems: A Surveycited by 95
- 2021Learning Intents behind Interactions with Knowledge Graph for Recommendationcited by 94
- 2022Intent Contrastive Learning for Sequential Recommendationcited by 91
- 2022Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learningcited by 86
- 2022What's Behind the Mask: Understanding Masked Graph Modeling for Graph Autoencoderscited by 82
- 2024OpenGraph: Towards Open Graph Foundation Modelscited by 78
- 2017IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Modelscited by 75
- 2020Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendationcited by 75
- 2023LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendationcited by 72
- 2022Knowledge Graph Contrastive Learning for Recommendationcited by 70
- 2021SimpleX: A Simple and Strong Baseline for Collaborative Filteringcited by 65
- 2019RecVAE: a New Variational Autoencoder for Top-N Recommendations with Implicit Feedbackcited by 63
- 2022Hypergraph Contrastive Collaborative Filteringcited by 63
- 2022Towards Representation Alignment and Uniformity in Collaborative Filteringcited by 57
50 most cited of 136 All 136 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 2; 2026: 1.
6 papers.
- 2024A Survey of Large Language Models for Graphscited by 72
- 2024Language Representations Can be What Recommenders Need: Findings and Potentialscited by 18
- 2025Diffusion Models in Recommendation Systems: A Surveycited by 3
- 2024A Survey of Latent Factor Models in Recommender Systemscited by 0
- 2025A Generic Machine Learning Framework for Radio Frequency Fingerprintingcited by 0
- 2026ProSR: Semantic-Prototype-Guided Discrete Modeling for Physically Consistent SAR Super-Resolutioncited by 0
- 2026ProSR: Semantic-Prototype-Guided Discrete Modeling for Physically Consistent SAR Super-Resolution2 Sep 2026
- 2025A Generic Machine Learning Framework for Radio Frequency Fingerprinting10 Oct 2025
- 2025Diffusion Models in Recommendation Systems: A Survey17 Jan 2025
- 2024Language Representations Can be What Recommenders Need: Findings and Potentials7 Jul 2024
- 2024A Survey of Latent Factor Models in Recommender Systems28 May 2024
- 2024A Survey of Large Language Models for Graphs10 May 2024