SelfCF: A Simple Framework for Self-supervised Collaborative Filtering
Not on the map. Why?
Abstract (arXiv)
Collaborative filtering (CF) is widely used to learn informative latent representations of users and items from observed interactions. Existing CF-based methods commonly adopt negative sampling to discriminate different items. Training with negative sampling on large datasets is computationally expensive. Further, negative items should be carefully sampled under the defined distribution, in order to avoid selecting an observed positive item in the training dataset. Unavoidably, some negative items sampled from the training dataset could be positive in the test set. In this paper, we propose a self-supervised collaborative filtering framework (SelfCF), that is specially designed for recommender scenario with implicit feedback. The proposed SelfCF framework simplifies the Siamese networks and can be easily applied to existing deep-learning based CF models, which we refer to as backbone networks. The main idea of SelfCF is to augment the output embeddings generated by backbone networks, because it is infeasible to augment raw input of user/item ids. We propose and study three output perturbation techniques that can be applied to different types of backbone networks including both traditional CF models and graph-based models. The framework enables learning informative representations of users and items without negative samples, and is agnostic to the encapsulated backbones. We conduct comprehensive experiments on four datasets to show that our framework may achieve even better recommendation accuracy than the encapsulated supervised counterpart with a 2×--4× faster training speed. We also show that SelfCF can boost up the accuracy by up to 17.79% on average, compared with a self-supervised framework BUIR.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 34 of its 78 references that are in the map. First posted on arXiv 7 Jul 2021.
Builds on
34 of 78 references.
References · 34
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
22 more
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
- 2017Neural Collaborative Filteringcited by 1,108
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2020Self-supervised Learning: Generative or Contrastivecited by 693
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
- 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 672
- 2019Neural Graph Collaborative Filteringcited by 660
- 2017Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning resultscited by 470
- 2018Variational Autoencoders for Collaborative Filteringcited by 308
- 2020Self-supervised Graph Learning for Recommendationcited by 305
- 2021Graph Self-Supervised Learning: A Surveycited by 289
- 2020RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithmscited by 137
- 2020Learning to Drop: Robust Graph Neural Network via Topological Denoisingcited by 127
- 2020Revisiting Graph based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approachcited by 119
- 2014Collaborative Deep Learning for Recommender Systemscited by 95
- 2021GNNAutoScale: Scalable and Expressive Graph Neural Networks via Historical Embeddingscited by 90
- 2018NAIS: Neural Attentive Item Similarity Model for Recommendationcited by 52
- 2021Dynamic Graph Collaborative Filteringcited by 33
- 2019Security and Privacy on Blockchaincited by 32
- 2020Learning to Hash with Graph Neural Networks for Recommender Systemscited by 31
- 2021Bootstrapping User and Item Representations for One-Class Collaborative Filteringcited by 22
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 5; 2025: 5.
15 papers.
Sort:
By area:
- 2024A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trendscited by 16
- 2022CL4CTR: A Contrastive Learning Framework for CTR Predictioncited by 14
- 2024RecDCL: Dual Contrastive Learning for Recommendationcited by 11
- 2023LD4MRec: Simplifying and Powering Diffusion Model for Multimedia Recommendationcited by 8
- 2024Mirror Gradient: Towards Robust Multimodal Recommender Systems via Exploring Flat Local Minimacited by 6
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendationcited by 6
- 2022Inductive Graph Transformer for Delivery Time Estimationcited by 5
- 2023Self Contrastive Learning for Session-based Recommendationcited by 3
- 2025Semantic Item Graph Enhancement for Multimodal Recommendationcited by 2
- 2023Capturing Popularity Trends: A Simplistic Non-Personalized Approach for Enhanced Item Recommendationcited by 1
- 2025Diffusion-augmented Graph Contrastive Learning for Collaborative Filtercited by 1
- 2024A Survey of Latent Factor Models in Recommender Systemscited by 0
3 more
- 2025Combating the Bucket Effect:Multi-Knowledge Alignment for Medication Recommendationcited by 0
- 2025VoteGCL: Enhancing Graph-based Recommendations with Majority-Voting LLM-Rerank Augmentationcited by 0
- 2025A Probabilistic Framework for Temporal Distribution Generalization in Industry-Scale Recommender Systemscited by 0
- 2025A Probabilistic Framework for Temporal Distribution Generalization in Industry-Scale Recommender Systems26 Nov 2025
- 2025Semantic Item Graph Enhancement for Multimodal Recommendation8 Aug 2025
- 2025VoteGCL: Enhancing Graph-based Recommendations with Majority-Voting LLM-Rerank Augmentation29 Jul 2025
- 2025Combating the Bucket Effect:Multi-Knowledge Alignment for Medication Recommendation25 Apr 2025
- 2025Diffusion-augmented Graph Contrastive Learning for Collaborative Filter20 Mar 2025
- 2024A Survey of Latent Factor Models in Recommender Systems28 May 2024
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendation4 Apr 2024
- 2024A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends23 Feb 2024
- 2024Mirror Gradient: Towards Robust Multimodal Recommender Systems via Exploring Flat Local Minima17 Feb 2024
- 2024RecDCL: Dual Contrastive Learning for Recommendation28 Jan 2024
- 2023LD4MRec: Simplifying and Powering Diffusion Model for Multimedia Recommendation27 Sep 2023
- 2023Capturing Popularity Trends: A Simplistic Non-Personalized Approach for Enhanced Item Recommendation17 Aug 2023
3 more
- 2024A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trendscited by 16
- 2022CL4CTR: A Contrastive Learning Framework for CTR Predictioncited by 14
- 2024RecDCL: Dual Contrastive Learning for Recommendationcited by 11
- 2024Mirror Gradient: Towards Robust Multimodal Recommender Systems via Exploring Flat Local Minimacited by 6
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendationcited by 6
- 2022Inductive Graph Transformer for Delivery Time Estimationcited by 5
- 2023Self Contrastive Learning for Session-based Recommendationcited by 3
- 2025Semantic Item Graph Enhancement for Multimodal Recommendationcited by 2
- 2023Capturing Popularity Trends: A Simplistic Non-Personalized Approach for Enhanced Item Recommendationcited by 1
- 2024A Survey of Latent Factor Models in Recommender Systemscited by 0
- 2025Combating the Bucket Effect:Multi-Knowledge Alignment for Medication Recommendationcited by 0
- 2025VoteGCL: Enhancing Graph-based Recommendations with Majority-Voting LLM-Rerank Augmentationcited by 0
12 most cited of 13 All 13 (JSON)
- 2025A Probabilistic Framework for Temporal Distribution Generalization in Industry-Scale Recommender Systems26 Nov 2025
- 2025Semantic Item Graph Enhancement for Multimodal Recommendation8 Aug 2025
- 2025VoteGCL: Enhancing Graph-based Recommendations with Majority-Voting LLM-Rerank Augmentation29 Jul 2025
- 2025Combating the Bucket Effect:Multi-Knowledge Alignment for Medication Recommendation25 Apr 2025
- 2024A Survey of Latent Factor Models in Recommender Systems28 May 2024
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendation4 Apr 2024
- 2024A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends23 Feb 2024
- 2024Mirror Gradient: Towards Robust Multimodal Recommender Systems via Exploring Flat Local Minima17 Feb 2024
- 2024RecDCL: Dual Contrastive Learning for Recommendation28 Jan 2024
- 2023Capturing Popularity Trends: A Simplistic Non-Personalized Approach for Enhanced Item Recommendation17 Aug 2023
- 2023Self Contrastive Learning for Session-based Recommendation2 Jun 2023
- 2022CL4CTR: A Contrastive Learning Framework for CTR Prediction1 Dec 2022
12 newest of 13 All 13 (JSON)