mlsanityData to 7 Oct 2026

SelfCF: A Simple Framework for Self-supervised Collaborative Filtering

arXiv 2107.03019 ↗First posted 7 Jul 2021cs.IR cs.AI cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

Collaborative filtering (CF) is widely used to learn informative latent representations of users and items from observed interactions. Existing CF-based methods commonly adopt negative sampling to discriminate different items. Training with negative sampling on large datasets is computationally expensive. Further, negative items should be carefully sampled under the defined distribution, in order to avoid selecting an observed positive item in the training dataset. Unavoidably, some negative items sampled from the training dataset could be positive in the test set. In this paper, we propose a self-supervised collaborative filtering framework (SelfCF), that is specially designed for recommender scenario with implicit feedback. The proposed SelfCF framework simplifies the Siamese networks and can be easily applied to existing deep-learning based CF models, which we refer to as backbone networks. The main idea of SelfCF is to augment the output embeddings generated by backbone networks, because it is infeasible to augment raw input of user/item ids. We propose and study three output perturbation techniques that can be applied to different types of backbone networks including both traditional CF models and graph-based models. The framework enables learning informative representations of users and items without negative samples, and is agnostic to the encapsulated backbones. We conduct comprehensive experiments on four datasets to show that our framework may achieve even better recommendation accuracy than the encapsulated supervised counterpart with a 2×--4× faster training speed. We also show that SelfCF can boost up the accuracy by up to 17.79% on average, compared with a self-supervised framework BUIR.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 34 of its 78 references that are in the map. First posted on arXiv 7 Jul 2021.

Builds on

34 of 78 references.

References · 34

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  7. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  8. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  9. 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
  10. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  11. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  12. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
22 more
  1. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  2. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
  3. 2017Neural Collaborative Filteringcited by 1,108
  4. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
  5. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  6. 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 679
  7. 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 672
  8. 2019Neural Graph Collaborative Filteringcited by 660
  9. 2017Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning resultscited by 470
  10. 2018Variational Autoencoders for Collaborative Filteringcited by 308
  11. 2020Self-supervised Graph Learning for Recommendationcited by 305
  12. 2021Graph Self-Supervised Learning: A Surveycited by 289
  13. 2020RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithmscited by 137
  14. 2020Learning to Drop: Robust Graph Neural Network via Topological Denoisingcited by 127
  15. 2020Revisiting Graph based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approachcited by 119
  16. 2014Collaborative Deep Learning for Recommender Systemscited by 95
  17. 2021GNNAutoScale: Scalable and Expressive Graph Neural Networks via Historical Embeddingscited by 90
  18. 2018NAIS: Neural Attentive Item Similarity Model for Recommendationcited by 52
  19. 2021Dynamic Graph Collaborative Filteringcited by 33
  20. 2019Security and Privacy on Blockchaincited by 32
  21. 2020Learning to Hash with Graph Neural Networks for Recommender Systemscited by 31
  22. 2021Bootstrapping User and Item Representations for One-Class Collaborative Filteringcited by 22

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 3; 2024: 5; 2025: 5.

15 papers.

Sort:

By area: