mlsanityData to 14 Oct 2026

RecDCL: Dual Contrastive Learning for Recommendation

arXiv 2401.15635 ↗First posted 28 Jan 2024cs.IR cs.CLcited by 11

Not on the map. Why?

Abstract (arXiv)

Self-supervised learning (SSL) has recently achieved great success in mining the user-item interactions for collaborative filtering. As a major paradigm, contrastive learning (CL) based SSL helps address data sparsity in Web platforms by contrasting the embeddings between raw and augmented data. However, existing CL-based methods mostly focus on contrasting in a batch-wise way, failing to exploit potential regularity in the feature dimension. This leads to redundant solutions during the representation learning of users and items. In this work, we investigate how to employ both batch-wise CL (BCL) and feature-wise CL (FCL) for recommendation. We theoretically analyze the relation between BCL and FCL, and find that combining BCL and FCL helps eliminate redundant solutions but never misses an optimal solution. We propose a dual contrastive learning recommendation framework -- RecDCL. In RecDCL, the FCL objective is designed to eliminate redundant solutions on user-item positive pairs and to optimize the uniform distributions within users and items using a polynomial kernel for driving the representations to be orthogonal; The BCL objective is utilized to generate contrastive embeddings on output vectors for enhancing the robustness of the representations. Extensive experiments on four widely-used benchmarks and one industry dataset demonstrate that RecDCL can consistently outperform the state-of-the-art GNNs-based and SSL-based models (with an improvement of up to 5.65% in terms of Recall@20). The source code is publicly available (https://github.com/THUDM/RecDCL).

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 38 of its 59 references that are in the map. First posted on arXiv 28 Jan 2024.

Builds on

38 of 59 references.

References · 38

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  6. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  7. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  8. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
  9. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
  10. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
  11. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
  12. 2017Neural Collaborative Filteringcited by 1,111
26 more
  1. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
  2. 2019Neural Graph Collaborative Filteringcited by 661
  3. 2020A Survey on Contrastive Self-supervised Learningcited by 554
  4. 2020Debiased Contrastive Learningcited by 356
  5. 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 312
  6. 2018Variational Autoencoders for Collaborative Filteringcited by 310
  7. 2020Self-supervised Graph Learning for Recommendationcited by 305
  8. 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
  9. 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
  10. 2020RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithmscited by 138
  11. 2021Contrastive Learning for Representation Degeneration Problem in Sequential Recommendationcited by 121
  12. 2020Revisiting Graph based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approachcited by 120
  13. 2021Towards the Generalization of Contrastive Self-Supervised Learningcited by 99
  14. 2022Self-Supervised Learning for Recommender Systems: A Surveycited by 95
  15. 2022Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learningcited by 86
  16. 2023LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendationcited by 72
  17. 2019RecVAE: a New Variational Autoencoder for Top-N Recommendations with Implicit Feedbackcited by 63
  18. 2022Towards Representation Alignment and Uniformity in Collaborative Filteringcited by 57
  19. 2022XSimGCL: Towards Extremely Simple Graph Contrastive Learning for Recommendationcited by 57
  20. 2020Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systemscited by 38
  21. 2022Self-Supervised Learning via Maximum Entropy Codingcited by 33
  22. 2021Bootstrapping User and Item Representations for One-Class Collaborative Filteringcited by 22
  23. 2021SelfCF: A Simple Framework for Self-supervised Collaborative Filteringcited by 15
  24. 2022CL4CTR: A Contrastive Learning Framework for CTR Predictioncited by 14
  25. 2021TLDR: Twin Learning for Dimensionality Reductioncited by 9
  26. 2023uCTRL: Unbiased Contrastive Representation Learning via Alignment and Uniformity for Collaborative Filteringcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 5; 2025: 4; 2026: 2.

11 papers.