Prototypical Contrastive Learning through Alignment and Uniformity for Recommendation
Not on the map. Why?
Abstract (arXiv)
Graph Collaborative Filtering (GCF), one of the most widely adopted recommendation system methods, effectively captures intricate relationships between user and item interactions. Graph Contrastive Learning (GCL) based GCF has gained significant attention as it leverages self-supervised techniques to extract valuable signals from real-world scenarios. However, many methods usually learn the instances of discrimination tasks that involve the construction of contrastive pairs through random sampling. GCL approaches suffer from sampling bias issues, where the negatives might have a semantic structure similar to that of the positives, thus leading to a loss of effective feature representation. To address these problems, we present the underlinePrototypical contrastive learning through underlineAlignment and underlineUniformity for recommendation, which is called ProtoAU. Specifically, we first propose prototypes (cluster centroids) as a latent space to ensure consistency across different augmentations from the origin graph, aiming to eliminate the need for random sampling of contrastive pairs. Furthermore, the absence of explicit negatives means that directly optimizing the consistency loss between instance and prototype could easily result in dimensional collapse issues. Therefore, we propose aligning and maintaining uniformity in the prototypes of users and items as optimization objectives to prevent falling into trivial solutions. Finally, we conduct extensive experiments on four datasets and evaluate their performance on the task of link prediction. Experimental results demonstrate that the proposed ProtoAU outperforms other representative methods. The source codes of our proposed ProtoAU are available at urlhttps://github.com/oceanlvr/ProtoAU.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 33 references that are in the map. First posted on arXiv 3 Feb 2024.
Builds on
22 of 33 references.
References · 22
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
- 2015Image-based Recommendations on Styles and Substitutescited by 702
- 2019Neural Graph Collaborative Filteringcited by 660
- 2020Contrastive Learning with Hard Negative Samplescited by 619
- 2020Self-supervised Graph Learning for Recommendationcited by 305
- 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
- 2021On Feature Decorrelation in Self-Supervised Learningcited by 160
10 more
- 2021Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendationcited by 101
- 2022Self-Supervised Learning for Recommender Systems: A Surveycited by 95
- 2022Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learningcited by 86
- 2023LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendationcited by 72
- 2019POG: Personalized Outfit Generation for Fashion Recommendation at Alibaba iFashioncited by 63
- 2022Towards Representation Alignment and Uniformity in Collaborative Filteringcited by 57
- 2022Debiased Contrastive Learning of Unsupervised Sentence Representationscited by 56
- 2021Socially-Aware Self-Supervised Tri-Training for Recommendationcited by 32
- 2020Bipartite Graph Embedding via Mutual Information Maximizationcited by 29
- 2023Towards Mitigating Dimensional Collapse of Representations in Collaborative Filteringcited by 10
Built on by
Not cited yet.