mlsanityData to 7 Oct 2026

Your Graph Recommender is Provably a Single-view Graph Contrastive Learning

arXiv 2407.17723 ↗First posted 25 Jul 2024cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph recommender (GR) is a type of graph neural network (GNNs) encoder that is customized for extracting information from the user-item interaction graph. Due to its strong performance on the recommendation task, GR has gained significant attention recently. Graph contrastive learning (GCL) is also a popular research direction that aims to learn, often unsupervised, GNNs with certain contrastive objectives. As a general graph representation learning method, GCLs have been widely adopted with the supervised recommendation loss for joint training of GRs. Despite the intersection of GR and GCL research, theoretical understanding of the relationship between the two fields is surprisingly sparse. This vacancy inevitably leads to inefficient scientific research. In this paper, we aim to bridge the gap between the field of GR and GCL from the perspective of encoders and loss functions. With mild assumptions, we theoretically show an astonishing fact that graph recommender is equivalent to a commonly-used single-view graph contrastive model. Specifically, we find that (1) the classic encoder in GR is essentially a linear graph convolutional network with one-hot inputs, and (2) the loss function in GR is well bounded by a single-view GCL loss with certain hyperparameters. The first observation enables us to explain crucial designs of GR models, e.g., the removal of self-loop and nonlinearity. And the second finding can easily prompt many cross-field research directions. We empirically show a remarkable result that the recommendation loss and the GCL loss can be used interchangeably. The fact that we can train GR models solely with the GCL loss is particularly insightful, since before this work, GCLs were typically viewed as unsupervised methods that need fine-tuning. We also discuss some potential future works inspired by our theory.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 37 references that are in the map. First posted on arXiv 25 Jul 2024.

Builds on

20 of 37 references.

References · 20

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  5. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  6. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  7. 2019Neural Graph Collaborative Filteringcited by 660
  8. 2020Deep Graph Contrastive Representation Learningcited by 535
  9. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  10. 2020Self-supervised Graph Learning for Recommendationcited by 305
  11. 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
  12. 2018Contextual Stochastic Block Modelscited by 134
8 more
  1. 2022Rethinking and Scaling Up Graph Contrastive Learning: An Extremely Efficient Approach with Group Discriminationcited by 67
  2. 2022XSimGCL: Towards Extremely Simple Graph Contrastive Learning for Recommendationcited by 57
  3. 2018NAIS: Neural Attentive Item Similarity Model for Recommendationcited by 52
  4. 2024Macro Graph Neural Networks for Online Billion-Scale Recommender Systemscited by 40
  5. 2024Linear-Time Graph Neural Networks for Scalable Recommendationscited by 31
  6. 2022Contrastive Laplacian Eigenmapscited by 24
  7. 2022Understanding Non-linearity in Graph Neural Networks from the Bayesian-Inference Perspectivecited by 19
  8. 2020SCE: Scalable Network Embedding from Sparsest Cutcited by 12

Built on by

Not cited yet.