mlsanityData to 7 Oct 2026

ITEM: Improving Training and Evaluation of Message-Passing based GNNs for top-k recommendation

arXiv 2407.07912 ↗First posted 3 Jul 2024cs.IR cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs), especially message-passing-based models, have become prominent in top-k recommendation tasks, outperforming matrix factorization models due to their ability to efficiently aggregate information from a broader context. Although GNNs are evaluated with ranking-based metrics, e.g NDCG@k and Recall@k, they remain largely trained with proxy losses, e.g the BPR loss. In this work we explore the use of ranking loss functions to directly optimize the evaluation metrics, an area not extensively investigated in the GNN community for collaborative filtering. We take advantage of smooth approximations of the rank to facilitate end-to-end training of GNNs and propose a Personalized PageRank-based negative sampling strategy tailored for ranking loss functions. Moreover, we extend the evaluation of GNN models for top-k recommendation tasks with an inductive user-centric protocol, providing a more accurate reflection of real-world applications. Our proposed method significantly outperforms the standard BPR loss and more advanced losses across four datasets and four recent GNN architectures while also exhibiting faster training. Demonstrating the potential of ranking loss functions in improving GNN training for collaborative filtering tasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 51 references that are in the map. First posted on arXiv 3 Jul 2024.

Builds on

29 of 51 references.

References · 29

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2017Inductive Representation Learning on Large Graphscited by 6,284
  4. 2018How Powerful are Graph Neural Networks?cited by 4,355
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  6. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  7. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  8. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
  9. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  10. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
  11. 2019Neural Graph Collaborative Filteringcited by 660
  12. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
17 more
  1. 2015LINE: Large-scale Information Network Embeddingcited by 582
  2. 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 544
  3. 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
  4. 2018Variational Autoencoders for Collaborative Filteringcited by 308
  5. 2020Self-supervised Graph Learning for Recommendationcited by 305
  6. 2019Learning with Average Precision: Training Image Retrieval with a Listwise Losscited by 184
  7. 2020Revisiting Graph based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approachcited by 119
  8. 2020Disentangled Graph Collaborative Filteringcited by 118
  9. 2020Smooth-AP: Smoothing the Path Towards Large-Scale Image Retrievalcited by 98
  10. 2016Yelp Dataset Challenge: Review Rating Predictioncited by 84
  11. 2021SimpleX: A Simple and Strong Baseline for Collaborative Filteringcited by 65
  12. 2022XSimGCL: Towards Extremely Simple Graph Contrastive Learning for Recommendationcited by 57
  13. 2021Recall@k Surrogate Loss with Large Batches and Similarity Mixupcited by 49
  14. 2020Exploring Data Splitting Strategies for the Evaluation of Recommendation Modelscited by 48
  15. 2021NeuralNDCG: Direct Optimisation of a Ranking Metric via Differentiable Relaxation of Sortingcited by 39
  16. 2021Robust and Decomposable Average Precision for Image Retrievalcited by 19
  17. 2022Hierarchical Average Precision Training for Pertinent Image Retrievalcited by 8

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.