mlsanityData to 7 Oct 2026

MultiBiSage: A Web-Scale Recommendation System Using Multiple Bipartite Graphs at Pinterest

arXiv 2205.10666 ↗First posted 21 May 2022cs.LG cs.SIcited by 6

Not on the map. Why?

Abstract (arXiv)

Graph Convolutional Networks (GCN) can efficiently integrate graph structure and node features to learn high-quality node embeddings. These embeddings can then be used for several tasks such as recommendation and search. At Pinterest, we have developed and deployed PinSage, a data-efficient GCN that learns pin embeddings from the Pin-Board graph. The Pin-Board graph contains pin and board entities and the graph captures the pin belongs to a board interaction. However, there exist several entities at Pinterest such as users, idea pins, creators, and there exist heterogeneous interactions among these entities such as add-to-cart, follow, long-click. In this work, we show that training deep learning models on graphs that captures these diverse interactions would result in learning higher-quality pin embeddings than training PinSage on only the Pin-Board graph. To that end, we model the diverse entities and their diverse interactions through multiple bipartite graphs and propose a novel data-efficient MultiBiSage model. MultiBiSage can capture the graph structure of multiple bipartite graphs to learn high-quality pin embeddings. We take this pragmatic approach as it allows us to utilize the existing infrastructure developed at Pinterest -- such as Pixie system that can perform optimized random-walks on billion node graphs, along with existing training and deployment workflows. We train MultiBiSage on six bipartite graphs including our Pin-Board graph. Our offline metrics show that MultiBiSage significantly outperforms the deployed latest version of PinSage on multiple user engagement metrics.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 33 of its 56 references that are in the map. First posted on arXiv 21 May 2022.

Builds on

33 of 56 references.

References · 33

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  6. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  7. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  8. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  9. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  10. 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,479
  11. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  12. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
21 more
  1. 2018Pitfalls of Graph Neural Network Evaluationcited by 994
  2. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  3. 2019Heterogeneous Graph Attention Networkcited by 732
  4. 2019Neural Graph Collaborative Filteringcited by 660
  5. 2015LINE: Large-scale Information Network Embeddingcited by 582
  6. 2020Heterogeneous Graph Transformercited by 581
  7. 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
  8. 2017Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2veccited by 197
  9. 2019AliGraph: A Comprehensive Graph Neural Network Platformcited by 152
  10. 2020DistDGL: Distributed Graph Neural Network Training for Billion-Scale Graphscited by 139
  11. 2020A Survey on Heterogeneous Graph Embedding: Methods, Techniques, Applications and Sourcescited by 126
  12. 2015PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networkscited by 96
  13. 2019Representation Learning for Attributed Multiplex Heterogeneous Networkcited by 91
  14. 2014On Using Very Large Target Vocabulary for Neural Machine Translationcited by 80
  15. 2019GraphZoom: A multi-level spectral approach for accurate and scalable graph embeddingcited by 58
  16. 2017Pixie: A System for Recommending 3+ Billion Items to 200+ Million Users in Real-Timecited by 46
  17. 2020Scalable Graph Neural Networks for Heterogeneous Graphscited by 31
  18. 2018MILE: A Multi-Level Framework for Scalable Graph Embeddingcited by 28
  19. 2021Billion-Scale Pretraining with Vision Transformers for Multi-Task Visual Representationscited by 24
  20. 2016Task-Guided and Path-Augmented Heterogeneous Network Embedding for Author Identificationcited by 18
  21. 2017Semi-supervised Embedding in Attributed Networks with Outlierscited by 10

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 1; 2024: 4.

6 papers.