MultiBiSage: A Web-Scale Recommendation System Using Multiple Bipartite Graphs at Pinterest
Not on the map. Why?
Abstract (arXiv)
Graph Convolutional Networks (GCN) can efficiently integrate graph structure and node features to learn high-quality node embeddings. These embeddings can then be used for several tasks such as recommendation and search. At Pinterest, we have developed and deployed PinSage, a data-efficient GCN that learns pin embeddings from the Pin-Board graph. The Pin-Board graph contains pin and board entities and the graph captures the pin belongs to a board interaction. However, there exist several entities at Pinterest such as users, idea pins, creators, and there exist heterogeneous interactions among these entities such as add-to-cart, follow, long-click. In this work, we show that training deep learning models on graphs that captures these diverse interactions would result in learning higher-quality pin embeddings than training PinSage on only the Pin-Board graph. To that end, we model the diverse entities and their diverse interactions through multiple bipartite graphs and propose a novel data-efficient MultiBiSage model. MultiBiSage can capture the graph structure of multiple bipartite graphs to learn high-quality pin embeddings. We take this pragmatic approach as it allows us to utilize the existing infrastructure developed at Pinterest -- such as Pixie system that can perform optimized random-walks on billion node graphs, along with existing training and deployment workflows. We train MultiBiSage on six bipartite graphs including our Pin-Board graph. Our offline metrics show that MultiBiSage significantly outperforms the deployed latest version of PinSage on multiple user engagement metrics.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 33 of its 56 references that are in the map. First posted on arXiv 21 May 2022.
Builds on
33 of 56 references.
References · 33
- 2017Attention Is All You Needcited by 59,932
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,479
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
21 more
- 2018Pitfalls of Graph Neural Network Evaluationcited by 994
- 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
- 2019Heterogeneous Graph Attention Networkcited by 732
- 2019Neural Graph Collaborative Filteringcited by 660
- 2015LINE: Large-scale Information Network Embeddingcited by 582
- 2020Heterogeneous Graph Transformercited by 581
- 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
- 2017Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2veccited by 197
- 2019AliGraph: A Comprehensive Graph Neural Network Platformcited by 152
- 2020DistDGL: Distributed Graph Neural Network Training for Billion-Scale Graphscited by 139
- 2020A Survey on Heterogeneous Graph Embedding: Methods, Techniques, Applications and Sourcescited by 126
- 2015PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networkscited by 96
- 2019Representation Learning for Attributed Multiplex Heterogeneous Networkcited by 91
- 2014On Using Very Large Target Vocabulary for Neural Machine Translationcited by 80
- 2019GraphZoom: A multi-level spectral approach for accurate and scalable graph embeddingcited by 58
- 2017Pixie: A System for Recommending 3+ Billion Items to 200+ Million Users in Real-Timecited by 46
- 2020Scalable Graph Neural Networks for Heterogeneous Graphscited by 31
- 2018MILE: A Multi-Level Framework for Scalable Graph Embeddingcited by 28
- 2021Billion-Scale Pretraining with Vision Transformers for Multi-Task Visual Representationscited by 24
- 2016Task-Guided and Path-Augmented Heterogeneous Network Embedding for Author Identificationcited by 18
- 2017Semi-supervised Embedding in Attributed Networks with Outlierscited by 10
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 4.
6 papers.
- 2024Personalized Audiobook Recommendations at Spotify Through Graph Neural Networkscited by 14
- 2024RoarGraph: A Projected Bipartite Graph for Efficient Cross-Modal Approximate Nearest Neighbor Searchcited by 12
- 2023Generative and Contrastive Paradigms Are Complementary for Graph Self-Supervised Learningcited by 9
- 2022FairMILE: Towards an Efficient Framework for Fair Graph Representation Learningcited by 4
- 2024A Thorough Performance Benchmarking on Lightweight Embedding-based Recommender Systemscited by 4
- 2024Graph Sparsification for Enhanced Conformal Prediction in Graph Neural Networkscited by 0
- 2024Graph Sparsification for Enhanced Conformal Prediction in Graph Neural Networks28 Oct 2024
- 2024RoarGraph: A Projected Bipartite Graph for Efficient Cross-Modal Approximate Nearest Neighbor Search16 Aug 2024
- 2024A Thorough Performance Benchmarking on Lightweight Embedding-based Recommender Systems25 Jun 2024
- 2024Personalized Audiobook Recommendations at Spotify Through Graph Neural Networks8 Mar 2024
- 2023Generative and Contrastive Paradigms Are Complementary for Graph Self-Supervised Learning24 Oct 2023
- 2022FairMILE: Towards an Efficient Framework for Fair Graph Representation Learning17 Nov 2022