Related Pins at Pinterest: The Evolution of a Real-World Recommender System
Not on the map. Why?
Abstract (arXiv)
Related Pins is the Web-scale recommender system that powers over 40% of user engagement on Pinterest. This paper is a longitudinal study of three years of its development, exploring the evolution of the system and its components from prototypes to present state. Each component was originally built with many constraints on engineering effort and computational resources, so we prioritized the simplest and highest-leverage solutions. We show how organic growth led to a complex system and how we managed this complexity. Many challenges arose while building this system, such as avoiding feedback loops, evaluating performance, activating content, and eliminating legacy heuristics. Finally, we offer suggestions for tackling these challenges when engineering Web-scale recommender systems.
Key facts. Cited by 24 papers in the map (data through 13 Oct 2026). First posted on arXiv 26 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 9; 2023: 5; 2024: 2; 2025: 5; 2026: 1.
24 papers.
Sort:
By area:
- 2022Understanding Scaling Laws for Recommendation Modelscited by 38
- 2023TransAct: Transformer-based Realtime User Action Model for Recommendation at Pinterestcited by 35
- 2021Billion-Scale Pretraining with Vision Transformers for Multi-Task Visual Representationscited by 24
- 2023High-Throughput Vector Similarity Search in Knowledge Graphscited by 19
- 2021Persia: An Open, Hybrid System Scaling Deep Learning-based Recommenders up to 100 Trillion Parameterscited by 17
- 2022AutoShard: Automated Embedding Table Sharding for Recommender Systemscited by 17
- 2022DreamShard: Generalizable Embedding Table Placement for Recommender Systemscited by 14
- 2022Recommendation Systems with Distribution-Free Reliability Guaranteescited by 13
- 2022BagPipe: Accelerating Deep Recommendation Model Trainingcited by 10
- 2023Online Matching: A Real-time Bandit System for Large-scale Recommendationscited by 8
- 2025Quake: Adaptive Indexing for Vector Searchcited by 8
- 2024Incremental IVF Index Maintenance for Streaming Vector Searchcited by 7
12 more
- 2025MicroNN: An On-device Disk-resident Updatable Vector Databasecited by 6
- 2023Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Modelscited by 5
- 2022kNN-Embed: Locally Smoothed Embedding Mixtures For Multi-interest Candidate Retrievalcited by 4
- 2022Learning to Rank For Push Notifications Using Pairwise Expected Regretcited by 3
- 2022Biomedical Multi-hop Question Answering Using Knowledge Graph Embeddings and Language Modelscited by 1
- 2023Impression-Aware Recommender Systemscited by 1
- 2024Position bias in featurescited by 1
- 2025Save, Revisit, Retain: A Scalable Framework for Enhancing User Retention in Large-Scale Recommender Systemscited by 1
- 2025Warmer for Less: A Cost-Efficient Strategy for Cold-Start Recommendations at Pinterestcited by 1
- 2022MetaCon: Unified Predictive Segments System with Trillion Concept Meta-Learningcited by 0
- 2025Applying Deep Learning to Ads Conversion Prediction in Last Mile Delivery Marketplacecited by 0
- 2026Distributional Approximate Nearest Neighbour Search for Uncertainty-Aware Retrievalcited by 0
- 2026Distributional Approximate Nearest Neighbour Search for Uncertainty-Aware Retrieval3 Jun 2026
- 2025Warmer for Less: A Cost-Efficient Strategy for Cold-Start Recommendations at Pinterest19 Dec 2025
- 2025Save, Revisit, Retain: A Scalable Framework for Enhancing User Retention in Large-Scale Recommender Systems22 Nov 2025
- 2025Quake: Adaptive Indexing for Vector Search3 Jun 2025
- 2025MicroNN: An On-device Disk-resident Updatable Vector Database8 Apr 2025
- 2025Applying Deep Learning to Ads Conversion Prediction in Last Mile Delivery Marketplace14 Feb 2025
- 2024Incremental IVF Index Maintenance for Streaming Vector Search1 Nov 2024
- 2024Position bias in features4 Feb 2024
- 2023Impression-Aware Recommender Systems15 Aug 2023
- 2023Online Matching: A Real-time Bandit System for Large-scale Recommendations29 Jul 2023
- 2023TransAct: Transformer-based Realtime User Action Model for Recommendation at Pinterest31 May 2023
- 2023Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models3 May 2023
12 more
- 2023High-Throughput Vector Similarity Search in Knowledge Graphs4 Apr 2023
- 2022Biomedical Multi-hop Question Answering Using Knowledge Graph Embeddings and Language Models10 Nov 2022
- 2022DreamShard: Generalizable Embedding Table Placement for Recommender Systems5 Oct 2022
- 2022Understanding Scaling Laws for Recommendation Models17 Aug 2022
- 2022AutoShard: Automated Embedding Table Sharding for Recommender Systems12 Aug 2022
- 2022Recommendation Systems with Distribution-Free Reliability Guarantees4 Jul 2022
- 2022kNN-Embed: Locally Smoothed Embedding Mixtures For Multi-interest Candidate Retrieval12 May 2022
- 2022MetaCon: Unified Predictive Segments System with Trillion Concept Meta-Learning9 Mar 2022
- 2022BagPipe: Accelerating Deep Recommendation Model Training24 Feb 2022
- 2022Learning to Rank For Push Notifications Using Pairwise Expected Regret19 Jan 2022
- 2021Persia: An Open, Hybrid System Scaling Deep Learning-based Recommenders up to 100 Trillion Parameters10 Nov 2021
- 2021Billion-Scale Pretraining with Vision Transformers for Multi-Task Visual Representations12 Aug 2021
- 2025Quake: Adaptive Indexing for Vector Searchcited by 8
- 2025MicroNN: An On-device Disk-resident Updatable Vector Databasecited by 6
- 2025Quake: Adaptive Indexing for Vector Search3 Jun 2025
- 2025MicroNN: An On-device Disk-resident Updatable Vector Database8 Apr 2025
- 2022Understanding Scaling Laws for Recommendation Modelscited by 38
- 2023TransAct: Transformer-based Realtime User Action Model for Recommendation at Pinterestcited by 35
- 2021Billion-Scale Pretraining with Vision Transformers for Multi-Task Visual Representationscited by 24
- 2023High-Throughput Vector Similarity Search in Knowledge Graphscited by 19
- 2021Persia: An Open, Hybrid System Scaling Deep Learning-based Recommenders up to 100 Trillion Parameterscited by 17
- 2022AutoShard: Automated Embedding Table Sharding for Recommender Systemscited by 17
- 2022DreamShard: Generalizable Embedding Table Placement for Recommender Systemscited by 14
- 2022Recommendation Systems with Distribution-Free Reliability Guaranteescited by 13
- 2022BagPipe: Accelerating Deep Recommendation Model Trainingcited by 10
- 2023Online Matching: A Real-time Bandit System for Large-scale Recommendationscited by 8
- 2024Incremental IVF Index Maintenance for Streaming Vector Searchcited by 7
- 2023Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Modelscited by 5
12 most cited of 22 All 22 (JSON)
- 2026Distributional Approximate Nearest Neighbour Search for Uncertainty-Aware Retrieval3 Jun 2026
- 2025Warmer for Less: A Cost-Efficient Strategy for Cold-Start Recommendations at Pinterest19 Dec 2025
- 2025Save, Revisit, Retain: A Scalable Framework for Enhancing User Retention in Large-Scale Recommender Systems22 Nov 2025
- 2025Applying Deep Learning to Ads Conversion Prediction in Last Mile Delivery Marketplace14 Feb 2025
- 2024Incremental IVF Index Maintenance for Streaming Vector Search1 Nov 2024
- 2024Position bias in features4 Feb 2024
- 2023Impression-Aware Recommender Systems15 Aug 2023
- 2023Online Matching: A Real-time Bandit System for Large-scale Recommendations29 Jul 2023
- 2023TransAct: Transformer-based Realtime User Action Model for Recommendation at Pinterest31 May 2023
- 2023Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models3 May 2023
- 2023High-Throughput Vector Similarity Search in Knowledge Graphs4 Apr 2023
- 2022Biomedical Multi-hop Question Answering Using Knowledge Graph Embeddings and Language Models10 Nov 2022
12 newest of 22 All 22 (JSON)