Embedding-based Retrieval in Facebook Search
Not on the map. Why?
Abstract (arXiv)
Search in social networks such as Facebook poses different challenges than in classical web search: besides the query text, it is important to take into account the searcher's context to provide relevant results. Their social graph is an integral part of this context and is a unique aspect of Facebook search. While embedding-based retrieval (EBR) has been applied in eb search engines for years, Facebook search was still mainly based on a Boolean matching model. In this paper, we discuss the techniques for applying EBR to a Facebook Search system. We introduce the unified embedding framework developed to model semantic embeddings for personalized search, and the system to serve embedding-based retrieval in a typical search system based on an inverted index. We discuss various tricks and experiences on end-to-end optimization of the whole system, including ANN parameter tuning and full-stack optimization. Finally, we present our progress on two selected advanced topics about modeling. We evaluated EBR on verticals for Facebook Search with significant metrics gains observed in online A/B experiments. We believe this paper will provide useful insights and experiences to help people on developing embedding-based retrieval systems in search engines.
Key facts. Cited by 155 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 29; 2023: 28; 2024: 24; 2025: 38; 2026: 20.
155 papers.
Sort:
By area:
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2022MTEB: Massive Text Embedding Benchmarkcited by 623
- 2024The Faiss librarycited by 370
- 2024Generative Representational Instruction Tuningcited by 227
- 2021RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingcited by 175
- 2023Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approachcited by 168
- 2021GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrievalcited by 119
- 2021Adversarial Retriever-Ranker for dense text retrievalcited by 82
- 2021TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Searchcited by 54
- 2021Large-Scale Spatio-Temporal Person Re-identification: Algorithms and Benchmarkcited by 47
- 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
- 2025MemVerse: Multimodal Memory for Lifelong Learning Agentscited by 31
38 more
- 2025Search Arena: Analyzing Search-Augmented LLMscited by 30
- 2022Fine-Grained Distillation for Long Document Retrievalcited by 29
- 2021A Proposed Conceptual Framework for a Representational Approach to Information Retrievalcited by 24
- 2022ItemSage: Learning Product Embeddings for Shopping Recommendations at Pinterestcited by 23
- 2024Enhancing Taobao Display Advertising with Multimodal Representations: Challenges, Approaches and Insightscited by 23
- 2022Multi-view Multi-behavior Contrastive Learning in Recommendationcited by 21
- 2023Neurosymbolic AI for Reasoning over Knowledge Graphs: A Surveycited by 21
- 2022HLATR: Enhance Multi-stage Text Retrieval with Hybrid List Aware Transformer Rerankingcited by 19
- 2023Adap-τ: Adaptively Modulating Embedding Magnitude for Recommendationcited by 19
- 2023Embedding in Recommender Systems: A Surveycited by 19
- 2024PL-MTEB: Polish Massive Text Embedding Benchmarkcited by 19
- 2022Uni-Retriever: Towards Learning The Unified Embedding Based Retriever in Bing Sponsored Searchcited by 17
- 2022Distill-VQ: Learning Retrieval Oriented Vector Quantization By Distilling Knowledge from Dense Embeddingscited by 17
- 2022LED: Lexicon-Enlightened Dense Retriever for Large-Scale Retrievalcited by 15
- 2022DeepJoin: Joinable Table Discovery with Pre-trained Language Modelscited by 15
- 2023Tsetlin Machine Embedding: Representing Words Using Logical Expressionscited by 15
- 2022Approximate Nearest Neighbor Search under Neural Similarity Metric for Large-Scale Recommendationcited by 14
- 2023Revisiting Neural Retrieval on Acceleratorscited by 14
- 2024Does Negative Sampling Matter? A Review with Insights into its Theory and Applicationscited by 14
- 2022Heterogeneous Acceleration Pipeline for Recommendation System Trainingcited by 13
- 2023Beyond Two-Tower Matching: Learning Sparse Retrievable Cross-Interactions for Recommendationcited by 13
- 2024German Text Embedding Clustering Benchmarkcited by 13
- 2024OmniSearchSage: Multi-Task Multi-Entity Embeddings for Pinterest Searchcited by 13
- 2024Negating Negatives: Alignment with Human Negative Samples via Distributional Dispreference Optimizationcited by 11
- 2025MIEB: Massive Image Embedding Benchmarkcited by 11
- 2023Synthetic Query Generation for Privacy-Preserving Deep Retrieval Systems using Differentially Private Language Modelscited by 10
- 2024VectorSearch: Enhancing Document Retrieval with Semantic Embeddings and Optimized Searchcited by 10
- 2021Graph-based Multilingual Product Retrieval in E-commerce Searchcited by 9
- 2021Rethinking Self-Supervision Objectives for Generalizable Coherence Modelingcited by 8
- 2022Supervised Contrastive Learning for Recommendationcited by 7
- 2022Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrievalcited by 7
- 2022Scenario-Adaptive and Self-Supervised Model for Multi-Scenario Personalized Recommendationcited by 7
- 2023BatchSampler: Sampling Mini-Batches for Contrastive Learning in Vision, Language, and Graphscited by 7
- 2023Cold & Warm Net: Addressing Cold-Start Users in Recommender Systemscited by 7
- 2025FreeRet: MLLMs as Training-Free Retrieverscited by 7
- 2022Modality-Balanced Embedding for Video Retrievalcited by 6
- 2022Multi-Objective Personalized Product Retrieval in Taobao Searchcited by 6
- 2022SeDR: Segment Representation Learning for Long Documents Dense Retrievalcited by 6
50 most cited of 155 All 155 (JSON)
- 2026Retrieval Sensitivity to Identity Signals in Queries29 Sep 2026
- 2026Hybrid GPU-CPU Retrieval for Personalized Search at Ultra-Large Scale18 Sep 2026
- 2026Verify, Don't Trust: Agentic Model Development for Video Discovery Retrieval at Scale18 Sep 2026
- 2026Merging Cyber Threat Intelligence Through Retrieval-Augmented Generation and Small Language Models for Rich Threat Representation7 Sep 2026
- 2026A Multi-Source Ensemble Approach to Candidate Generation for Alternative Vacation Rental Property Recommendations4 Sep 2026
- 2026Keeping the Index Open: The Recommendation-Side Cost of Shared Search and Recommendation25 Aug 2026
- 2026A Recommendation System Approach for Interference-Robust Sensor Subset Selection11 Aug 2026
- 2026ANNLib: A Development Framework for Efficient Approximate Nearest Neighbor Search20 Jul 2026
- 2026IntentTune: Using user demand and personalization to resolve "unknown" query intents for e-commerce search1 Jul 2026
- 2026Real-Time Hard Negative Sampling via LLM-based Clustering for Large-Scale Two-Tower Retrieval1 Jul 2026
- 2026Policy Regret for Embedding Model Routing: Contextual Bandits with Low-Rank Experts12 Jun 2026
- 2026Bergson: An Open Source Library for Data Attribution10 Jun 2026
38 more
- 2026Semantic Retrieval for Product Search in E-Commerce31 May 2026
- 2026Structure Retention in Embedding Spaces as a Predictor of Benchmark Performance21 May 2026
- 2026To MRL or not to MRL: Text Embeddings are Robust to Truncation Without Matryoshka Learning, Except In Heavy Truncation Scenarios15 May 2026
- 2026Policy-Grounded Dynamic Facet Suggestions for Job Search15 May 2026
- 2026An In-Depth Study of Filter-Agnostic Vector Search on a PostgreSQL Database System: [Experiments and Analysis]24 Mar 2026
- 2026A Practical Algorithm for Feature-Rich, Non-Stationary Bandit Problems17 Mar 2026
- 2026Entropy Guided Diversification and Preference Elicitation in Agentic Recommendation Systems12 Mar 2026
- 2026Applying Embedding-Based Retrieval to Airbnb Search11 Jan 2026
- 2025SciNet: Evaluating AI Agents in Relation-Aware Scientific Literature Retrieval16 Dec 2025
- 2025Breaking the Curse of Dimensionality: On the Stability of Modern Vector Retrieval13 Dec 2025
- 2025Near-Zero-Overhead Freshness for Recommendation Systems via Inference-Side Model Updates13 Dec 2025
- 2025MemVerse: Multimodal Memory for Lifelong Learning Agents3 Dec 2025
- 2025Distillation-based Scenario-Adaptive Mixture-of-Experts for the Matching Stage of Multi-scenario Recommendation28 Nov 2025
- 2025MixLM: High-Throughput and Effective LLM Ranking via Text-Embedding Mix-Interaction25 Nov 2025
- 2025Uncertainty Modeling for Multi-Objective RTA Interception with Distillation Acceleration5 Nov 2025
- 2025Approximate Diverse k-nearest Neighbor Search in Vector Database31 Oct 2025
- 2025VeritasFi: An Adaptable, Multi-tiered RAG Framework for Multi-modal Financial Question Answering12 Oct 2025
- 2025CustomIR: Unsupervised Fine-Tuning of Dense Embeddings for Known Document Corpora30 Sep 2025
- 2025Understanding Generative Recommendation with Semantic IDs from a Model-scaling View29 Sep 2025
- 2025Scalable Disk-Based Approximate Nearest Neighbor Search with Page-Aligned Graph29 Sep 2025
- 2025FreeRet: MLLMs as Training-Free Retrievers29 Sep 2025
- 2025Semi-Supervised Synthetic Data Generation with Fine-Grained Relevance Control for Short Video Search Relevance Modeling20 Sep 2025
- 2025Modernizing Facebook Scoped Search: Keyword and Embedding Hybrid Retrieval with LLM Evaluation17 Sep 2025
- 2025ScaleDoc: Scaling LLM-based Predicates over Large Document Collections16 Sep 2025
- 2025Decoupled Entity Representation Learning for Pinterest Ads Ranking4 Sep 2025
- 2025SEAL: Structure and Element Aware Learning to Improve Long Structured Document Retrieval28 Aug 2025
- 2025MPFormer: Adaptive Framework for Industrial Multi-Task Personalized Sequential Retriever28 Aug 2025
- 2025On The Role of Pretrained Language Models in General-Purpose Text Embeddings: A Survey28 Jul 2025
- 2025WebANNS: Fast and Efficient Approximate Nearest Neighbor Search in Web Browsers1 Jul 2025
- 2025PERSCEN: Learning Personalized Interaction Pattern and Scenario Preference for Multi-Scenario Matching23 Jun 2025
- 2025REIS: A High-Performance and Energy-Efficient Retrieval System with In-Storage Processing19 Jun 2025
- 2025Search Arena: Analyzing Search-Augmented LLMs5 Jun 2025
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models5 Jun 2025
- 2025FinBERT2: A Specialized Bidirectional Encoder for Bridging the Gap in Finance-Specific Deployment of Large Language Models31 May 2025
- 2025MMGeoLM: Hard Negative Contrastive Learning for Fine-Grained Geometric Understanding in Large Multimodal Models26 May 2025
- 2025Aug2Search: Enhancing Facebook Marketplace Search with LLM-Generated Synthetic Data Augmentation21 May 2025
- 2025UniMoCo: Unified Modality Completion for Robust Multi-Modal Embeddings17 May 2025
- 2025Theoretical Guarantees for LT-TTD: A Unified Transformer-based Architecture for Two-Level Ranking Systems7 May 2025
50 newest of 155 All 155 (JSON)
- 2025VeritasFi: An Adaptable, Multi-tiered RAG Framework for Multi-modal Financial Question Answeringcited by 3
- 2025WebANNS: Fast and Efficient Approximate Nearest Neighbor Search in Web Browserscited by 1
- 2025CustomIR: Unsupervised Fine-Tuning of Dense Embeddings for Known Document Corporacited by 0
- 2025Approximate Diverse k-nearest Neighbor Search in Vector Databasecited by 0
- 2025Breaking the Curse of Dimensionality: On the Stability of Modern Vector Retrievalcited by 0
- 2026Merging Cyber Threat Intelligence Through Retrieval-Augmented Generation and Small Language Models for Rich Threat Representationcited by 0
- 2026Merging Cyber Threat Intelligence Through Retrieval-Augmented Generation and Small Language Models for Rich Threat Representation7 Sep 2026
- 2025Breaking the Curse of Dimensionality: On the Stability of Modern Vector Retrieval13 Dec 2025
- 2025Approximate Diverse k-nearest Neighbor Search in Vector Database31 Oct 2025
- 2025VeritasFi: An Adaptable, Multi-tiered RAG Framework for Multi-modal Financial Question Answering12 Oct 2025
- 2025CustomIR: Unsupervised Fine-Tuning of Dense Embeddings for Known Document Corpora30 Sep 2025
- 2025WebANNS: Fast and Efficient Approximate Nearest Neighbor Search in Web Browsers1 Jul 2025
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2022MTEB: Massive Text Embedding Benchmarkcited by 623
- 2024The Faiss librarycited by 370
- 2024Generative Representational Instruction Tuningcited by 227
- 2021RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingcited by 175
- 2023Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approachcited by 168
- 2021GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrievalcited by 119
- 2021Adversarial Retriever-Ranker for dense text retrievalcited by 82
- 2021TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Searchcited by 54
- 2021Large-Scale Spatio-Temporal Person Re-identification: Algorithms and Benchmarkcited by 47
- 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
- 2025MemVerse: Multimodal Memory for Lifelong Learning Agentscited by 31
12 most cited of 138 All 138 (JSON)
- 2026Retrieval Sensitivity to Identity Signals in Queries29 Sep 2026
- 2026Hybrid GPU-CPU Retrieval for Personalized Search at Ultra-Large Scale18 Sep 2026
- 2026A Multi-Source Ensemble Approach to Candidate Generation for Alternative Vacation Rental Property Recommendations4 Sep 2026
- 2026Keeping the Index Open: The Recommendation-Side Cost of Shared Search and Recommendation25 Aug 2026
- 2026A Recommendation System Approach for Interference-Robust Sensor Subset Selection11 Aug 2026
- 2026ANNLib: A Development Framework for Efficient Approximate Nearest Neighbor Search20 Jul 2026
- 2026IntentTune: Using user demand and personalization to resolve "unknown" query intents for e-commerce search1 Jul 2026
- 2026Real-Time Hard Negative Sampling via LLM-based Clustering for Large-Scale Two-Tower Retrieval1 Jul 2026
- 2026Policy Regret for Embedding Model Routing: Contextual Bandits with Low-Rank Experts12 Jun 2026
- 2026Bergson: An Open Source Library for Data Attribution10 Jun 2026
- 2026Semantic Retrieval for Product Search in E-Commerce31 May 2026
- 2026Structure Retention in Embedding Spaces as a Predictor of Benchmark Performance21 May 2026
12 newest of 138 All 138 (JSON)