Keeping the Index Open: The Recommendation-Side Cost of Shared Search and Recommendation
Not on the map. Why?
Abstract (arXiv)
A shared search-and-recommendation index must score new items from features alone because search has no exploration slot. In a public log covering both surfaces over one catalog, 38.6% of held-out query-search impressions show an item never previously shown or visited. For user-cold engagements, the feature-based tower serves this demand without measurable loss against 99 sampled negatives (0.9595 Recall@20 versus 0.9510 warm). A lexical baseline reaches similar parity, while a full-catalog check remains statistically undecided. Dual-encoder retrieval therefore keeps the index open to new items, unlike an ID-softmax recommender that requires retraining. We price this openness on recommendation against six sequential baselines, each retrained and tuned through five rounds on corrected targets. A float32 timestamp bug had reordered leave-one-out targets for 19.7% of users. On MovieLens-1M, warm accuracy trails the strongest retrained baseline by 5.2% Recall@20 and 11.4% NDCG@20. On MIND, the gap narrows to 0.8--3.6% relative to the five strongest baselines, though the model ranks sixth of seven. Under strict zero-leakage cold-start evaluation, the content tower achieves 0.172 ± 0.006 Recall@20, 1.4× the strongest retrained dedicated method (0.124 ± 0.007) and 3× a training-free floor, without cold-specific training. Exact full-softmax training raises Recall@20 by 54% on MIND-small and 6.9% on MovieLens-1M over sampled InfoNCE, but recomputes the full catalog each step and exhausts accelerator memory at 240K items. Approximate nearest-neighbor search explains none of the remaining gap, serving cost does not regress against ID-softmax retrieval, and a history-window sweep explains half the post-recipe remainder. Exact-quality training at catalog scale remains the open problem.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 58 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
33 of 58 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
- 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 320
- 2017Neural Attentive Session-based Recommendationcited by 237
21 more
- 2020Sparse, Dense, and Attentional Representations for Text Retrievalcited by 214
- 2019Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approachescited by 185
- 2020Embedding-based Retrieval in Facebook Searchcited by 156
- 2020RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithmscited by 138
- 2022Filter-enhanced MLP is All You Need for Sequential Recommendationcited by 96
- 2021Contrastive Learning for Cold-Start Recommendationcited by 79
- 2016Efficient softmax approximation for GPUscited by 67
- 2017Pixie: A System for Recommending 3+ Billion Items to 200+ Million Users in Real-Timecited by 47
- 2024Cut Your Losses in Large-Vocabulary Language Modelscited by 40
- 2022On the Effectiveness of Sampled Softmax Loss for Item Recommendationcited by 39
- 2022Decoupled Side Information Fusion for Sequential Recommendationcited by 30
- 2023Turning Dross Into Gold Loss: is BERT4Rec really better than SASRec?cited by 30
- 2023gSASRec: Reducing Overconfidence in Sequential Recommendation Trained with Negative Samplingcited by 29
- 2021Cross-Batch Negative Sampling for Training Two-Tower Recommenderscited by 24
- 2023When Search Meets Recommendation: Learning Disentangled Search Representation for Recommendationcited by 17
- 2024Scalable Cross-Entropy Loss for Sequential Recommendations with Large Item Catalogscited by 15
- 2023Beyond Two-Tower Matching: Learning Sparse Retrievable Cross-Interactions for Recommendationcited by 13
- 2024UniSAR: Modeling User Transition Behaviors between Search and Recommendationcited by 12
- 2024RECE: Reduced Cross-Entropy Loss for Large-Catalogue Sequential Recommenderscited by 9
- 2025Efficient Recommendation with Millions of Items by Dynamic Pruning of Sub-Item Embeddingscited by 3
- 2025Correcting the LogQ Correction: Revisiting Sampled Softmax for Large-Scale Retrievalcited by 1
Built on by
Not cited yet.