mlsanityData to 7 Oct 2026

OneShot: Index-in-Ranking with Neural Scoring for Large-Scale Retrieval

arXiv 2607.27475 ↗First posted 29 Jul 2026cs.IR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In modern recommendation systems, retrieval serves as a primary stage responsible for filtering billions of candidate items down to thousands prior to refined ranking. To make this massive search effective and efficient, the system relies on ranking accuracy and indexing efficiency. However, these two objectives are traditionally misaligned: while the former optimizes for the alignment between ranking predictions and user behavior, the latter optimizes for a structural grouping of item representations which enables fast search among billions of candidates. Thus, despite extensive efforts to scale up interaction modeling for retrieval, they remain fundamentally limited by the structural misalignment between the ranking objectives and the proximity-learned index. In this work, we address this long-standing dichotomy by proposing a new holistic retrieval framework, OneShot. It is an end-to-end, in-model index learning framework that natively aligns index learning with ranking objectives. Using this joint learning as a structural foundation, OneShot pushes the boundaries of retrieval expressiveness by scaling interaction modeling with neural scoring beyond the persistent dot-product bottleneck. OneShot is fully deployed in Instagram's industrial short-video recommendation system, driving significant wins in user daily sessions, engagement, and time-spent. Additionally, OneShot achieves a 20% recall gain at the operational ranking volume and a 10x efficiency improvement at an equivalent recall level.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

36 of 53 references.

References · 36

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2017Neural Discrete Representation Learningcited by 4,650
  4. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  5. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  6. 2017Billion-scale similarity search with GPUscited by 2,477
  7. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
  8. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  9. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 853
  10. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  11. 2020Jukebox: A Generative Model for Musiccited by 535
  12. 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 326
24 more
  1. 2023Recommender Systems with Generative Retrievalcited by 191
  2. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 167
  3. 2014Asymmetric LSH (ALSH) for Sublinear Time Maximum Inner Product Search (MIPS)cited by 109
  4. 2018AttentionXML: Label Tree-based Attention-Aware Deep Model for High-Performance Extreme Multi-Label Text Classificationcited by 101
  5. 2018Learning Tree-based Deep Model for Recommender Systemscited by 99
  6. 2014Stochastic Compositional Gradient Descent: Algorithms for Minimizing Compositions of Expected-Value Functionscited by 93
  7. 2014On Using Very Large Target Vocabulary for Neural Machine Translationcited by 80
  8. 2023TWIN: TWo-stage Interest Network for Lifelong User Behavior Modeling in CTR Prediction at Kuaishoucited by 40
  9. 2022On the Effectiveness of Sampled Softmax Loss for Item Recommendationcited by 39
  10. 2019Joint Optimization of Tree-based Index and Deep Model for Recommender Systemscited by 37
  11. 2019Differentiable Product Quantization for End-to-End Embedding Compressioncited by 36
  12. 2019Extreme Classification in Log Memory using Count-Min Sketch: A Case Study of Amazon Search with 50M Productscited by 36
  13. 2025PLUM: Adapting Pre-trained Language Models for Industrial-scale Generative Recommendationscited by 27
  14. 2020Learning Optimal Tree Models Under Beam Searchcited by 26
  15. 2022CARCA: Context and Attribute-Aware Next-Item Recommendation via Cross-Attentioncited by 22
  16. 2019Candidate Generation with Binary Codes for Large-Scale Top-N Recommendationcited by 19
  17. 2025Enhancing Embedding Representation Stability in Recommendation Systems with Semantic IDcited by 19
  18. 2016Scalable and Sustainable Deep Learning via Randomized Hashingcited by 17
  19. 2026Differentiable Semantic ID for Generative Recommendationcited by 16
  20. 2022Approximate Nearest Neighbor Search under Neural Similarity Metric for Large-Scale Recommendationcited by 14
  21. 2023Revisiting Neural Retrieval on Acceleratorscited by 14
  22. 2025Real-time Indexing for Large-scale Recommendation by Streaming Vector Quantization Retrievercited by 9
  23. 2025Realizing Scaling Laws in Recommender Systems: A Foundation-Expert Paradigm for Hyperscale Model Deploymentcited by 4
  24. 2024Retrieval with Learned Similaritiescited by 3

Built on by

Not cited yet.