mlsanityData to 7 Oct 2026

The Voronoi Bottleneck: Capacity-Aware Dense Retrieval for Product Search

arXiv 2606.28359 ↗First posted 9 Jun 2026cs.IR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Dense embedding retrieval compresses all relevance information into a single inner product, imposing a fundamental geometric limit -- the Voronoi Bottleneck -- on the number of query-document relevance patterns expressible at fixed embedding dimension (d). We make three contributions. (1) Unified capacity theory. We prove that Voronoi complexity and sign-rank are equivalent for top-1 retrieval, yielding tight dimension bounds and a computable diagnostic, the Capacity Utilization Score (CUS), that predicts per-query retrieval failure with AUC (> 0.8) without relevance labels. (2) Diagnosis. CUS identifies two capacity regimes -- moderate ((δ gtrsim 1)), where density-aware training yields measurable gains, and vacuous ((δ ll 1)), where it does not -- giving practitioners an a priori check before investing in retraining. (3) DART training. We introduce AT-DW-InfoNCE, an Adaptive-Temperature Density-Weighted contrastive objective with formally derived optimal weighting (α^* = 2.0). On a 100K-query synthetic product-search corpus with controlled relevance structure, DART improves +1.9 Recall@100 over a same-data InfoNCE baseline ((84.9 ± 0.0) vs. (83.0 ± 0.3); 8 seeds, (p < 0.001)), outperforming focal loss and temperature-schedule alternatives. DART requires zero inference-time overhead -- it is a drop-in training objective that improves any dual-encoder system.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 21 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

12 of 21 references.

References · 12

  1. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  2. 2017Billion-scale similarity search with GPUscited by 2,477
  3. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  4. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  5. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
  6. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  7. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
  8. 2020Contrastive Learning with Hard Negative Samplescited by 619
  9. 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
  10. 2021Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Samplingcited by 238
  11. 2019Multi-Stage Document Ranking with BERTcited by 200
  12. 2025On the Theoretical Limitations of Embedding-Based Retrievalcited by 98

Built on by

Not cited yet.