mlsanityData to 7 Oct 2026

When Does Dense Retrieval Need Asymmetric Geometry? A Bias-Variance Theory of Shared and Dual Projections

arXiv 2609.32488 ↗First posted 26 Sep 2026cs.IR cs.LGcited by 0

On the map: Retrieval-augmented generation → Generation and context integration also fits: Vector search and ANN indexes

Abstract (arXiv)

Dense retrieval powers retrieval-augmented generation, semantic search, and question answering, yet the theoretical basis for choosing between shared and dual query-document projections remains unclear. We introduce a bias-variance theory for low-rank bilinear scoring. Shared projections induce positive-semidefinite operators, whereas dual projections realize arbitrary low-rank operators. We derive their exact approximation gap and prove a local Gaussian boundary: dual has lower risk exactly when squared directional signal exceeds the estimation cost of its additional degrees of freedom. This boundary motivates the Cross-fitted Asymmetry Risk Selector (CARS), which estimates reproducible directional signal from training pairs; its Gaussian counterpart admits exact selection-power and regret formulas. Guided by the theory, we run retrieval experiments across multiple datasets and embedding models. The mean Dual-minus-Shared NDCG@10 advantage more than doubles as query rotation increases from 0 degrees to 90 degrees. In the rank-sample-size grids, Shared wins 13 of 16 cells at n=32, whereas Dual wins all 32 cells at n=1024 and n=2048. Consistent with this shift, all 168 comparable operator-risk curves move toward Dual as training data grow. Compared to the two fixed-geometry baselines, CARS reduces held-out regret by 49-96% and achieves 90.1% mean geometry-selection accuracy.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 21 of its 41 references that are in the map. First posted on arXiv 26 Sep 2026.

Builds on

21 of 41 references.

Closest ancestors · 1

Same direction, newest first

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks22 May

Other references · 20

  1. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  2. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  3. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  4. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
  5. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  6. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
  7. 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 556
  8. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
  9. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
  10. 2021GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrievalcited by 119
  11. 2016Rate-Optimal Perturbation Bounds for Singular Subspaces with Applications to High-Dimensional Statisticscited by 45
  12. 2022Exploring Dual Encoder Architectures for Question Answeringcited by 19
8 more
  1. 2022COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learningcited by 19
  2. 2024Matryoshka-Adaptor: Unsupervised and Supervised Tuning for Smaller Embedding Dimensionscited by 16
  3. 2021More Robust Dense Retrieval with Contrastive Dual Learningcited by 15
  4. 2023Search-Adaptor: Embedding Customization for Information Retrievalcited by 10
  5. 2017Stochastic Canonical Correlation Analysiscited by 7
  6. 2017End-to-End Cross-Modality Retrieval with CCA Projections and Pairwise Ranking Losscited by 7
  7. 2019Computing the degrees of freedom of rank-regularized estimators and cousinscited by 2
  8. 2026Align Then Adapt: Label-Efficient Adapter Learning for Asymmetric Dense Retrievalcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Collapse of Dense Retrievers: Short, Early, and Literal Biases Outranking Factual Evidence
  2. 2026ScoreGate: Adaptive Chunk Selection for Retrieval-Augmented Generation via Dual-Score Statistical Fusion
  3. 2026Taxonomy of the Retrieval System Framework: Pitfalls and Paradigms
  4. 2026Towards a Relevance Posterior in Neural Information Access ↗
  5. 2026BoundaryMORPH: Budgeted Reranking via Active Set Selection for Diffuse Retrieval
  6. 2026Finding the Right Balance: Relevance and Diversity in LLM Retrieval
  7. 2026Retrieval-Guided Fine-Tuning as Noisy Estimation: Risk bounds and Architectural Analysis
  8. 2026JKO-RAG: Distributional Retrieval as Wasserstein Free-Energy Gradient Flow