When Does Dense Retrieval Need Asymmetric Geometry? A Bias-Variance Theory of Shared and Dual Projections
On the map: Retrieval-augmented generation → Generation and context integration also fits: Vector search and ANN indexes
Abstract (arXiv)
Dense retrieval powers retrieval-augmented generation, semantic search, and question answering, yet the theoretical basis for choosing between shared and dual query-document projections remains unclear. We introduce a bias-variance theory for low-rank bilinear scoring. Shared projections induce positive-semidefinite operators, whereas dual projections realize arbitrary low-rank operators. We derive their exact approximation gap and prove a local Gaussian boundary: dual has lower risk exactly when squared directional signal exceeds the estimation cost of its additional degrees of freedom. This boundary motivates the Cross-fitted Asymmetry Risk Selector (CARS), which estimates reproducible directional signal from training pairs; its Gaussian counterpart admits exact selection-power and regret formulas. Guided by the theory, we run retrieval experiments across multiple datasets and embedding models. The mean Dual-minus-Shared NDCG@10 advantage more than doubles as query rotation increases from 0 degrees to 90 degrees. In the rank-sample-size grids, Shared wins 13 of 16 cells at n=32, whereas Dual wins all 32 cells at n=1024 and n=2048. Consistent with this shift, all 168 comparable operator-risk curves move toward Dual as training data grow. Compared to the two fixed-geometry baselines, CARS reduces held-out regret by 49-96% and achieves 90.1% mean geometry-selection accuracy.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 21 of its 41 references that are in the map. First posted on arXiv 26 Sep 2026.
Builds on
21 of 41 references.
Closest ancestors · 1
Same direction, newest first
Other references · 20
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 556
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
- 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
- 2021GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrievalcited by 119
- 2016Rate-Optimal Perturbation Bounds for Singular Subspaces with Applications to High-Dimensional Statisticscited by 45
- 2022Exploring Dual Encoder Architectures for Question Answeringcited by 19
8 more
- 2022COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learningcited by 19
- 2024Matryoshka-Adaptor: Unsupervised and Supervised Tuning for Smaller Embedding Dimensionscited by 16
- 2021More Robust Dense Retrieval with Contrastive Dual Learningcited by 15
- 2023Search-Adaptor: Embedding Customization for Information Retrievalcited by 10
- 2017Stochastic Canonical Correlation Analysiscited by 7
- 2017End-to-End Cross-Modality Retrieval with CCA Projections and Pairwise Ranking Losscited by 7
- 2019Computing the degrees of freedom of rank-regularized estimators and cousinscited by 2
- 2026Align Then Adapt: Label-Efficient Adapter Learning for Asymmetric Dense Retrievalcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Collapse of Dense Retrievers: Short, Early, and Literal Biases Outranking Factual Evidence
- 2026ScoreGate: Adaptive Chunk Selection for Retrieval-Augmented Generation via Dual-Score Statistical Fusion
- 2026Taxonomy of the Retrieval System Framework: Pitfalls and Paradigms
- 2026Towards a Relevance Posterior in Neural Information Access ↗
- 2026BoundaryMORPH: Budgeted Reranking via Active Set Selection for Diffuse Retrieval
- 2026Finding the Right Balance: Relevance and Diversity in LLM Retrieval
- 2026Retrieval-Guided Fine-Tuning as Noisy Estimation: Risk bounds and Architectural Analysis
- 2026JKO-RAG: Distributional Retrieval as Wasserstein Free-Energy Gradient Flow