A Simple and Effective Framework for Symmetric Consistent Indexing in Large-Scale Dense Retrieval
Not on the map. Why?
Abstract (arXiv)
Dense retrieval has become the industry standard in large-scale information retrieval systems due to its high efficiency and competitive accuracy. Its core relies on a coarse-to-fine hierarchical architecture that enables rapid candidate selection and precise semantic matching, achieving millisecond-level response over billion-scale corpora. This capability makes it essential not only in traditional search and recommendation scenarios but also in the emerging paradigm of generative recommendation driven by large language models, where semantic IDs-themselves a form of coarse-to-fine representation-play a foundational role. However, the widely adopted dual-tower encoding architecture introduces inherent challenges, primarily representational space misalignment and retrieval index inconsistency, which degrade matching accuracy, retrieval stability, and performance on long-tail queries. These issues are further magnified in semantic ID generation, ultimately limiting the performance ceiling of downstream generative models. To address these challenges, this paper proposes a simple and effective framework named SCI comprising two synergistic modules: a symmetric representation alignment module that employs an innovative input-swapping mechanism to unify the dual-tower representation space without adding parameters, and an consistent indexing with dual-tower synergy module that redesigns retrieval paths using a dual-view indexing strategy to maintain consistency from training to inference. The framework is systematic, lightweight, and engineering-friendly, requiring minimal overhead while fully supporting billion-scale deployment. We provide theoretical guarantees for our approach, with its effectiveness validated by results across public datasets and real-world e-commerce datasets.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 36 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
22 of 36 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
- 2021Large Dual Encoders Are Generalizable Retrieverscited by 456
- 2022Transformer Memory as a Differentiable Search Indexcited by 247
- 2021Optimizing Dense Retrieval Model Training with Hard Negativescited by 155
- 2018Learning Tree-based Deep Model for Recommender Systemscited by 99
- 2021A Few Brief Notes on DeepImpact, COIL, and a Conceptual Framework for Information Retrieval Techniquescited by 69
10 more
- 2021SimpleX: A Simple and Strong Baseline for Collaborative Filteringcited by 65
- 2021Salient Phrase Aware Dense Retrieval: Can a Dense Retriever Imitate a Sparse One?cited by 60
- 2023T2Ranking: A large-scale Chinese Benchmark for Passage Rankingcited by 60
- 2020Distilling Dense Representations for Ranking using Tightly-Coupled Teacherscited by 52
- 2021Jointly Optimizing Query Encoder and Product Quantization to Improve Retrieval Performancecited by 35
- 2022Ultron: An Ultimate Retriever on Corpus with a Model-based Indexercited by 31
- 2021Learning Discrete Representations via Constrained Clustering for Effective and Efficient Dense Retrievalcited by 27
- 2023Generative Retrieval via Term Set Generationcited by 13
- 2023Beyond Two-Tower Matching: Learning Sparse Retrievable Cross-Interactions for Recommendationcited by 13
- 2025Unleashing the Potential of Two-Tower Models: Diffusion-Based Cross-Interaction for Large-Scale Matchingcited by 3
Built on by
Not cited yet.