mlsanityData to 13 Oct 2026

IVF-TQ: Calibration-Free Streaming Vector Search via a Codebook-Free Residual Layer

arXiv 2605.17415 ↗First posted 17 May 2026cs.LG cs.AI cs.DBcited by 0

Not on the map. Why?

Abstract (arXiv)

Approximate nearest neighbor (ANN) indexes deployed against streaming corpora silently lose recall over weeks. The standard diagnosis is distribution shift, but under shuffled-i.i.d. ingestion -- no shift at all -- product quantization still degrades -3.8pp at sub-matched bit budgets. The dominant production compression methods (PQ, OPQ, ScaNN) all fit a codebook to an initial sample and reuse it as the database grows by orders of magnitude. This paper presents IVF-TQ, an inverted-file index whose residual compression layer is data-independent: a fixed random rotation followed by a precomputed Lloyd-Max scalar quantizer parameterised only by the bit width b and dimension d. Only the IVF coarse k-means partition is trained. A uniform-over-sphere inner-product error bound depending only on (b, d, delta) provides a structural guarantee no learned-codebook method admits. The same codebook-free design enables an IVF-amplification effect that closes the gap to Extended RaBitQ to within statistical noise (+17.7pp over flat TQ at matched bit budget), and an Adaptive variant that refreshes the partition without touching the compression layer. Across nine controlled cells (three 10M datasets, three PQ memory regimes, three seeds), per-batch PQ codebook retraining never recovers the streaming gap; IVF-PQ streaming stability requires per-dataset bit-budget tuning, while IVF-TQ holds at one fixed (b, d) configuration on all three datasets with Delta in [-0.80, +0.56]pp. The contribution is operational: no codebook to train, no per-dataset bit-budget tuning, no retraining cycle that ever closes the gap.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 17 May 2026.

Builds on

20 of 28 references.

References · 20

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,221
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,107
  3. 2017Billion-scale similarity search with GPUscited by 2,490
  4. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,600
  5. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 857
  6. 2018ANN-Benchmarks: A Benchmarking Tool for Approximate Nearest Neighbor Algorithmscited by 130
  7. 2025TurboQuant: Online Vector Quantization with Near-optimal Distortion Ratecited by 119
  8. 2017Fast Approximate Nearest Neighbor Search With The Navigating Spreading-out Graphcited by 104
  9. 2024RaBitQ: Quantizing High-Dimensional Vectors with a Theoretical Error Bound for Approximate Nearest Neighbor Searchcited by 47
  10. 2024QJL: 1-Bit Quantized JL Transform for KV Cache Quantization with Zero Overheadcited by 47
  11. 2021FreshDiskANN: A Fast and Accurate Graph-Based ANN Index for Streaming Similarity Searchcited by 37
  12. 2021SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Searchcited by 35
8 more
  1. 2024SPFresh: Incremental In-Place Update for Billion-Scale Vector Searchcited by 28
  2. 2025PolarQuant: Quantizing KV Caches with Polar Transformationcited by 26
  3. 2024Practical and Asymptotically Optimal Quantization of High-Dimensional Vectors in Euclidean Space for Approximate Nearest Neighbor Searchcited by 20
  4. 2017Accelerated Nearest Neighbor Search with Quick ADCcited by 9
  5. 2024Incremental IVF Index Maintenance for Streaming Vector Searchcited by 7
  6. 2026GPU-Native Approximate Nearest Neighbor Search with IVF-RaBitQ: Fast Index Build and Searchcited by 4
  7. 2025SAQ: Pushing the Limits of Vector Quantization through Code Adjustment and Dimension Segmentationcited by 3
  8. 2025Quantization for Vector Search under Streaming Updatescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RSLM: Training-Free Vector Quantization for Approximate Nearest Neighbor Search
  2. 2026TurboVec: A Case Study in Cost-Efficient Private Retrieval for Enterprise RAG via Codebook-Oblivious Quantization
  3. 2026MRVQ: One Resident Index for Dimension- and Rate-Elastic Vector Search
  4. 2024Locally-Adaptive Quantization for Streaming Vector Search
  5. 2026FaTRQ: Tiered Residual Quantization for LLM Vector Search in Far-Memory-Aware ANNS Systems
  6. 2026XFP: Quality-Targeted Adaptive Codebook Quantization with Sparse Outlier Separation for LLM Inference
  7. 2025Dimension vs. Precision: A Comparative Analysis of Autoencoders and Quantization for Efficient Vector Retrieval on BEIR SciFact
  8. 2025Qinco2: Vector Compression and Search with Improved Implicit Neural Codebooks