mlsanityData to 7 Oct 2026

Projection and Quantisation: A Unifying View of Learning to Hash, from Random Projections to the RAG Era

arXiv 2510.04127 ↗First posted 5 Oct 2025cs.IR cs.AI cs.CVcited by 0

On the map: Retrieval-augmented generation → Generation and context integration

Abstract (arXiv)

Approximate nearest-neighbour search underpins large-scale retrieval and retrieval-augmented generation, yet its methods are studied in communities that seldom read one another. We argue that they form one field with three design choices. We develop the projection-quantisation-organisation lens: every method places its projections, places its quantisation thresholds, and organises the resulting codes for search. We test the lens with a reproducible measurement, released as the open BitBudget benchmark, and report three findings. First, the quantisation axis delivers the largest memory savings: a one-bit code with full-precision re-ranking matches uncompressed quality for six of seven embedders, the scanned code one thirty-second of the float's size. Second, the orderings the lens anticipates, including a learned-embedding regime where binary codes overtake an inverted-file product quantiser at a matched byte budget, recur as the embedding is enlarged. Third, given class labels, an eight-byte supervised code more than doubles the retrieval quality of the two-kilobyte task-agnostic float it replaces. We also recast the semantic identifiers of generative retrieval as quantisation codes. The main contribution is a single, tested account of compact-code search, from random projections to the retrieval-augmented era.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. First posted on arXiv 5 Oct 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Matryoshka Hash Representations for Model-Aware Compact Semantic Retrieval
  2. 2025HASH-RAG: Bridging Deep Hashing with Retriever for Efficient, Fine Retrieval and Augmented Generation
  3. 2025Mutual Learning for Hashing: Unlocking Strong Hash Functions from Weak Supervision
  4. 2026Faithfulness Is Not Free: Auditing Offline KV-Cache Quantization in Retrieval-Augmented Generation
  5. 2026Quanta: A Self-Contained Python Library for Hybrid Retrieval over Quantised Embeddings, Lexical Indexes, and Knowledge Graphs
  6. 2024Distilling Vision-Language Pretraining for Efficient Cross-Modal Retrieval
  7. 2026Pointing the Way, Hiding the Destination: Practical Private Dense Retrieval at Scale
  8. 2026π-RAG: Oblivious Retrieval via Semantic Quantization and Transcendental Addressing for Large Language Models