mlsanityData to 7 Oct 2026

Filtered ANN as a Phase Transition: When Selectivity-Estimation Error Causes Plan Regret

arXiv 2606.16341 ↗First posted 15 Jun 2026cs.LG cs.DBcited by 0

Not on the map. Why?

Abstract (arXiv)

A filtered approximate-nearest-neighbor (ANN) query returns the k nearest vectors among those satisfying an attribute predicate P of selectivity s. The best execution strategy -- pre-filter, post-filter, or in-filter -- changes with s, so a system must estimate s and choose. We model this as an argmax over a landscape with phases (regions where each strategy wins) separated by boundaries, and show that selectivity-estimation error produces plan regret -- recall lost versus the oracle strategy -- only in the critical regions around those boundaries. The regret is a wedge of log-width equal to the multiplicative estimation error epsilon and height equal to the local cliff |V'(s*)| epsilon; the flip-margin 1/|V'(s*)| is the condition number of a sibling cardinality-estimation study reappearing as the local boundary theory. The two phase boundaries follow from independent mathematics: order statistics place the post-filter cliff at s ~ k/K, and site percolation places the in-filter cliff at s_c ~ 0.83/M for graph degree M (corpus-size independent). Criticality exists only under a constrained budget B < sqrt(k n). Under pre-registered decision rules we confirm, on synthetic sweeps and real SIFT1M, that regret concentrates ~290x at the boundary and that the regret curves obey a finite-size scaling collapse onto one universal wedge across two decades of corpus size. A real approximate index does not mis-locate the boundary, but a biased cost model opens a persistent miscalibration band that estimation-error robustness cannot fix. The contribution is a characterization, not a new index. Code and the full pre-registration are public.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 16 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

6 of 16 references.

References · 6

  1. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 853
  2. 2024ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured Datacited by 31
  3. 2024Results of the Big ANN: NeurIPS'23 competitioncited by 21
  4. 2024UNIFY: Unified Index for Range Filtered Approximate Nearest Neighbors Searchcited by 10
  5. 2026Efficient Filtered-ANN via Learning-based Query Planningcited by 2
  6. 2026When Does q-error Predict Plan Regret? Three Regimes of Cardinality-Estimation Errorcited by 1

Built on by

Not cited yet.