Approximate Nearest Neighbor Search in High Dimensions
Not on the map. Why?
Abstract (arXiv)
The nearest neighbor problem is defined as follows: Given a set P of n points in some metric space (X,D), build a data structure that, given any point q, returns a point in P that is closest to q (its "nearest neighbor" in P). The data structure stores additional information about the set P, which is then used to find the nearest neighbor without computing all distances between q and P. The problem has a wide range of applications in machine learning, computer vision, databases and other fields. To reduce the time needed to find nearest neighbors and the amount of memory used by the data structure, one can formulate the em approximate nearest neighbor problem, where the the goal is to return any point p' ∈ P such that the distance from q to p' is at most c · minp ∈ P D(q,p), for some c ≥ 1. Over the last two decades, many efficient solutions to this problem were developed. In this article we survey these developments, as well as their connections to questions in geometric functional analysis and combinatorial geometry.
Key facts. Cited by 47 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 7; 2023: 6; 2024: 7; 2025: 11; 2026: 6.
47 papers.
Sort:
By area:
- 2023Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Timecited by 252
- 2022Multi-View Document Representation Learning for Open-Domain Dense Retrievalcited by 41
- 2021Multi-Vector Models with Textual Guidance for Fine-Grained Scientific Document Similaritycited by 35
- 2021Does Preprocessing Help Training Over-parameterized Neural Networks?cited by 32
- 2022Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessingcited by 29
- 2021Learning-Augmented k-means Clusteringcited by 26
- 2024Hidden in the Noise: Two-Stage Robust Watermarking for Imagescited by 21
- 2023Worst-case Performance of Popular Approximate Nearest Neighbor Search Implementations: Guarantees and Limitationscited by 20
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
- 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashingcited by 15
- 2021Linear Bandit Algorithms with Sublinear Time Complexitycited by 9
- 2021SLOSH: Set LOcality Sensitive Hashing via Sliced-Wasserstein Embeddingscited by 9
35 more
- 2021Learning to Hash Robustly, Guaranteedcited by 7
- 2022Sublinear Time Algorithm for Online Weighted Bipartite Matchingcited by 7
- 2021Self-Supervised Motion Retargeting with Safety Guaranteecited by 6
- 2022Falconn++: A Locality-sensitive Filtering Approach for Approximate Nearest Neighbor Searchcited by 6
- 2022A Theoretical View on Sparsely Activated Networkscited by 6
- 2024HashEvict: A Pre-Attention KV Cache Eviction Strategy using Locality-Sensitive Hashingcited by 6
- 2023Query Encoder Distillation via Embedding Alignment is a Strong Baseline Method to Boost Dense Retriever Online Efficiencycited by 5
- 2024LSHBloom: Memory-efficient, Extreme-scale Document Deduplicationcited by 5
- 2025syftr: Pareto-Optimal Generative AIcited by 5
- 2023Data Structures for Density Estimationcited by 4
- 20254bit-Quantization in Vector-Embedding for RAGcited by 4
- 2025Monitoring Robustness and Individual Fairnesscited by 3
- 2023Simple, Scalable and Effective Clustering via One-Dimensional Projectionscited by 2
- 2024Conditional Mean and Variance Estimation via textitk-NN Algorithm with Automated Variance Selectioncited by 2
- 2024Gini Coefficient as a Unified Metric for Evaluating Many-versus-Many Similarity in Vector Spacescited by 2
- 2022Unsupervised Space Partitioning for Nearest Neighbor Searchcited by 1
- 2026DASH-KV: Accelerating Long-Context LLM Inference via Asymmetric KV Cache Hashingcited by 1
- 2021Nearest Neighbor Search Under Uncertaintycited by 0
- 2022Addressing Bias in Face Detectors using Decentralised Data collection with incentivescited by 0
- 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Trainingcited by 0
- 2024Scalable Density-based Clustering with Random Projectionscited by 0
- 2024Discovering Data Structures: Nearest Neighbor Search and Beyondcited by 0
- 2025Beyond Worst-Case Dimensionality Reduction for Sparse Vectorscited by 0
- 2025GARLIC: GAussian Representation LearnIng for spaCe partitioningcited by 0
- 2025Lightweight Relevance Grader in RAGcited by 0
- 2025A Hybrid Framework for Subject Analysis: Integrating Embedding-Based Regression Models with Large Language Modelscited by 0
- 2025Enhancing Serendipity Recommendation System by Constructing Dynamic User Knowledge Graphs with Large Language Modelscited by 0
- 2025Stack Trace-Based Crash Deduplication with Transformer Adaptationcited by 0
- 2025Multimedia-Aware Question Answering: A Review of Retrieval and Cross-Modal Reasoning Architecturescited by 0
- 2025Graph-based Nearest Neighbors with Dynamic Updates via Random Walkscited by 0
- 2026Progressive Searching for Retrieval in RAGcited by 0
- 2026Learning Partition Trees for Nearest Neighbor Searchcited by 0
- 2026Sub-Quadratic Bisimulation Metrics via Approximate Nearest Neighbors: Coverage-Augmented Guarantees and Computable Two-Sided Certificatescited by 0
- 2026Multimodal Dual-Encoder Retrieval for Automated ICD Codingcited by 0
- 2026Efficient Test-time Adaptation through Candidate Verification and Divergence Shiftscited by 0
- 2026Efficient Test-time Adaptation through Candidate Verification and Divergence Shifts5 Oct 2026
- 2026Multimodal Dual-Encoder Retrieval for Automated ICD Coding3 Oct 2026
- 2026Sub-Quadratic Bisimulation Metrics via Approximate Nearest Neighbors: Coverage-Augmented Guarantees and Computable Two-Sided Certificates7 Aug 2026
- 2026Learning Partition Trees for Nearest Neighbor Search10 Jul 2026
- 2026DASH-KV: Accelerating Long-Context LLM Inference via Asymmetric KV Cache Hashing21 Apr 2026
- 2026Progressive Searching for Retrieval in RAG7 Feb 2026
- 2025Graph-based Nearest Neighbors with Dynamic Updates via Random Walks19 Dec 2025
- 2025Multimedia-Aware Question Answering: A Review of Retrieval and Cross-Modal Reasoning Architectures23 Oct 2025
- 2025Stack Trace-Based Crash Deduplication with Transformer Adaptation26 Aug 2025
- 2025Enhancing Serendipity Recommendation System by Constructing Dynamic User Knowledge Graphs with Large Language Models6 Aug 2025
- 2025A Hybrid Framework for Subject Analysis: Integrating Embedding-Based Regression Models with Large Language Models19 Jul 2025
- 2025Lightweight Relevance Grader in RAG17 Jun 2025
35 more
- 2025Monitoring Robustness and Individual Fairness31 May 2025
- 2025GARLIC: GAussian Representation LearnIng for spaCe partitioning30 May 2025
- 2025syftr: Pareto-Optimal Generative AI26 May 2025
- 2025Beyond Worst-Case Dimensionality Reduction for Sparse Vectors27 Feb 2025
- 20254bit-Quantization in Vector-Embedding for RAG17 Jan 2025
- 2024HashEvict: A Pre-Attention KV Cache Eviction Strategy using Locality-Sensitive Hashing13 Dec 2024
- 2024Hidden in the Noise: Two-Stage Robust Watermarking for Images5 Dec 2024
- 2024Gini Coefficient as a Unified Metric for Evaluating Many-versus-Many Similarity in Vector Spaces12 Nov 2024
- 2024LSHBloom: Memory-efficient, Extreme-scale Document Deduplication6 Nov 2024
- 2024Discovering Data Structures: Nearest Neighbor Search and Beyond5 Nov 2024
- 2024Scalable Density-based Clustering with Random Projections24 Feb 2024
- 2024Conditional Mean and Variance Estimation via textitk-NN Algorithm with Automated Variance Selection2 Feb 2024
- 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training19 Nov 2023
- 2023Worst-case Performance of Popular Approximate Nearest Neighbor Search Implementations: Guarantees and Limitations29 Oct 2023
- 2023Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time26 Oct 2023
- 2023Simple, Scalable and Effective Clustering via One-Dimensional Projections25 Oct 2023
- 2023Data Structures for Density Estimation20 Jun 2023
- 2023Query Encoder Distillation via Embedding Alignment is a Strong Baseline Method to Boost Dense Retriever Online Efficiency5 Jun 2023
- 2022Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessing25 Nov 2022
- 2022Addressing Bias in Face Detectors using Decentralised Data collection with incentives28 Oct 2022
- 2022A Theoretical View on Sparsely Activated Networks8 Aug 2022
- 2022Sublinear Time Algorithm for Online Weighted Bipartite Matching5 Aug 2022
- 2022Unsupervised Space Partitioning for Nearest Neighbor Search16 Jun 2022
- 2022Falconn++: A Locality-sensitive Filtering Approach for Approximate Nearest Neighbor Search3 Jun 2022
- 2022Multi-View Document Representation Learning for Open-Domain Dense Retrieval16 Mar 2022
- 2021SLOSH: Set LOcality Sensitive Hashing via Sliced-Wasserstein Embeddings11 Dec 2021
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structures30 Nov 2021
- 2021Multi-Vector Models with Textual Guidance for Fine-Grained Scientific Document Similarity16 Nov 2021
- 2021Learning-Augmented k-means Clustering27 Oct 2021
- 2021Does Preprocessing Help Training Over-parameterized Neural Networks?9 Oct 2021
- 2021Learning to Hash Robustly, Guaranteed11 Aug 2021
- 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashing18 May 2021
- 2021Self-Supervised Motion Retargeting with Safety Guarantee11 Mar 2021
- 2021Nearest Neighbor Search Under Uncertainty8 Mar 2021
- 2021Linear Bandit Algorithms with Sublinear Time Complexity3 Mar 2021
- 2025syftr: Pareto-Optimal Generative AIcited by 5
- 20254bit-Quantization in Vector-Embedding for RAGcited by 4
- 2025Lightweight Relevance Grader in RAGcited by 0
- 2025Multimedia-Aware Question Answering: A Review of Retrieval and Cross-Modal Reasoning Architecturescited by 0
- 2025Graph-based Nearest Neighbors with Dynamic Updates via Random Walkscited by 0
- 2026Progressive Searching for Retrieval in RAGcited by 0
- 2026Progressive Searching for Retrieval in RAG7 Feb 2026
- 2025Graph-based Nearest Neighbors with Dynamic Updates via Random Walks19 Dec 2025
- 2025Multimedia-Aware Question Answering: A Review of Retrieval and Cross-Modal Reasoning Architectures23 Oct 2025
- 2025Lightweight Relevance Grader in RAG17 Jun 2025
- 2025syftr: Pareto-Optimal Generative AI26 May 2025
- 20254bit-Quantization in Vector-Embedding for RAG17 Jan 2025
- 2022A Theoretical View on Sparsely Activated Networkscited by 6
- 2022A Theoretical View on Sparsely Activated Networks8 Aug 2022
- 2023Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Timecited by 252
- 2022Multi-View Document Representation Learning for Open-Domain Dense Retrievalcited by 41
- 2021Multi-Vector Models with Textual Guidance for Fine-Grained Scientific Document Similaritycited by 35
- 2021Does Preprocessing Help Training Over-parameterized Neural Networks?cited by 32
- 2022Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessingcited by 29
- 2021Learning-Augmented k-means Clusteringcited by 26
- 2024Hidden in the Noise: Two-Stage Robust Watermarking for Imagescited by 21
- 2023Worst-case Performance of Popular Approximate Nearest Neighbor Search Implementations: Guarantees and Limitationscited by 20
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
- 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashingcited by 15
- 2021Linear Bandit Algorithms with Sublinear Time Complexitycited by 9
- 2021SLOSH: Set LOcality Sensitive Hashing via Sliced-Wasserstein Embeddingscited by 9
12 most cited of 36 All 36 (JSON)
- 2026Multimodal Dual-Encoder Retrieval for Automated ICD Coding3 Oct 2026
- 2026Sub-Quadratic Bisimulation Metrics via Approximate Nearest Neighbors: Coverage-Augmented Guarantees and Computable Two-Sided Certificates7 Aug 2026
- 2026Learning Partition Trees for Nearest Neighbor Search10 Jul 2026
- 2025Stack Trace-Based Crash Deduplication with Transformer Adaptation26 Aug 2025
- 2025A Hybrid Framework for Subject Analysis: Integrating Embedding-Based Regression Models with Large Language Models19 Jul 2025
- 2025Monitoring Robustness and Individual Fairness31 May 2025
- 2025GARLIC: GAussian Representation LearnIng for spaCe partitioning30 May 2025
- 2025Beyond Worst-Case Dimensionality Reduction for Sparse Vectors27 Feb 2025
- 2024Hidden in the Noise: Two-Stage Robust Watermarking for Images5 Dec 2024
- 2024Gini Coefficient as a Unified Metric for Evaluating Many-versus-Many Similarity in Vector Spaces12 Nov 2024
- 2024LSHBloom: Memory-efficient, Extreme-scale Document Deduplication6 Nov 2024
- 2024Discovering Data Structures: Nearest Neighbor Search and Beyond5 Nov 2024
12 newest of 36 All 36 (JSON)