Approximate Nearest Neighbor Search on High Dimensional Data --- Experiments, Analyses, and Improvement (v1.0)
Not on the map. Why?
Abstract (arXiv)
Approximate Nearest neighbor search (ANNS) is fundamental and essential operation in applications from many domains, such as databases, machine learning, multimedia, and computer vision. Although many algorithms have been continuously proposed in the literature in the above domains each year, there is no comprehensive evaluation and analysis of their performances. In this paper, we conduct a comprehensive experimental evaluation of many state-of-the-art methods for approximate nearest neighbor search. Our study (1) is cross-disciplinary (i.e., including 16 algorithms in different domains, and from practitioners) and (2) has evaluated a diverse range of settings, including 20 datasets, several evaluation metrics, and different query workloads. The experimental results are carefully reported and analyzed to understand the performance results. Furthermore, we propose a new method that achieves both high query efficiency and high recall empirically on majority of the datasets under a wide range of settings.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Oct 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 4; 2023: 13; 2024: 16; 2025: 1; 2026: 1.
44 papers.
Sort:
By area:
- 2021Hyperdimensional computing as a framework for systematic aggregation of image descriptorscited by 32
- 2023Visual Place Recognition: A Tutorialcited by 31
- 2023CAGRA: Highly Parallel Graph Construction and Approximate Nearest Neighbor Search for GPUscited by 22
- 2023Similarity search in the blink of an eye with compressed indicescited by 20
- 2023Worst-case Performance of Popular Approximate Nearest Neighbor Search Implementations: Guarantees and Limitationscited by 20
- 2022Distill-VQ: Learning Retrieval Oriented Vector Quantization By Distilling Knowledge from Dense Embeddingscited by 17
- 2021What makes visual place recognition easy or hard?cited by 14
- 2023Pre-trained Embeddings for Entity Resolution: An Experimental Analysis [Experiment, Analysis & Benchmark]cited by 13
- 2024Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representationscited by 12
- 2024RoarGraph: A Projected Bipartite Graph for Efficient Cross-Modal Approximate Nearest Neighbor Searchcited by 12
- 2024Generative Dense Retrieval: Memory Can Be a Burdencited by 11
- 2021Data Twinningcited by 10
32 more
- 2024Locally-Adaptive Quantization for Streaming Vector Searchcited by 10
- 2021Mask-GVAE: Blind Denoising Graphs via Partitioncited by 9
- 2022TaDaa: real time Ticket Assignment Deep learning Auto Advisor for customer support, help desk, and issue ticketing systemscited by 7
- 2024Multi-Label Plant Species Classification with Self-Supervised Vision Transformerscited by 7
- 2021Beyond ANN: Exploiting Structural Knowledge for Efficient Place Recognitioncited by 6
- 2023Track Mix Generation on Music Streaming Services using Transformerscited by 6
- 2023Cross Modal Data Discovery over Structured and Unstructured Data Lakescited by 5
- 2024VDTuner: Automated Performance Tuning for Vector Data Management Systemscited by 5
- 2022Reducing Training Sample Memorization in GANs by Training with Memorization Rejectioncited by 4
- 2024Evaluation of Semantic Search and its Role in Retrieved-Augmented-Generation (RAG) for Arabic Languagecited by 4
- 2024CANDY: A Benchmark for Continuous Approximate Nearest Neighbor Search with Dynamic Data Ingestioncited by 4
- 2024LoRANN: Low-Rank Matrix Factorization for Approximate Nearest Neighbor Searchcited by 4
- 2023AdANNS: A Framework for Adaptive Semantic Searchcited by 2
- 2023K-Nearest-Neighbor Resampling for Off-Policy Evaluation in Stochastic Controlcited by 2
- 2023MultiEM: Efficient and Effective Unsupervised Multi-Table Entity Matchingcited by 2
- 2023Locally Adaptive and Differentiable Regressioncited by 2
- 2024Approximate Nearest Neighbour Search on Dynamic Datasets: An Investigationcited by 2
- 2024ChipExpert: The Open-Source Integrated-Circuit-Design-Specific Large Language Modelcited by 2
- 2023EHI: End-to-end Learning of Hierarchical Index for Efficient Dense Retrievalcited by 1
- 2024ChatGraph: Chat with Your Graphscited by 1
- 2024Theoretical and Empirical Analysis of Adaptive Entry Point Selection for Graph-based Approximate Nearest Neighbor Searchcited by 1
- 2024Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoderscited by 1
- 2021Instance-based learning using the Half-Space Proximal Graphcited by 0
- 2021A multimodal deep learning framework for scalable content based visual media retrievalcited by 0
- 2021A Simple Generative Networkcited by 0
- 2021Scalable Reverse Image Search Engine for NASAWorldviewcited by 0
- 2022Learned k-NN Distance Estimationcited by 0
- 2023Fast Locality Sensitive Hashing with Theoretical Guaranteecited by 0
- 2024Exploring the Meaningfulness of Nearest Neighbor Search in High-Dimensional Spacecited by 0
- 2024Online and Offline Evaluations of Collaborative Filtering and Content Based Recommender Systemscited by 0
- 2025Bidding-Aware Retrieval for Multi-Stage Consistency in Online Advertisingcited by 0
- 2026Progressive Searching for Retrieval in RAGcited by 0
- 2026Progressive Searching for Retrieval in RAG7 Feb 2026
- 2025Bidding-Aware Retrieval for Multi-Stage Consistency in Online Advertising7 Aug 2025
- 2024Online and Offline Evaluations of Collaborative Filtering and Content Based Recommender Systems2 Nov 2024
- 2024LoRANN: Low-Rank Matrix Factorization for Approximate Nearest Neighbor Search24 Oct 2024
- 2024Exploring the Meaningfulness of Nearest Neighbor Search in High-Dimensional Space8 Oct 2024
- 2024RoarGraph: A Projected Bipartite Graph for Efficient Cross-Modal Approximate Nearest Neighbor Search16 Aug 2024
- 2024ChipExpert: The Open-Source Integrated-Circuit-Design-Specific Large Language Model26 Jul 2024
- 2024Multi-Label Plant Species Classification with Self-Supervised Vision Transformers8 Jul 2024
- 2024CANDY: A Benchmark for Continuous Approximate Nearest Neighbor Search with Dynamic Data Ingestion28 Jun 2024
- 2024Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoders6 May 2024
- 2024Approximate Nearest Neighbour Search on Dynamic Datasets: An Investigation30 Apr 2024
- 2024Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representations19 Apr 2024
32 more
- 2024VDTuner: Automated Performance Tuning for Vector Data Management Systems16 Apr 2024
- 2024Evaluation of Semantic Search and its Role in Retrieved-Augmented-Generation (RAG) for Arabic Language27 Mar 2024
- 2024Theoretical and Empirical Analysis of Adaptive Entry Point Selection for Graph-based Approximate Nearest Neighbor Search7 Feb 2024
- 2024Locally-Adaptive Quantization for Streaming Vector Search3 Feb 2024
- 2024ChatGraph: Chat with Your Graphs23 Jan 2024
- 2024Generative Dense Retrieval: Memory Can Be a Burden19 Jan 2024
- 2023Worst-case Performance of Popular Approximate Nearest Neighbor Search Implementations: Guarantees and Limitations29 Oct 2023
- 2023EHI: End-to-end Learning of Hierarchical Index for Efficient Dense Retrieval13 Oct 2023
- 2023Fast Locality Sensitive Hashing with Theoretical Guarantee27 Sep 2023
- 2023CAGRA: Highly Parallel Graph Construction and Approximate Nearest Neighbor Search for GPUs29 Aug 2023
- 2023Locally Adaptive and Differentiable Regression14 Aug 2023
- 2023MultiEM: Efficient and Effective Unsupervised Multi-Table Entity Matching2 Aug 2023
- 2023Track Mix Generation on Music Streaming Services using Transformers6 Jul 2023
- 2023K-Nearest-Neighbor Resampling for Off-Policy Evaluation in Stochastic Control7 Jun 2023
- 2023Cross Modal Data Discovery over Structured and Unstructured Data Lakes1 Jun 2023
- 2023AdANNS: A Framework for Adaptive Semantic Search30 May 2023
- 2023Pre-trained Embeddings for Entity Resolution: An Experimental Analysis [Experiment, Analysis & Benchmark]24 Apr 2023
- 2023Similarity search in the blink of an eye with compressed indices7 Apr 2023
- 2023Visual Place Recognition: A Tutorial6 Mar 2023
- 2022Reducing Training Sample Memorization in GANs by Training with Memorization Rejection21 Oct 2022
- 2022Learned k-NN Distance Estimation29 Aug 2022
- 2022TaDaa: real time Ticket Assignment Deep learning Auto Advisor for customer support, help desk, and issue ticketing systems18 Jul 2022
- 2022Distill-VQ: Learning Retrieval Oriented Vector Quantization By Distilling Knowledge from Dense Embeddings1 Apr 2022
- 2021Data Twinning6 Oct 2021
- 2021Scalable Reverse Image Search Engine for NASAWorldview10 Aug 2021
- 2021What makes visual place recognition easy or hard?23 Jun 2021
- 2021A Simple Generative Network17 Jun 2021
- 2021A multimodal deep learning framework for scalable content based visual media retrieval18 May 2021
- 2021Beyond ANN: Exploiting Structural Knowledge for Efficient Place Recognition15 Mar 2021
- 2021Mask-GVAE: Blind Denoising Graphs via Partition8 Feb 2021
- 2021Instance-based learning using the Half-Space Proximal Graph4 Feb 2021
- 2021Hyperdimensional computing as a framework for systematic aggregation of image descriptors19 Jan 2021
- 2026Progressive Searching for Retrieval in RAGcited by 0
- 2026Progressive Searching for Retrieval in RAG7 Feb 2026
- 2021Hyperdimensional computing as a framework for systematic aggregation of image descriptorscited by 32
- 2023Visual Place Recognition: A Tutorialcited by 31
- 2023CAGRA: Highly Parallel Graph Construction and Approximate Nearest Neighbor Search for GPUscited by 22
- 2023Similarity search in the blink of an eye with compressed indicescited by 20
- 2023Worst-case Performance of Popular Approximate Nearest Neighbor Search Implementations: Guarantees and Limitationscited by 20
- 2022Distill-VQ: Learning Retrieval Oriented Vector Quantization By Distilling Knowledge from Dense Embeddingscited by 17
- 2021What makes visual place recognition easy or hard?cited by 14
- 2023Pre-trained Embeddings for Entity Resolution: An Experimental Analysis [Experiment, Analysis & Benchmark]cited by 13
- 2024Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representationscited by 12
- 2024RoarGraph: A Projected Bipartite Graph for Efficient Cross-Modal Approximate Nearest Neighbor Searchcited by 12
- 2024Generative Dense Retrieval: Memory Can Be a Burdencited by 11
- 2021Data Twinningcited by 10
12 most cited of 43 All 43 (JSON)
- 2025Bidding-Aware Retrieval for Multi-Stage Consistency in Online Advertising7 Aug 2025
- 2024Online and Offline Evaluations of Collaborative Filtering and Content Based Recommender Systems2 Nov 2024
- 2024LoRANN: Low-Rank Matrix Factorization for Approximate Nearest Neighbor Search24 Oct 2024
- 2024Exploring the Meaningfulness of Nearest Neighbor Search in High-Dimensional Space8 Oct 2024
- 2024RoarGraph: A Projected Bipartite Graph for Efficient Cross-Modal Approximate Nearest Neighbor Search16 Aug 2024
- 2024ChipExpert: The Open-Source Integrated-Circuit-Design-Specific Large Language Model26 Jul 2024
- 2024Multi-Label Plant Species Classification with Self-Supervised Vision Transformers8 Jul 2024
- 2024CANDY: A Benchmark for Continuous Approximate Nearest Neighbor Search with Dynamic Data Ingestion28 Jun 2024
- 2024Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoders6 May 2024
- 2024Approximate Nearest Neighbour Search on Dynamic Datasets: An Investigation30 Apr 2024
- 2024Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representations19 Apr 2024
- 2024VDTuner: Automated Performance Tuning for Vector Data Management Systems16 Apr 2024
12 newest of 43 All 43 (JSON)