mlsanityData to 7 Oct 2026

Results of the Big ANN: NeurIPS'23 competition

arXiv 2409.17424 ↗First posted 25 Sep 2024cs.IR cs.DS cs.LGcited by 21

Not on the map. Why?

Abstract (arXiv)

The 2023 Big ANN Challenge, held at NeurIPS 2023, focused on advancing the state-of-the-art in indexing data structures and search algorithms for practical variants of Approximate Nearest Neighbor (ANN) search that reflect the growing complexity and diversity of workloads. Unlike prior challenges that emphasized scaling up classical ANN search ~citeDBLP:conf/nips/SimhadriWADBBCH21, this competition addressed filtered search, out-of-distribution data, sparse and streaming variants of ANNS. Participants developed and submitted innovative solutions that were evaluated on new standard datasets with constrained computational resources. The results showcased significant improvements in search accuracy and efficiency over industry-standard baselines, with notable contributions from both academic and industrial teams. This paper summarizes the competition tracks, datasets, evaluation metrics, and the innovative approaches of the top-performing submissions, providing insights into the current advancements and future directions in the field of approximate nearest neighbor search.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 25 Sep 2024.

Builds on

13 of 27 references.

References · 13

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2017Squeeze-and-Excitation Networkscited by 4,763
  3. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  4. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 853
  5. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
  6. 2024The Faiss librarycited by 370
  7. 2018ANN-Benchmarks: A Benchmarking Tool for Approximate Nearest Neighbor Algorithmscited by 130
  8. 2022From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effectivecited by 98
  9. 2022Results of the NeurIPS'21 Challenge on Billion-Scale Approximate Nearest Neighbor Searchcited by 45
  10. 2021FreshDiskANN: A Fast and Accurate Graph-Based ANN Index for Streaming Similarity Searchcited by 36
  11. 2024Efficient Inverted Indexes for Approximate Retrieval over Learned Sparse Representationscited by 23
  12. 2024RoarGraph: A Projected Bipartite Graph for Efficient Cross-Modal Approximate Nearest Neighbor Searchcited by 12
1 more
  1. 2023An Approximate Algorithm for Maximum Inner Product Search over Streaming Sparse Vectorscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 12; 2026: 9.

21 papers.

Sort:

By area:

  1. 2025Inference-time sparse attention with asymmetric indexingcited by 11
  2. 2025MicroNN: An On-device Disk-resident Updatable Vector Databasecited by 6
  3. 2025VIBE: Vector Index Benchmark for Embeddingscited by 6
  4. 2025Exploring Large Action Sets with Hyperspherical Embeddings using von Mises-Fisher Samplingcited by 3
  5. 2026Results and Retrospective Analysis of the CODS 2025 AssetOpsBench Challengecited by 2
  6. 2025Machine learning and high dimensional vector searchcited by 1
  7. 2025LotusFilter: Fast Diverse Nearest Neighbor Search via a Learned Cutoff Tablecited by 1
  8. 2025Efficient Sketching and Nearest Neighbor Search Algorithms for Sparse Vector Setscited by 1
  9. 2025Scalable k-Means Clustering for Large k via Seeded Approximate Nearest-Neighbor Searchcited by 0
  10. 2025MINT: Multi-Vector Search Index Tuningcited by 0
  11. 2025Distance Adaptive Beam Search for Provably Accurate Graph-Based Nearest Neighbor Searchcited by 0
  12. 2025Passing the Baton: High Throughput Distributed Disk-Based Vector Search with BatANNcited by 0
9 more
  1. 2025Exqutor: Extended Query Optimizer for Vector-augmented Analytical Queriescited by 0
  2. 2026MCGI: Manifold-Consistent Graph Indexing for Billion-Scale Disk-Resident Vector Searchcited by 0
  3. 2026Welfarist Formulations for Diverse Similarity Searchcited by 0
  4. 2026Filtered Approximate Nearest Neighbor Search in Vector Databases: System Design and Performance Analysiscited by 0
  5. 2026Filtered ANN as a Phase Transition: When Selectivity-Estimation Error Causes Plan Regretcited by 0
  6. 2026ANNLib: A Development Framework for Efficient Approximate Nearest Neighbor Searchcited by 0
  7. 2026VQ-bench: A Composable Vector Quantization Frameworkcited by 0
  8. 2026A Power Law in Logarithm's Clothing: On the Scalability of Graph-Based Vector Searchcited by 0
  9. 2026Beyond Private Training: The New Landscape of AI Privacycited by 0