Practical and Optimal LSH for Angular Distance
Not on the map. Why?
Abstract (arXiv)
We show the existence of a Locality-Sensitive Hashing (LSH) family for the angular distance that yields an approximate Near Neighbor Search algorithm with the asymptotically optimal running time exponent. Unlike earlier algorithms with this property (e.g., Spherical LSH [Andoni, Indyk, Nguyen, Razenshteyn 2014], [Andoni, Razenshteyn 2015]), our algorithm is also practical, improving upon the well-studied hyperplane LSH [Charikar, 2002] in practice. We also introduce a multiprobe version of this algorithm, and conduct experimental evaluation on real and synthetic data sets. We complement the above positive results with a fine-grained lower bound for the quality of any LSH family for angular distance. Our lower bound implies that the above LSH family exhibits a trade-off between evaluation time and quality that is close to optimal for a natural class of LSH functions.
Key facts. Cited by 105 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Sep 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 18; 2023: 12; 2024: 17; 2025: 21; 2026: 17.
105 papers.
Sort:
By area:
- 2023Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Timecited by 247
- 2021Scatterbrain: Unifying Sparse and Low-rank Attention Approximationcited by 128
- 2024MagicPIG: LSH Sampling for Efficient LLM Generationcited by 112
- 2021End-to-End Training of Neural Retrievers for Open-Domain Question Answeringcited by 75
- 2023Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memorycited by 64
- 2022Video Transformers: A Surveycited by 63
- 2021EDEN: Communication-Efficient and Robust Distributed Mean Estimation for Federated Learningcited by 53
- 2021End-to-End User Behavior Retrieval in Click-Through RatePrediction Modelcited by 45
- 2021Does Preprocessing Help Training Over-parameterized Neural Networks?cited by 32
- 2022Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessingcited by 29
- 2022Sampling Is All You Need on Modeling Long-Term User Behaviors for CTR Predictioncited by 24
- 2023ParlayANN: Scalable and Deterministic Parallel Graph-Based Approximate Nearest Neighbor Search Algorithmscited by 24
38 more
- 2023Faster Causal Attention Over Large Sequences Through Sparse Flash Attentioncited by 24
- 2022EcoFormer: Energy-Saving Attention with Linear Complexitycited by 21
- 2021Shifted Chunk Transformer for Spatio-Temporal Representational Learningcited by 20
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
- 2022TPU-KNN: K Nearest Neighbor Search at Peak FLOP/scited by 18
- 2021You Only Sample (Almost) Once: Linear Cost Self-Attention Via Bernoulli Samplingcited by 17
- 2022LSG Attention: Extrapolation of pretrained Transformers to long sequencescited by 16
- 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashingcited by 15
- 2024Scalable Cross-Entropy Loss for Sequential Recommendations with Large Item Catalogscited by 15
- 2022OOD-DiskANN: Efficient and Scalable Graph ANNS for Out-of-Distribution Queriescited by 14
- 2024Sketch-GNN: Scalable Graph Neural Networks with Sublinear Training Complexitycited by 14
- 2025EraRAG: Efficient and Incremental Retrieval Augmented Generation for Growing Corporacited by 14
- 2024Locality-Sensitive Hashing-Based Efficient Point Transformer with Applications in High-Energy Physicscited by 12
- 2021Scalable Optimal Transport in High Dimensions for Graph Distances, Embedding Alignment, and Morecited by 10
- 2022Survival Kernets: Scalable and Interpretable Deep Kernel Survival Analysis with an Accuracy Guaranteecited by 9
- 2024RECE: Reduced Cross-Entropy Loss for Large-Catalogue Sequential Recommenderscited by 9
- 2021DEANN: Speeding up Kernel-Density Estimation using Approximate Nearest Neighbor Searchcited by 8
- 2023Memoria: Resolving Fateful Forgetting Problem through Human-Inspired Memory Architecturecited by 8
- 2024LookupFFN: Making Transformers Compute-lite for CPU inferencecited by 8
- 2024IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUscited by 8
- 2021Learning to Hash Robustly, Guaranteedcited by 7
- 2022QUIC-FL: Quick Unbiased Compression for Federated Learningcited by 7
- 2022Sublinear Time Algorithm for Online Weighted Bipartite Matchingcited by 7
- 2024Navigable Graphs for High-Dimensional Nearest Neighbor Search: Constructions and Limitscited by 7
- 2022Falconn++: A Locality-sensitive Filtering Approach for Approximate Nearest Neighbor Searchcited by 6
- 2022A Theoretical View on Sparsely Activated Networkscited by 6
- 2026Provable Quantization with Randomized Hadamard Transformcited by 6
- 2022iFlipper: Label Flipping for Individual Fairnesscited by 5
- 2026Scout Before You Attend: Sketch-and-Walk Sparse Attention for Efficient LLM Inferencecited by 4
- 2022Faster Maximum Inner Product Search in High Dimensionscited by 3
- 2023TBIN: Modeling Long Textual Behavior Data for CTR Predictioncited by 3
- 2024Curator: Efficient Indexing for Multi-Tenant Vector Databasescited by 3
- 2024Probabilistic Routing for Graph-Based Approximate Nearest Neighbor Searchcited by 3
- 2025Explainable and Robust Millimeter Wave Beam Alignment for AI-Native 6G Networkscited by 3
- 2025Cracking Vector Search Indexescited by 3
- 2025HONEYBEE: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning[Technical Report]cited by 3
- 2026Revisiting RaBitQ and TurboQuant: A Symmetric Comparison of Methods, Theory, and Experimentscited by 3
- 2022A Lower Bound of Hash Codes' Performancecited by 2
50 most cited of 105 All 105 (JSON)
- 2026LeanStream: A Speculate-and-Refine Streaming Framework for Efficient on-Device LLM Inference2 Sep 2026
- 2026Pointing the Way, Hiding the Destination: Practical Private Dense Retrieval at Scale26 Aug 2026
- 2026Beyond Observed Auxiliary Relations: Environment-Conditioned Modeling for Multi-Behavior Recommendation24 Aug 2026
- 2026Random features for Grassmannian kernel approximation with bounded rank-one projections4 Aug 2026
- 2026Cluster with Auctions for Vector Search15 Jul 2026
- 2026Exact and Deterministic Patch Descriptor Retrieval via Hierarchical Normalization25 Jun 2026
- 2026Provable Quantization with Randomized Hadamard Transform13 May 2026
- 2026Positional LSH: Binary Block Matrix Approximation for Attention with Linear Biases10 May 2026
- 2026FAVOR: Efficient Filter-Agnostic Vector ANNS Based on Selectivity-Aware Exclusion Distances8 May 2026
- 2026New Bounds for Kernel Sums via Fast Spherical Embeddings2 May 2026
- 2026Revisiting RaBitQ and TurboQuant: A Symmetric Comparison of Methods, Theory, and Experiments21 Apr 2026
- 2026Using predefined vector systems to speed up neural network multimillion class classification1 Apr 2026
38 more
- 2026Approximate Nearest Neighbor Search for Modern AI: A Projection-Augmented Graph Approach1 Mar 2026
- 2026Rethinking ANN-based Retrieval: Multifaceted Learnable Index for Large-scale Recommendation System18 Feb 2026
- 2026GPU-Accelerated Algorithms for Graph Vector Search: Taxonomy, Empirical Study, and Research Directions10 Feb 2026
- 2026Scout Before You Attend: Sketch-and-Walk Sparse Attention for Efficient LLM Inference7 Feb 2026
- 2026JAF: Judge Agent Forest29 Jan 2026
- 2025Graph-based Nearest Neighbors with Dynamic Updates via Random Walks19 Dec 2025
- 2025Adaptive Prefiltering for High-Dimensional Similarity Search: A Frequency-Aware Approach3 Dec 2025
- 2025LAHNet: Local Attentive Hashing Network for Point Cloud Registration30 Nov 2025
- 2025B+ANN: A Fast Billion-Scale Disk-based Nearest-Neighbor Index19 Nov 2025
- 2025Contextual Tokenization for Graph Inverted Indices26 Oct 2025
- 2025Applying Graph Analysis for Unsupervised Fast Malware Fingerprinting7 Oct 2025
- 2025Fast attention mechanisms: a tale of parallelism10 Sep 2025
- 2025Spotlight Attention: Towards Efficient LLM Generation via Non-linear Hashing-based KV Cache Retrieval27 Aug 2025
- 2025PLASMA: A Layout-Aware Benchmark Reveals Memory Layout Matters for Graph-based ANNS on GPU21 Aug 2025
- 2025Scalable Varied-Density Clustering via Graph Propagation5 Aug 2025
- 2025Benchmarking Filtered Approximate Nearest Neighbor Search Algorithms on Transformer-based Embedding Vectors29 Jul 2025
- 2025Digital Twin-Assisted Explainable AI for Robust Beam Prediction in mmWave MIMO Systems12 Jul 2025
- 2025EraRAG: Efficient and Incremental Retrieval Augmented Generation for Growing Corpora26 Jun 2025
- 2025GARLIC: GAussian Representation LearnIng for spaCe partitioning30 May 2025
- 2025Probabilistic Kernel Function for Fast Angle Testing26 May 2025
- 2025Locality-Sensitive Hashing for Efficient Hard Negative Sampling in Contrastive Learning23 May 2025
- 2025Distance Adaptive Beam Search for Provably Accurate Graph-Based Nearest Neighbor Search21 May 2025
- 2025HONEYBEE: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning[Technical Report]2 May 2025
- 2025Cracking Vector Search Indexes3 Mar 2025
- 2025Explaining the Success of Nearest Neighbor Methods in Prediction21 Feb 2025
- 2025Explainable and Robust Millimeter Wave Beam Alignment for AI-Native 6G Networks23 Jan 2025
- 2024UpANNS: Enhancing Billion-Scale ANNS Efficiency with Real-World PIM Architecture31 Oct 2024
- 2024MagicPIG: LSH Sampling for Efficient LLM Generation21 Oct 2024
- 2024Scalable Cross-Entropy Loss for Sequential Recommendations with Large Item Catalogs27 Sep 2024
- 2024ELASTIC: Efficient Linear Attention for Sequential Interest Compression18 Aug 2024
- 2024RECE: Reduced Cross-Entropy Loss for Large-Catalogue Sequential Recommenders5 Aug 2024
- 2024Sketch-GNN: Scalable Graph Neural Networks with Sublinear Training Complexity21 Jun 2024
- 2024Spectral Toolkit of Algorithms for Graphs: Technical Report (2)6 Jun 2024
- 2024Navigable Graphs for High-Dimensional Nearest Neighbor Search: Constructions and Limits29 May 2024
- 2024IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs5 May 2024
- 2024LookupFFN: Making Transformers Compute-lite for CPU inference12 Mar 2024
- 2024Scalable Density-based Clustering with Random Projections24 Feb 2024
- 2024Xling: A Learned Filter Framework for Accelerating High-Dimensional Approximate Similarity Join20 Feb 2024
50 newest of 105 All 105 (JSON)
- 2025EraRAG: Efficient and Incremental Retrieval Augmented Generation for Growing Corporacited by 14
- 2025Cracking Vector Search Indexescited by 3
- 2025Benchmarking Filtered Approximate Nearest Neighbor Search Algorithms on Transformer-based Embedding Vectorscited by 2
- 2026Pointing the Way, Hiding the Destination: Practical Private Dense Retrieval at Scalecited by 1
- 2024UpANNS: Enhancing Billion-Scale ANNS Efficiency with Real-World PIM Architecturecited by 0
- 2025Graph-based Nearest Neighbors with Dynamic Updates via Random Walkscited by 0
- 2026FAVOR: Efficient Filter-Agnostic Vector ANNS Based on Selectivity-Aware Exclusion Distancescited by 0
- 2026Pointing the Way, Hiding the Destination: Practical Private Dense Retrieval at Scale26 Aug 2026
- 2026FAVOR: Efficient Filter-Agnostic Vector ANNS Based on Selectivity-Aware Exclusion Distances8 May 2026
- 2025Graph-based Nearest Neighbors with Dynamic Updates via Random Walks19 Dec 2025
- 2025Benchmarking Filtered Approximate Nearest Neighbor Search Algorithms on Transformer-based Embedding Vectors29 Jul 2025
- 2025EraRAG: Efficient and Incremental Retrieval Augmented Generation for Growing Corpora26 Jun 2025
- 2025Cracking Vector Search Indexes3 Mar 2025
- 2024UpANNS: Enhancing Billion-Scale ANNS Efficiency with Real-World PIM Architecture31 Oct 2024
- 2023Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memorycited by 64
- 2026JAF: Judge Agent Forestcited by 0
- 2026JAF: Judge Agent Forest29 Jan 2026
- 2023Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memory15 Nov 2023
- 2022A Theoretical View on Sparsely Activated Networkscited by 6
- 2022A Theoretical View on Sparsely Activated Networks8 Aug 2022
- 2023Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Timecited by 247
- 2021Scatterbrain: Unifying Sparse and Low-rank Attention Approximationcited by 128
- 2024MagicPIG: LSH Sampling for Efficient LLM Generationcited by 112
- 2021End-to-End Training of Neural Retrievers for Open-Domain Question Answeringcited by 75
- 2022Video Transformers: A Surveycited by 63
- 2021EDEN: Communication-Efficient and Robust Distributed Mean Estimation for Federated Learningcited by 53
- 2021End-to-End User Behavior Retrieval in Click-Through RatePrediction Modelcited by 45
- 2021Does Preprocessing Help Training Over-parameterized Neural Networks?cited by 32
- 2022Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessingcited by 29
- 2022Sampling Is All You Need on Modeling Long-Term User Behaviors for CTR Predictioncited by 24
- 2023ParlayANN: Scalable and Deterministic Parallel Graph-Based Approximate Nearest Neighbor Search Algorithmscited by 24
- 2023Faster Causal Attention Over Large Sequences Through Sparse Flash Attentioncited by 24
12 most cited of 92 All 92 (JSON)
- 2026LeanStream: A Speculate-and-Refine Streaming Framework for Efficient on-Device LLM Inference2 Sep 2026
- 2026Beyond Observed Auxiliary Relations: Environment-Conditioned Modeling for Multi-Behavior Recommendation24 Aug 2026
- 2026Random features for Grassmannian kernel approximation with bounded rank-one projections4 Aug 2026
- 2026Cluster with Auctions for Vector Search15 Jul 2026
- 2026Exact and Deterministic Patch Descriptor Retrieval via Hierarchical Normalization25 Jun 2026
- 2026Positional LSH: Binary Block Matrix Approximation for Attention with Linear Biases10 May 2026
- 2026New Bounds for Kernel Sums via Fast Spherical Embeddings2 May 2026
- 2026Revisiting RaBitQ and TurboQuant: A Symmetric Comparison of Methods, Theory, and Experiments21 Apr 2026
- 2026Using predefined vector systems to speed up neural network multimillion class classification1 Apr 2026
- 2026Approximate Nearest Neighbor Search for Modern AI: A Projection-Augmented Graph Approach1 Mar 2026
- 2026Rethinking ANN-based Retrieval: Multifaceted Learnable Index for Large-scale Recommendation System18 Feb 2026
- 2026GPU-Accelerated Algorithms for Graph Vector Search: Taxonomy, Empirical Study, and Research Directions10 Feb 2026
12 newest of 92 All 92 (JSON)