On The Hardness of Approximate and Exact (Bichromatic) Maximum Inner Product
Not on the map. Why?
Abstract (arXiv)
In this paper we study the (Bichromatic) Maximum Inner Product Problem (Max-IP), in which we are given sets A and B of vectors, and the goal is to find a ∈ A and b ∈ B maximizing inner product a · b. Max-IP is very basic and serves as the base problem in the recent breakthrough of [Abboud et al., FOCS 2017] on hardness of approximation for polynomial-time problems. It is also used (implicitly) in the argument for hardness of exact ℓ2-Furthest Pair (and other important problems in computational geometry) in poly-log-log dimensions in [Williams, SODA 2018]. We have three main results regarding this problem. First, we study the best multiplicative approximation ratio for Boolean Max-IP in sub-quadratic time. We show that, for Max-IP with two sets of n vectors from 0,1d, there is an n2 - Omega(1) time left( d/log n right)Omega(1)-multiplicative-approximating algorithm, and we show this is conditionally optimal, as such a left(d/log nright)o(1)-approximating algorithm would refute SETH. Second, we achieve a similar characterization for the best additive approximation error to Boolean Max-IP. We show that, for Max-IP with two sets of n vectors from 0,1d, there is an n2 - Omega(1) time Omega(d)-additive-approximating algorithm, and this is conditionally optimal, as such an o(d)-approximating algorithm would refute SETH [Rubinstein, STOC 2018]. Last, we revisit the hardness of solving Max-IP exactly for vectors with integer entries. We show that, under SETH, for Max-IP with sets of n vectors from mathbbZd for some d = 2^O(log* n), every exact algorithm requires n2 - o(1) time. With the reduction from [Williams, SODA 2018], it follows that ℓ2-Furthest Pair and Bichromatic ℓ2-Closest Pair in 2^O(log* n) dimensions require n2 - o(1) time.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 1; 2023: 5; 2024: 2; 2025: 1.
12 papers.
- 2023Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Timecited by 252
- 2024Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Modelscited by 31
- 2022Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessingcited by 29
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
- 2023Beyond Classical Attention: Quantum Attention for Scalable Computationcited by 18
- 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashingcited by 15
- 2023Why Softmax Attention Outperforms Linear Attentioncited by 15
- 2024Fundamental Limitations on Subquadratic Alternatives to Transformerscited by 9
- 2023The complexity of non-stationary reinforcement learningcited by 7
- 2025Subquadratic Algorithms and Hardness for Attention with Any Temperaturecited by 5
- 2021On Complexity of 1-Center in Various Metricscited by 1
- 2023Can You Solve Closest String Faster than Exhaustive Search?cited by 0
- 2025Subquadratic Algorithms and Hardness for Attention with Any Temperature20 May 2025
- 2024Fundamental Limitations on Subquadratic Alternatives to Transformers5 Oct 2024
- 2024Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Models5 Jun 2024
- 2023Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time26 Oct 2023
- 2023Why Softmax Attention Outperforms Linear Attention18 Oct 2023
- 2023Beyond Classical Attention: Quantum Attention for Scalable Computation16 Jul 2023
- 2023The complexity of non-stationary reinforcement learning13 Jul 2023
- 2023Can You Solve Closest String Faster than Exhaustive Search?26 May 2023
- 2022Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessing25 Nov 2022
- 2021On Complexity of 1-Center in Various Metrics6 Dec 2021
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structures30 Nov 2021
- 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashing18 May 2021