A Deterministic Linear Program Solver in Current Matrix Multiplication Time
Not on the map. Why?
Abstract (arXiv)
Interior point algorithms for solving linear programs have been studied extensively for a long time [e.g. Karmarkar 1984; Lee, Sidford FOCS'14; Cohen, Lee, Song STOC'19]. For linear programs of the form minAx=b, x ≥ 0 c^top x with n variables and d constraints, the generic case d = Omega(n) has recently been settled by Cohen, Lee and Song [STOC'19]. Their algorithm can solve linear programs in tilde O(nω log(n/δ)) expected time, where δ is the relative accuracy. This is essentially optimal as all known linear system solvers require up to O(nω) time for solving Ax = b. However, for the case of deterministic solvers, the best upper bound is Vaidya's 30 years old O(n2.5 log(n/δ)) bound [FOCS'89]. In this paper we show that one can also settle the deterministic setting by derandomizing Cohen et al.'s tildeO(nω log(n/δ)) time algorithm. This allows for a strict tildeO(nω log(n/δ)) time bound, instead of an expected one, and a simplified analysis, reducing the length of their proof of their central path method by roughly half. Derandomizing this algorithm was also an open question asked in Song's PhD Thesis. The main tool to achieve our result is a new data-structure that can maintain the solution to a linear system in subquadratic time. More accurately we are able to maintain √UA^top(AUA^top)-1A√U:v in subquadratic time under ℓ2 multiplicative changes to the diagonal matrix U and the vector v. This type of change is common for interior point algorithms. Previous algorithms [e.g. Vaidya STOC'89; Lee, Sidford FOCS'15; Cohen, Lee, Song STOC'19] required Omega(n2) time for this task. [...]
Key facts. Cited by 42 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 4; 2023: 19; 2024: 5; 2025: 4; 2026: 1.
42 papers.
Sort:
By area:
- 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Timecited by 62
- 2023Attention Scheme Inspired Softmax Regressioncited by 49
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
- 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformerscited by 37
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 30
- 2023A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Timecited by 30
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
- 2021Graph Neural Network Reinforcement Learning for Autonomous Mobility-on-Demand Systemscited by 28
- 2023Differentially Private Attention Computationcited by 25
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
30 more
- 2024A Tighter Complexity Analysis of SparseGPTcited by 19
- 2021Online Double Oraclecited by 18
- 2021End-to-end Learning for Fair Ranking Systemscited by 18
- 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashingcited by 15
- 2023A General Algorithm for Solving Rank-one Matrix Sensingcited by 15
- 2023A Nearly-Optimal Bound for Fast Regression with ℓ_∞ Guaranteecited by 14
- 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Accelerationcited by 11
- 2023Federated Empirical Risk Minimization via Second-Order Methodcited by 9
- 2022Efficient Policy Space Response Oraclescited by 8
- 2022A simple approach for quantizing neural networkscited by 8
- 2023Solving Tensor Low Cycle Rank Approximationcited by 8
- 2024Truncated Variance Reduced Value Iterationcited by 8
- 2023Fast and Efficient Matching Algorithm with Deadline Instancescited by 7
- 2023PubDef: Defending Against Transfer Attacks From Public Modelscited by 7
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimizationcited by 7
- 2023Convergence of Two-Layer Regression with Nonlinear Unitscited by 6
- 2023Structured and Fast Optimization: The Kronecker SGD Algorithmcited by 5
- 2022Finding Bipartite Components in Hypergraphscited by 4
- 2023Projection-Free Online Convex Optimization via Efficient Newton Iterationscited by 4
- 2025The Structural Complexity of Matrix-Vector Multiplicationcited by 4
- 2021Offloading Algorithms for Maximizing Inference Accuracy on Edge Device Under a Time Constraintcited by 3
- 2022The Complexity of Dynamic Least-Squares Regressioncited by 3
- 2023A Whole New Ball Game: A Primal Accelerated Method for Matrix Games and Minimizing the Maximum of Smooth Functionscited by 3
- 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?cited by 3
- 2021Max-Linear Regression by Convex Programmingcited by 2
- 2021Neural Auto-Curriculacited by 2
- 2025Accept More, Reject Less: Reducing up to 19% Unnecessary Desk-Rejections over 11 Years of ICLR Datacited by 1
- 2024Combinatorial Approximations for Cluster Deletion: Simpler, Faster, and Bettercited by 0
- 2025Functional Encryption in Secure Neural Network Training: Data Leakage and Practical Mitigationscited by 0
- 2026Accelerated Relax-and-Round for Concave Coverage Problemscited by 0
- 2026Accelerated Relax-and-Round for Concave Coverage Problems7 May 2026
- 2025Functional Encryption in Secure Neural Network Training: Data Leakage and Practical Mitigations25 Sep 2025
- 2025Accept More, Reject Less: Reducing up to 19% Unnecessary Desk-Rejections over 11 Years of ICLR Data25 Jun 2025
- 2025The Structural Complexity of Matrix-Vector Multiplication28 Feb 2025
- 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?24 Feb 2025
- 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers17 Dec 2024
- 2024A Tighter Complexity Analysis of SparseGPT22 Aug 2024
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimization12 Aug 2024
- 2024Truncated Variance Reduced Value Iteration21 May 2024
- 2024Combinatorial Approximations for Cluster Deletion: Simpler, Faster, and Better24 Apr 2024
- 2023A Whole New Ball Game: A Primal Accelerated Method for Matrix Games and Minimizing the Maximum of Smooth Functions17 Nov 2023
- 2023PubDef: Defending Against Transfer Attacks From Public Models26 Oct 2023
30 more
- 2023A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time14 Sep 2023
- 2023Convergence of Two-Layer Regression with Nonlinear Units16 Aug 2023
- 2023Projection-Free Online Convex Optimization via Efficient Newton Iterations19 Jun 2023
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding8 Jun 2023
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models4 Jun 2023
- 2023Federated Empirical Risk Minimization via Second-Order Method27 May 2023
- 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Acceleration15 May 2023
- 2023Fast and Efficient Matching Algorithm with Deadline Instances15 May 2023
- 2023Structured and Fast Optimization: The Kronecker SGD Algorithm13 May 2023
- 2023Differentially Private Attention Computation8 May 2023
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regression1 May 2023
- 2023Attention Scheme Inspired Softmax Regression20 Apr 2023
- 2023Solving Tensor Low Cycle Rank Approximation13 Apr 2023
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimension10 Apr 2023
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problems28 Mar 2023
- 2023A General Algorithm for Solving Rank-one Matrix Sensing22 Mar 2023
- 2023A Nearly-Optimal Bound for Fast Regression with ℓ_∞ Guarantee1 Feb 2023
- 2022A simple approach for quantizing neural networks7 Sep 2022
- 2022Finding Bipartite Components in Hypergraphs5 May 2022
- 2022Efficient Policy Space Response Oracles28 Jan 2022
- 2022The Complexity of Dynamic Least-Squares Regression1 Jan 2022
- 2021Offloading Algorithms for Maximizing Inference Accuracy on Edge Device Under a Time Constraint21 Dec 2021
- 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time14 Dec 2021
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structures30 Nov 2021
- 2021End-to-end Learning for Fair Ranking Systems21 Nov 2021
- 2021Neural Auto-Curricula4 Jun 2021
- 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashing18 May 2021
- 2021Graph Neural Network Reinforcement Learning for Autonomous Mobility-on-Demand Systems23 Apr 2021
- 2021Online Double Oracle13 Mar 2021
- 2021Max-Linear Regression by Convex Programming12 Mar 2021
- 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Timecited by 62
- 2023Attention Scheme Inspired Softmax Regressioncited by 49
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 30
- 2023A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Timecited by 30
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
- 2021Graph Neural Network Reinforcement Learning for Autonomous Mobility-on-Demand Systemscited by 28
- 2023Differentially Private Attention Computationcited by 25
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
- 2024A Tighter Complexity Analysis of SparseGPTcited by 19
12 most cited of 41 All 41 (JSON)
- 2026Accelerated Relax-and-Round for Concave Coverage Problems7 May 2026
- 2025Functional Encryption in Secure Neural Network Training: Data Leakage and Practical Mitigations25 Sep 2025
- 2025Accept More, Reject Less: Reducing up to 19% Unnecessary Desk-Rejections over 11 Years of ICLR Data25 Jun 2025
- 2025The Structural Complexity of Matrix-Vector Multiplication28 Feb 2025
- 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?24 Feb 2025
- 2024A Tighter Complexity Analysis of SparseGPT22 Aug 2024
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimization12 Aug 2024
- 2024Truncated Variance Reduced Value Iteration21 May 2024
- 2024Combinatorial Approximations for Cluster Deletion: Simpler, Faster, and Better24 Apr 2024
- 2023A Whole New Ball Game: A Primal Accelerated Method for Matrix Games and Minimizing the Maximum of Smooth Functions17 Nov 2023
- 2023PubDef: Defending Against Transfer Attacks From Public Models26 Oct 2023
- 2023A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time14 Sep 2023
12 newest of 41 All 41 (JSON)