mlsanityData to 14 Oct 2026

A Deterministic Linear Program Solver in Current Matrix Multiplication Time

arXiv 1910.11957 ↗First posted 25 Oct 2019cs.DScited by 42

Not on the map. Why?

Abstract (arXiv)

Interior point algorithms for solving linear programs have been studied extensively for a long time [e.g. Karmarkar 1984; Lee, Sidford FOCS'14; Cohen, Lee, Song STOC'19]. For linear programs of the form minAx=b, x ≥ 0 c^top x with n variables and d constraints, the generic case d = Omega(n) has recently been settled by Cohen, Lee and Song [STOC'19]. Their algorithm can solve linear programs in tilde O(nω log(n/δ)) expected time, where δ is the relative accuracy. This is essentially optimal as all known linear system solvers require up to O(nω) time for solving Ax = b. However, for the case of deterministic solvers, the best upper bound is Vaidya's 30 years old O(n2.5 log(n/δ)) bound [FOCS'89]. In this paper we show that one can also settle the deterministic setting by derandomizing Cohen et al.'s tildeO(nω log(n/δ)) time algorithm. This allows for a strict tildeO(nω log(n/δ)) time bound, instead of an expected one, and a simplified analysis, reducing the length of their proof of their central path method by roughly half. Derandomizing this algorithm was also an open question asked in Song's PhD Thesis. The main tool to achieve our result is a new data-structure that can maintain the solution to a linear system in subquadratic time. More accurately we are able to maintain √UA^top(AUA^top)-1A√U:v in subquadratic time under ℓ2 multiplicative changes to the diagonal matrix U and the vector v. This type of change is common for interior point algorithms. Previous algorithms [e.g. Vaidya STOC'89; Lee, Sidford FOCS'15; Cohen, Lee, Song STOC'19] required Omega(n2) time for this task. [...]

Key facts. Cited by 42 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Oct 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 9; 2022: 4; 2023: 19; 2024: 5; 2025: 4; 2026: 1.

42 papers.

Sort:

By area:

  1. 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Timecited by 62
  2. 2023Attention Scheme Inspired Softmax Regressioncited by 49
  3. 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
  4. 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
  5. 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformerscited by 37
  6. 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
  7. 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 30
  8. 2023A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Timecited by 30
  9. 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
  10. 2021Graph Neural Network Reinforcement Learning for Autonomous Mobility-on-Demand Systemscited by 28
  11. 2023Differentially Private Attention Computationcited by 25
  12. 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
30 more
  1. 2024A Tighter Complexity Analysis of SparseGPTcited by 19
  2. 2021Online Double Oraclecited by 18
  3. 2021End-to-end Learning for Fair Ranking Systemscited by 18
  4. 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashingcited by 15
  5. 2023A General Algorithm for Solving Rank-one Matrix Sensingcited by 15
  6. 2023A Nearly-Optimal Bound for Fast Regression with ℓ_∞ Guaranteecited by 14
  7. 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Accelerationcited by 11
  8. 2023Federated Empirical Risk Minimization via Second-Order Methodcited by 9
  9. 2022Efficient Policy Space Response Oraclescited by 8
  10. 2022A simple approach for quantizing neural networkscited by 8
  11. 2023Solving Tensor Low Cycle Rank Approximationcited by 8
  12. 2024Truncated Variance Reduced Value Iterationcited by 8
  13. 2023Fast and Efficient Matching Algorithm with Deadline Instancescited by 7
  14. 2023PubDef: Defending Against Transfer Attacks From Public Modelscited by 7
  15. 2024Fast John Ellipsoid Computation with Differential Privacy Optimizationcited by 7
  16. 2023Convergence of Two-Layer Regression with Nonlinear Unitscited by 6
  17. 2023Structured and Fast Optimization: The Kronecker SGD Algorithmcited by 5
  18. 2022Finding Bipartite Components in Hypergraphscited by 4
  19. 2023Projection-Free Online Convex Optimization via Efficient Newton Iterationscited by 4
  20. 2025The Structural Complexity of Matrix-Vector Multiplicationcited by 4
  21. 2021Offloading Algorithms for Maximizing Inference Accuracy on Edge Device Under a Time Constraintcited by 3
  22. 2022The Complexity of Dynamic Least-Squares Regressioncited by 3
  23. 2023A Whole New Ball Game: A Primal Accelerated Method for Matrix Games and Minimizing the Maximum of Smooth Functionscited by 3
  24. 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?cited by 3
  25. 2021Max-Linear Regression by Convex Programmingcited by 2
  26. 2021Neural Auto-Curriculacited by 2
  27. 2025Accept More, Reject Less: Reducing up to 19% Unnecessary Desk-Rejections over 11 Years of ICLR Datacited by 1
  28. 2024Combinatorial Approximations for Cluster Deletion: Simpler, Faster, and Bettercited by 0
  29. 2025Functional Encryption in Secure Neural Network Training: Data Leakage and Practical Mitigationscited by 0
  30. 2026Accelerated Relax-and-Round for Concave Coverage Problemscited by 0