mlsanityData to 7 Oct 2026

Faster Dynamic Matrix Inverse for Faster LPs

arXiv 2004.07470 ↗First posted 16 Apr 2020cs.DScited by 44

Not on the map. Why?

Abstract (arXiv)

Motivated by recent Linear Programming solvers, we design dynamic data structures for maintaining the inverse of an n× n real matrix under textitlow-rank updates, with polynomially faster amortized running time. Our data structure is based on a recursive application of the Woodbury-Morrison identity for implementing textitcascading low-rank updates, combined with recent sketching technology. Our techniques and amortized analysis of multi-level partial updates, may be of broader interest to dynamic matrix problems. This data structure leads to the fastest known LP solver for general (dense) linear programs, improving the running time of the recent algorithms of (Cohen et al.'19, Lee et al.'19, Brand'20) from O^*(n^2+ maxfrac16, ω-2, frac1-α2) to O^*(n^2+maxfrac118, ω-2, frac1-α2), where ω and α are the fast matrix multiplication exponent and its dual. Hence, under the common belief that ω ≈ 2 and α ≈ 1, our LP solver runs in O^*(n2.055) time instead of O^*(n2.16).

Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 10; 2022: 6; 2023: 20; 2024: 4; 2025: 4.

44 papers.

Sort:

By area:

  1. 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Timecited by 62
  2. 2023Attention Scheme Inspired Softmax Regressioncited by 49
  3. 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
  4. 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
  5. 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
  6. 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformerscited by 35
  7. 2021Fast Sketching of Polynomial Kernels of Polynomial Degreecited by 33
  8. 2021Does Preprocessing Help Training Over-parameterized Neural Networks?cited by 32
  9. 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
  10. 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 29
  11. 2022Sketching for First Order Method: Efficient Algorithm for Low-Bandwidth Channel and Vulnerabilitycited by 25
  12. 2023Differentially Private Attention Computationcited by 25
32 more
  1. 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
  2. 2022Federated Adversarial Learning: A Framework with Convergence Analysiscited by 17
  3. 2022Dynamic Tensor Product Regressioncited by 17
  4. 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashingcited by 15
  5. 2023A General Algorithm for Solving Rank-one Matrix Sensingcited by 15
  6. 2022Adaptive and Dynamic Multi-Resolution Hashing for Pairwise Summationscited by 14
  7. 2022Scalable Decision-Focused Learning in Restless Multi-Armed Bandits with Application to Maternal and Child Healthcited by 12
  8. 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Accelerationcited by 11
  9. 2023Efficient SGD Neural Network Training via Sublinear Activated Neuron Identificationcited by 11
  10. 2023Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weightscited by 11
  11. 2023Federated Empirical Risk Minimization via Second-Order Methodcited by 9
  12. 2023Faster Robust Tensor Power Method for Arbitrary Ordercited by 8
  13. 2023Fast and Efficient Matching Algorithm with Deadline Instancescited by 7
  14. 2024Fast John Ellipsoid Computation with Differential Privacy Optimizationcited by 7
  15. 2021Efficient Algorithms for Finite Horizon and Streaming Restless Multi-Armed Bandit Problemscited by 6
  16. 2021COPS: Controlled Pruning Before Training Startscited by 6
  17. 2023Convergence of Two-Layer Regression with Nonlinear Unitscited by 6
  18. 2023Equitable Restless Multi-Armed Bandits: A General Framework Inspired By Digital Healthcited by 6
  19. 2021Near-Optimal Algorithms for Linear Algebra in the Current Matrix Multiplication Timecited by 4
  20. 2022A Faster k-means++ Algorithmcited by 4
  21. 2024Efficient Learning of Balanced Signed Graphs via Iterative Linear Programmingcited by 4
  22. 2023Interpolating Item and User Fairness in Multi-Sided Recommendationscited by 3
  23. 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?cited by 3
  24. 2021Fast Graph Neural Tangent Kernel via Kronecker Sketchingcited by 2
  25. 2025Quantum Algorithms for Bandits with Knapsacks with Improved Regret and Time Complexitiescited by 2
  26. 2021Abstract Interpretation of Fixpoint Iterators with Applications to Neural Networkscited by 1
  27. 2024Signal Processing in the Retina: Interpretable Graph Classifier to Predict Ganglion Cell Responsescited by 1
  28. 2025Accept More, Reject Less: Reducing up to 19% Unnecessary Desk-Rejections over 11 Years of ICLR Datacited by 1
  29. 2025Towards Sampling Data Structures for Tensor Products in Turnstile Streamscited by 1
  30. 2023Efficient Strongly Polynomial Algorithms for Quantile Regressioncited by 0
  31. 2023Online Adaptive Mahalanobis Distance Estimationcited by 0
  32. 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Trainingcited by 0