Faster Dynamic Matrix Inverse for Faster LPs
Not on the map. Why?
Abstract (arXiv)
Motivated by recent Linear Programming solvers, we design dynamic data structures for maintaining the inverse of an n× n real matrix under textitlow-rank updates, with polynomially faster amortized running time. Our data structure is based on a recursive application of the Woodbury-Morrison identity for implementing textitcascading low-rank updates, combined with recent sketching technology. Our techniques and amortized analysis of multi-level partial updates, may be of broader interest to dynamic matrix problems. This data structure leads to the fastest known LP solver for general (dense) linear programs, improving the running time of the recent algorithms of (Cohen et al.'19, Lee et al.'19, Brand'20) from O^*(n^2+ maxfrac16, ω-2, frac1-α2) to O^*(n^2+maxfrac118, ω-2, frac1-α2), where ω and α are the fast matrix multiplication exponent and its dual. Hence, under the common belief that ω ≈ 2 and α ≈ 1, our LP solver runs in O^*(n2.055) time instead of O^*(n2.16).
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 6; 2023: 20; 2024: 4; 2025: 4.
44 papers.
Sort:
By area:
- 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Timecited by 62
- 2023Attention Scheme Inspired Softmax Regressioncited by 49
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
- 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformerscited by 35
- 2021Fast Sketching of Polynomial Kernels of Polynomial Degreecited by 33
- 2021Does Preprocessing Help Training Over-parameterized Neural Networks?cited by 32
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 29
- 2022Sketching for First Order Method: Efficient Algorithm for Low-Bandwidth Channel and Vulnerabilitycited by 25
- 2023Differentially Private Attention Computationcited by 25
32 more
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
- 2022Federated Adversarial Learning: A Framework with Convergence Analysiscited by 17
- 2022Dynamic Tensor Product Regressioncited by 17
- 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashingcited by 15
- 2023A General Algorithm for Solving Rank-one Matrix Sensingcited by 15
- 2022Adaptive and Dynamic Multi-Resolution Hashing for Pairwise Summationscited by 14
- 2022Scalable Decision-Focused Learning in Restless Multi-Armed Bandits with Application to Maternal and Child Healthcited by 12
- 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Accelerationcited by 11
- 2023Efficient SGD Neural Network Training via Sublinear Activated Neuron Identificationcited by 11
- 2023Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weightscited by 11
- 2023Federated Empirical Risk Minimization via Second-Order Methodcited by 9
- 2023Faster Robust Tensor Power Method for Arbitrary Ordercited by 8
- 2023Fast and Efficient Matching Algorithm with Deadline Instancescited by 7
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimizationcited by 7
- 2021Efficient Algorithms for Finite Horizon and Streaming Restless Multi-Armed Bandit Problemscited by 6
- 2021COPS: Controlled Pruning Before Training Startscited by 6
- 2023Convergence of Two-Layer Regression with Nonlinear Unitscited by 6
- 2023Equitable Restless Multi-Armed Bandits: A General Framework Inspired By Digital Healthcited by 6
- 2021Near-Optimal Algorithms for Linear Algebra in the Current Matrix Multiplication Timecited by 4
- 2022A Faster k-means++ Algorithmcited by 4
- 2024Efficient Learning of Balanced Signed Graphs via Iterative Linear Programmingcited by 4
- 2023Interpolating Item and User Fairness in Multi-Sided Recommendationscited by 3
- 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?cited by 3
- 2021Fast Graph Neural Tangent Kernel via Kronecker Sketchingcited by 2
- 2025Quantum Algorithms for Bandits with Knapsacks with Improved Regret and Time Complexitiescited by 2
- 2021Abstract Interpretation of Fixpoint Iterators with Applications to Neural Networkscited by 1
- 2024Signal Processing in the Retina: Interpretable Graph Classifier to Predict Ganglion Cell Responsescited by 1
- 2025Accept More, Reject Less: Reducing up to 19% Unnecessary Desk-Rejections over 11 Years of ICLR Datacited by 1
- 2025Towards Sampling Data Structures for Tensor Products in Turnstile Streamscited by 1
- 2023Efficient Strongly Polynomial Algorithms for Quantile Regressioncited by 0
- 2023Online Adaptive Mahalanobis Distance Estimationcited by 0
- 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Trainingcited by 0
- 2025Towards Sampling Data Structures for Tensor Products in Turnstile Streams4 Oct 2025
- 2025Quantum Algorithms for Bandits with Knapsacks with Improved Regret and Time Complexities6 Jul 2025
- 2025Accept More, Reject Less: Reducing up to 19% Unnecessary Desk-Rejections over 11 Years of ICLR Data25 Jun 2025
- 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?24 Feb 2025
- 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers17 Dec 2024
- 2024Efficient Learning of Balanced Signed Graphs via Iterative Linear Programming12 Sep 2024
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimization12 Aug 2024
- 2024Signal Processing in the Retina: Interpretable Graph Classifier to Predict Ganglion Cell Responses3 Jan 2024
- 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training19 Nov 2023
- 2023Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weights19 Oct 2023
- 2023Online Adaptive Mahalanobis Distance Estimation2 Sep 2023
- 2023Equitable Restless Multi-Armed Bandits: A General Framework Inspired By Digital Health17 Aug 2023
32 more
- 2023Convergence of Two-Layer Regression with Nonlinear Units16 Aug 2023
- 2023Efficient Strongly Polynomial Algorithms for Quantile Regression14 Jul 2023
- 2023Efficient SGD Neural Network Training via Sublinear Activated Neuron Identification13 Jul 2023
- 2023Interpolating Item and User Fairness in Multi-Sided Recommendations12 Jun 2023
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding8 Jun 2023
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models4 Jun 2023
- 2023Faster Robust Tensor Power Method for Arbitrary Order1 Jun 2023
- 2023Federated Empirical Risk Minimization via Second-Order Method27 May 2023
- 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Acceleration15 May 2023
- 2023Fast and Efficient Matching Algorithm with Deadline Instances15 May 2023
- 2023Differentially Private Attention Computation8 May 2023
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regression1 May 2023
- 2023Attention Scheme Inspired Softmax Regression20 Apr 2023
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimension10 Apr 2023
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problems28 Mar 2023
- 2023A General Algorithm for Solving Rank-one Matrix Sensing22 Mar 2023
- 2022Adaptive and Dynamic Multi-Resolution Hashing for Pairwise Summations21 Dec 2022
- 2022A Faster k-means++ Algorithm28 Nov 2022
- 2022Sketching for First Order Method: Efficient Algorithm for Low-Bandwidth Channel and Vulnerability15 Oct 2022
- 2022Dynamic Tensor Product Regression8 Oct 2022
- 2022Federated Adversarial Learning: A Framework with Convergence Analysis7 Aug 2022
- 2022Scalable Decision-Focused Learning in Restless Multi-Armed Bandits with Application to Maternal and Child Health2 Feb 2022
- 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time14 Dec 2021
- 2021Fast Graph Neural Tangent Kernel via Kronecker Sketching4 Dec 2021
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structures30 Nov 2021
- 2021Abstract Interpretation of Fixpoint Iterators with Applications to Neural Networks14 Oct 2021
- 2021Does Preprocessing Help Training Over-parameterized Neural Networks?9 Oct 2021
- 2021Fast Sketching of Polynomial Kernels of Polynomial Degree21 Aug 2021
- 2021COPS: Controlled Pruning Before Training Starts27 Jul 2021
- 2021Near-Optimal Algorithms for Linear Algebra in the Current Matrix Multiplication Time16 Jul 2021
- 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashing18 May 2021
- 2021Efficient Algorithms for Finite Horizon and Streaming Restless Multi-Armed Bandit Problems8 Mar 2021
- 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Timecited by 62
- 2023Attention Scheme Inspired Softmax Regressioncited by 49
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
- 2021Fast Sketching of Polynomial Kernels of Polynomial Degreecited by 33
- 2021Does Preprocessing Help Training Over-parameterized Neural Networks?cited by 32
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 29
- 2022Sketching for First Order Method: Efficient Algorithm for Low-Bandwidth Channel and Vulnerabilitycited by 25
- 2023Differentially Private Attention Computationcited by 25
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
12 most cited of 43 All 43 (JSON)
- 2025Towards Sampling Data Structures for Tensor Products in Turnstile Streams4 Oct 2025
- 2025Quantum Algorithms for Bandits with Knapsacks with Improved Regret and Time Complexities6 Jul 2025
- 2025Accept More, Reject Less: Reducing up to 19% Unnecessary Desk-Rejections over 11 Years of ICLR Data25 Jun 2025
- 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?24 Feb 2025
- 2024Efficient Learning of Balanced Signed Graphs via Iterative Linear Programming12 Sep 2024
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimization12 Aug 2024
- 2024Signal Processing in the Retina: Interpretable Graph Classifier to Predict Ganglion Cell Responses3 Jan 2024
- 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training19 Nov 2023
- 2023Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weights19 Oct 2023
- 2023Online Adaptive Mahalanobis Distance Estimation2 Sep 2023
- 2023Equitable Restless Multi-Armed Bandits: A General Framework Inspired By Digital Health17 Aug 2023
- 2023Convergence of Two-Layer Regression with Nonlinear Units16 Aug 2023
12 newest of 43 All 43 (JSON)