mlsanityData to 7 Oct 2026

A Nearly-Linear Time Algorithm for Linear Programs with Small Treewidth: A Multiscale Representation of Robust Central Path

arXiv 2011.05365 ↗First posted 10 Nov 2020cs.DS math.OCcited by 29

Not on the map. Why?

Abstract (arXiv)

Arising from structural graph theory, treewidth has become a focus of study in fixed-parameter tractable algorithms in various communities including combinatorics, integer-linear programming, and numerical analysis. Many NP-hard problems are known to be solvable in widetildeO(n · 2O(tw)) time, where tw is the treewidth of the input graph. Analogously, many problems in P should be solvable in widetildeO(n · twO(1)) time; however, due to the lack of appropriate tools, only a few such results are currently known. [Fom+18] conjectured this to hold as broadly as all linear programs; in our paper, we show this is true: Given a linear program of the form minAx=b,ℓ ≤ x≤ u ctop x, and a width-τ tree decomposition of a graph GA related to A, we show how to solve it in time widetildeO(n · τ2 log (1/varepsilon)), where n is the number of variables and varepsilon is the relative accuracy. Combined with recent techniques in vertex-capacitated flow [BGS21], this leads to an algorithm with widetildeO(n1+o(1) · tw2 log (1/varepsilon)) run-time. Besides being the first of its kind, our algorithm has run-time nearly matching the fastest run-time for solving the sub-problem Ax=b (under the assumption that no fast matrix multiplication is used). We obtain these results by combining recent techniques in interior-point methods (IPMs), sketching, and a novel representation of the solution under a multiscale basis similar to the wavelet basis.

Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Nov 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 5; 2022: 4; 2023: 16; 2024: 2; 2025: 2.

29 papers.

Sort:

By area:

  1. 2023Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Timecited by 247
  2. 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Timecited by 62
  3. 2023Attention Scheme Inspired Softmax Regressioncited by 49
  4. 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
  5. 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
  6. 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
  7. 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformerscited by 35
  8. 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
  9. 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 29
  10. 2023Differentially Private Attention Computationcited by 25
  11. 2023GradientCoin: A Peer-to-Peer Decentralized Large Language Modelscited by 23
  12. 2022Training Overparametrized Neural Networks in Sublinear Timecited by 22
17 more
  1. 2022A Sublinear Adversarial Training Algorithmcited by 22
  2. 2023Solving Attention Kernel Regression Problem via Pre-conditionercited by 20
  3. 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
  4. 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashingcited by 15
  5. 2021On the Power of Preconditioning in Sparse Linear Regressioncited by 15
  6. 2023A General Algorithm for Solving Rank-one Matrix Sensingcited by 15
  7. 2022Adaptive and Dynamic Multi-Resolution Hashing for Pairwise Summationscited by 14
  8. 2023Federated Empirical Risk Minimization via Second-Order Methodcited by 9
  9. 2023Efficient Alternating Minimization with Applications to Weighted Low Rank Approximationcited by 9
  10. 2023Faster Robust Tensor Power Method for Arbitrary Ordercited by 8
  11. 2023Fast and Efficient Matching Algorithm with Deadline Instancescited by 7
  12. 2024Fast John Ellipsoid Computation with Differential Privacy Optimizationcited by 7
  13. 2021Fast Graph Neural Tangent Kernel via Kronecker Sketchingcited by 2
  14. 2022Decomposable Non-Smooth Convex Optimization with Nearly-Linear Gradient Oracle Complexitycited by 0
  15. 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Trainingcited by 0
  16. 2025On computing and the complexity of computing higher-order U-statistics, exactlycited by 0
  17. 2025Which Coauthor Should I Nominate in My 99 ICLR Submissions? A Mathematical Analysis of the ICLR 2026 Reciprocal Reviewer Nomination Policycited by 0