A Nearly-Linear Time Algorithm for Linear Programs with Small Treewidth: A Multiscale Representation of Robust Central Path
Not on the map. Why?
Abstract (arXiv)
Arising from structural graph theory, treewidth has become a focus of study in fixed-parameter tractable algorithms in various communities including combinatorics, integer-linear programming, and numerical analysis. Many NP-hard problems are known to be solvable in widetildeO(n · 2O(tw)) time, where tw is the treewidth of the input graph. Analogously, many problems in P should be solvable in widetildeO(n · twO(1)) time; however, due to the lack of appropriate tools, only a few such results are currently known. [Fom+18] conjectured this to hold as broadly as all linear programs; in our paper, we show this is true: Given a linear program of the form minAx=b,ℓ ≤ x≤ u ctop x, and a width-τ tree decomposition of a graph GA related to A, we show how to solve it in time widetildeO(n · τ2 log (1/varepsilon)), where n is the number of variables and varepsilon is the relative accuracy. Combined with recent techniques in vertex-capacitated flow [BGS21], this leads to an algorithm with widetildeO(n1+o(1) · tw2 log (1/varepsilon)) run-time. Besides being the first of its kind, our algorithm has run-time nearly matching the fastest run-time for solving the sub-problem Ax=b (under the assumption that no fast matrix multiplication is used). We obtain these results by combining recent techniques in interior-point methods (IPMs), sketching, and a novel representation of the solution under a multiscale basis similar to the wavelet basis.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 16; 2024: 2; 2025: 2.
29 papers.
Sort:
By area:
- 2023Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Timecited by 247
- 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Timecited by 62
- 2023Attention Scheme Inspired Softmax Regressioncited by 49
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
- 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformerscited by 35
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 29
- 2023Differentially Private Attention Computationcited by 25
- 2023GradientCoin: A Peer-to-Peer Decentralized Large Language Modelscited by 23
- 2022Training Overparametrized Neural Networks in Sublinear Timecited by 22
17 more
- 2022A Sublinear Adversarial Training Algorithmcited by 22
- 2023Solving Attention Kernel Regression Problem via Pre-conditionercited by 20
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
- 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashingcited by 15
- 2021On the Power of Preconditioning in Sparse Linear Regressioncited by 15
- 2023A General Algorithm for Solving Rank-one Matrix Sensingcited by 15
- 2022Adaptive and Dynamic Multi-Resolution Hashing for Pairwise Summationscited by 14
- 2023Federated Empirical Risk Minimization via Second-Order Methodcited by 9
- 2023Efficient Alternating Minimization with Applications to Weighted Low Rank Approximationcited by 9
- 2023Faster Robust Tensor Power Method for Arbitrary Ordercited by 8
- 2023Fast and Efficient Matching Algorithm with Deadline Instancescited by 7
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimizationcited by 7
- 2021Fast Graph Neural Tangent Kernel via Kronecker Sketchingcited by 2
- 2022Decomposable Non-Smooth Convex Optimization with Nearly-Linear Gradient Oracle Complexitycited by 0
- 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Trainingcited by 0
- 2025On computing and the complexity of computing higher-order U-statistics, exactlycited by 0
- 2025Which Coauthor Should I Nominate in My 99 ICLR Submissions? A Mathematical Analysis of the ICLR 2026 Reciprocal Reviewer Nomination Policycited by 0
- 2025Which Coauthor Should I Nominate in My 99 ICLR Submissions? A Mathematical Analysis of the ICLR 2026 Reciprocal Reviewer Nomination Policy17 Dec 2025
- 2025On computing and the complexity of computing higher-order U-statistics, exactly18 Aug 2025
- 2024LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers17 Dec 2024
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimization12 Aug 2024
- 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training19 Nov 2023
- 2023Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time26 Oct 2023
- 2023Solving Attention Kernel Regression Problem via Pre-conditioner28 Aug 2023
- 2023GradientCoin: A Peer-to-Peer Decentralized Large Language Models21 Aug 2023
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding8 Jun 2023
- 2023Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation7 Jun 2023
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models4 Jun 2023
- 2023Faster Robust Tensor Power Method for Arbitrary Order1 Jun 2023
17 more
- 2023Federated Empirical Risk Minimization via Second-Order Method27 May 2023
- 2023Fast and Efficient Matching Algorithm with Deadline Instances15 May 2023
- 2023Differentially Private Attention Computation8 May 2023
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regression1 May 2023
- 2023Attention Scheme Inspired Softmax Regression20 Apr 2023
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimension10 Apr 2023
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problems28 Mar 2023
- 2023A General Algorithm for Solving Rank-one Matrix Sensing22 Mar 2023
- 2022Adaptive and Dynamic Multi-Resolution Hashing for Pairwise Summations21 Dec 2022
- 2022A Sublinear Adversarial Training Algorithm10 Aug 2022
- 2022Training Overparametrized Neural Networks in Sublinear Time9 Aug 2022
- 2022Decomposable Non-Smooth Convex Optimization with Nearly-Linear Gradient Oracle Complexity7 Aug 2022
- 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time14 Dec 2021
- 2021Fast Graph Neural Tangent Kernel via Kronecker Sketching4 Dec 2021
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structures30 Nov 2021
- 2021On the Power of Preconditioning in Sparse Linear Regression17 Jun 2021
- 2021Sublinear Least-Squares Value Iteration via Locality Sensitive Hashing18 May 2021
- 2023Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Timecited by 247
- 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Timecited by 62
- 2023Attention Scheme Inspired Softmax Regressioncited by 49
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 29
- 2023Differentially Private Attention Computationcited by 25
- 2023GradientCoin: A Peer-to-Peer Decentralized Large Language Modelscited by 23
- 2022Training Overparametrized Neural Networks in Sublinear Timecited by 22
- 2022A Sublinear Adversarial Training Algorithmcited by 22
12 most cited of 28 All 28 (JSON)
- 2025Which Coauthor Should I Nominate in My 99 ICLR Submissions? A Mathematical Analysis of the ICLR 2026 Reciprocal Reviewer Nomination Policy17 Dec 2025
- 2025On computing and the complexity of computing higher-order U-statistics, exactly18 Aug 2025
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimization12 Aug 2024
- 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training19 Nov 2023
- 2023Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time26 Oct 2023
- 2023Solving Attention Kernel Regression Problem via Pre-conditioner28 Aug 2023
- 2023GradientCoin: A Peer-to-Peer Decentralized Large Language Models21 Aug 2023
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding8 Jun 2023
- 2023Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation7 Jun 2023
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models4 Jun 2023
- 2023Faster Robust Tensor Power Method for Arbitrary Order1 Jun 2023
- 2023Federated Empirical Risk Minimization via Second-Order Method27 May 2023
12 newest of 28 All 28 (JSON)