Discrepancy Minimization in Input-Sparsity Time
Not on the map. Why?
Abstract (arXiv)
A recent work by [Larsen, SODA 2023] introduced a faster combinatorial alternative to Bansal's SDP algorithm for finding a coloring x ∈ -1, 1n that approximately minimizes the discrepancy disc(A, x) := | A x |∞ of a real-valued m × n matrix A. Larsen's algorithm runs in widetildeO(mn2) time compared to Bansal's widetildeO(mn4.5)-time algorithm, with a slightly weaker logarithmic approximation ratio in terms of the hereditary discrepancy of A [Bansal, FOCS 2010]. We present a combinatorial widetildeO(nnz(A) + n3)-time algorithm with the same approximation guarantee as Larsen's, optimal for tall matrices where m = poly(n). Using a more intricate analysis and fast matrix multiplication, we further achieve a runtime of widetildeO(nnz(A) + n2.53), breaking the cubic barrier for square matrices and surpassing the limitations of linear-programming approaches [Eldan and Singh, RS&A 2018]. Our algorithm relies on two key ideas: (i) a new sketching technique for finding a projection matrix with a short ℓ2-basis using implicit leverage-score sampling, and (ii) a data structure for efficiently implementing the iterative Edge-Walk partial-coloring algorithm [Lovett and Meka, SICOMP 2015], and using an alternative analysis to enable ''lazy'' batch updates with low-rank corrections. Our results nearly close the computational gap between real-valued and binary matrices, for which input-sparsity time coloring was recently obtained by [Jain, Sah and Sawhney, SODA 2023].
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Oct 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 18; 2024: 3; 2025: 1.
22 papers.
Sort:
- 2023Attention Scheme Inspired Softmax Regressioncited by 49
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 29
- 2023Solving Attention Kernel Regression Problem via Pre-conditionercited by 20
- 2024A Tighter Complexity Analysis of SparseGPTcited by 19
- 2023A Unified Scheme of ResNet and Softmaxcited by 12
- 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Accelerationcited by 11
- 2023Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weightscited by 11
- 2023Federated Empirical Risk Minimization via Second-Order Methodcited by 9
10 more
- 2023Local Convergence of Approximate Newton Method for Two Layer Nonlinear Regressioncited by 9
- 2023Solving Tensor Low Cycle Rank Approximationcited by 8
- 2023Fast and Efficient Matching Algorithm with Deadline Instancescited by 7
- 2023Convergence of Two-Layer Regression with Nonlinear Unitscited by 6
- 2023A Theoretical Insight into Attack and Defense of Gradient Leakage in Transformercited by 6
- 2023Structured and Fast Optimization: The Kronecker SGD Algorithmcited by 5
- 2023Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basiscited by 4
- 2024Inverting the Leverage Score Gradient: An Efficient Approximate Newton Methodcited by 3
- 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?cited by 3
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Modelscited by 1
- 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?24 Feb 2025
- 2024A Tighter Complexity Analysis of SparseGPT22 Aug 2024
- 2024Inverting the Leverage Score Gradient: An Efficient Approximate Newton Method21 Aug 2024
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Models9 May 2024
- 2023Local Convergence of Approximate Newton Method for Two Layer Nonlinear Regression26 Nov 2023
- 2023A Theoretical Insight into Attack and Defense of Gradient Leakage in Transformer22 Nov 2023
- 2023Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weights19 Oct 2023
- 2023A Unified Scheme of ResNet and Softmax23 Sep 2023
- 2023Solving Attention Kernel Regression Problem via Pre-conditioner28 Aug 2023
- 2023Convergence of Two-Layer Regression with Nonlinear Units16 Aug 2023
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding8 Jun 2023
- 2023Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basis6 Jun 2023
10 more
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models4 Jun 2023
- 2023Federated Empirical Risk Minimization via Second-Order Method27 May 2023
- 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Acceleration15 May 2023
- 2023Fast and Efficient Matching Algorithm with Deadline Instances15 May 2023
- 2023Structured and Fast Optimization: The Kronecker SGD Algorithm13 May 2023
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regression1 May 2023
- 2023Attention Scheme Inspired Softmax Regression20 Apr 2023
- 2023Solving Tensor Low Cycle Rank Approximation13 Apr 2023
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimension10 Apr 2023
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problems28 Mar 2023
- 2023Attention Scheme Inspired Softmax Regressioncited by 49
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 29
- 2023Solving Attention Kernel Regression Problem via Pre-conditionercited by 20
- 2024A Tighter Complexity Analysis of SparseGPTcited by 19
- 2023A Unified Scheme of ResNet and Softmaxcited by 12
- 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Accelerationcited by 11
- 2023Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weightscited by 11
- 2023Federated Empirical Risk Minimization via Second-Order Methodcited by 9
12 most cited of 22 All 22 (JSON)
- 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?24 Feb 2025
- 2024A Tighter Complexity Analysis of SparseGPT22 Aug 2024
- 2024Inverting the Leverage Score Gradient: An Efficient Approximate Newton Method21 Aug 2024
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Models9 May 2024
- 2023Local Convergence of Approximate Newton Method for Two Layer Nonlinear Regression26 Nov 2023
- 2023A Theoretical Insight into Attack and Defense of Gradient Leakage in Transformer22 Nov 2023
- 2023Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weights19 Oct 2023
- 2023A Unified Scheme of ResNet and Softmax23 Sep 2023
- 2023Solving Attention Kernel Regression Problem via Pre-conditioner28 Aug 2023
- 2023Convergence of Two-Layer Regression with Nonlinear Units16 Aug 2023
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding8 Jun 2023
- 2023Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basis6 Jun 2023
12 newest of 22 All 22 (JSON)