mlsanityData to 7 Oct 2026

Discrepancy Minimization in Input-Sparsity Time

arXiv 2210.12468 ↗First posted 22 Oct 2022cs.DScited by 22

Not on the map. Why?

Abstract (arXiv)

A recent work by [Larsen, SODA 2023] introduced a faster combinatorial alternative to Bansal's SDP algorithm for finding a coloring x ∈ -1, 1n that approximately minimizes the discrepancy disc(A, x) := | A x |∞ of a real-valued m × n matrix A. Larsen's algorithm runs in widetildeO(mn2) time compared to Bansal's widetildeO(mn4.5)-time algorithm, with a slightly weaker logarithmic approximation ratio in terms of the hereditary discrepancy of A [Bansal, FOCS 2010]. We present a combinatorial widetildeO(nnz(A) + n3)-time algorithm with the same approximation guarantee as Larsen's, optimal for tall matrices where m = poly(n). Using a more intricate analysis and fast matrix multiplication, we further achieve a runtime of widetildeO(nnz(A) + n2.53), breaking the cubic barrier for square matrices and surpassing the limitations of linear-programming approaches [Eldan and Singh, RS&A 2018]. Our algorithm relies on two key ideas: (i) a new sketching technique for finding a projection matrix with a short ℓ2-basis using implicit leverage-score sampling, and (ii) a data structure for efficiently implementing the iterative Edge-Walk partial-coloring algorithm [Lovett and Meka, SICOMP 2015], and using an alternative analysis to enable ''lazy'' batch updates with low-rank corrections. Our results nearly close the computational gap between real-valued and binary matrices, for which input-sparsity time coloring was recently obtained by [Jain, Sah and Sawhney, SODA 2023].

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Oct 2022.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2023: 18; 2024: 3; 2025: 1.

22 papers.

Sort:

  1. 2023Attention Scheme Inspired Softmax Regressioncited by 49
  2. 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
  3. 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
  4. 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
  5. 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
  6. 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 29
  7. 2023Solving Attention Kernel Regression Problem via Pre-conditionercited by 20
  8. 2024A Tighter Complexity Analysis of SparseGPTcited by 19
  9. 2023A Unified Scheme of ResNet and Softmaxcited by 12
  10. 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Accelerationcited by 11
  11. 2023Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weightscited by 11
  12. 2023Federated Empirical Risk Minimization via Second-Order Methodcited by 9
10 more
  1. 2023Local Convergence of Approximate Newton Method for Two Layer Nonlinear Regressioncited by 9
  2. 2023Solving Tensor Low Cycle Rank Approximationcited by 8
  3. 2023Fast and Efficient Matching Algorithm with Deadline Instancescited by 7
  4. 2023Convergence of Two-Layer Regression with Nonlinear Unitscited by 6
  5. 2023A Theoretical Insight into Attack and Defense of Gradient Leakage in Transformercited by 6
  6. 2023Structured and Fast Optimization: The Kronecker SGD Algorithmcited by 5
  7. 2023Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basiscited by 4
  8. 2024Inverting the Leverage Score Gradient: An Efficient Approximate Newton Methodcited by 3
  9. 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?cited by 3
  10. 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Modelscited by 1