Faster Algorithm for Structured John Ellipsoid Computation
Not on the map. Why?
Abstract (arXiv)
The famous theorem of Fritz John states that any convex body has a unique maximal volume inscribed ellipsoid, known as the John Ellipsoid. Computing the John Ellipsoid is a fundamental problem in convex optimization. In this paper, we focus on approximating the John Ellipsoid inscribed in a convex and centrally symmetric polytope defined by P := x ∈ ℝd : -1n ≤ A x ≤ 1n , where A ∈ ℝn × d is a rank-d matrix and 1n ∈ ℝn is the all-ones vector. We develop two efficient algorithms for approximating the John Ellipsoid. The first is a sketching-based algorithm that runs in nearly input-sparsity time widetildeO(nnz(A) + dω) , where nnz(A) denotes the number of nonzero entries in the matrix A and ω ≈ 2.37 is the current matrix multiplication exponent. The second is a treewidth-based algorithm that runs in time widetildeO(n τ2), where τ is the treewidth of the dual graph of the matrix A. Our algorithms significantly improve upon the state-of-the-art running time of widetildeO(n d2) achieved by [Cohen, Cousins, Lee, and Yang, COLT 2019].
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Nov 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 21; 2024: 3; 2025: 1; 2026: 2.
28 papers.
Sort:
- 2023Attention Scheme Inspired Softmax Regressioncited by 49
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 30
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
- 2023GradientCoin: A Peer-to-Peer Decentralized Large Language Modelscited by 23
- 2023Solving Attention Kernel Regression Problem via Pre-conditionercited by 20
- 2023A Unified Scheme of ResNet and Softmaxcited by 12
- 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Accelerationcited by 11
- 2023Efficient SGD Neural Network Training via Sublinear Activated Neuron Identificationcited by 11
- 2023Efficient Alternating Minimization with Applications to Weighted Low Rank Approximationcited by 9
16 more
- 2023Local Convergence of Approximate Newton Method for Two Layer Nonlinear Regressioncited by 9
- 2023Solving Tensor Low Cycle Rank Approximationcited by 8
- 2023Is Solving Graph Neural Tangent Kernel Equivalent to Training Graph Neural Network?cited by 8
- 2023Fast and Efficient Matching Algorithm with Deadline Instancescited by 7
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimizationcited by 7
- 2023Convergence of Two-Layer Regression with Nonlinear Unitscited by 6
- 2023A Theoretical Insight into Attack and Defense of Gradient Leakage in Transformercited by 6
- 2023Structured and Fast Optimization: The Kronecker SGD Algorithmcited by 5
- 2022A Faster k-means++ Algorithmcited by 4
- 2024Inverting the Leverage Score Gradient: An Efficient Approximate Newton Methodcited by 3
- 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?cited by 3
- 2026Swap Regret Minimization Through Response-Based Approachabilitycited by 2
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Modelscited by 1
- 2023Online Adaptive Mahalanobis Distance Estimationcited by 0
- 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Trainingcited by 0
- 2026Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Modelcited by 0
- 2026Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Model18 Jun 2026
- 2026Swap Regret Minimization Through Response-Based Approachability5 Feb 2026
- 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?24 Feb 2025
- 2024Inverting the Leverage Score Gradient: An Efficient Approximate Newton Method21 Aug 2024
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimization12 Aug 2024
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Models9 May 2024
- 2023Local Convergence of Approximate Newton Method for Two Layer Nonlinear Regression26 Nov 2023
- 2023A Theoretical Insight into Attack and Defense of Gradient Leakage in Transformer22 Nov 2023
- 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training19 Nov 2023
- 2023A Unified Scheme of ResNet and Softmax23 Sep 2023
- 2023Is Solving Graph Neural Tangent Kernel Equivalent to Training Graph Neural Network?14 Sep 2023
- 2023Online Adaptive Mahalanobis Distance Estimation2 Sep 2023
16 more
- 2023Solving Attention Kernel Regression Problem via Pre-conditioner28 Aug 2023
- 2023GradientCoin: A Peer-to-Peer Decentralized Large Language Models21 Aug 2023
- 2023Convergence of Two-Layer Regression with Nonlinear Units16 Aug 2023
- 2023Efficient SGD Neural Network Training via Sublinear Activated Neuron Identification13 Jul 2023
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding8 Jun 2023
- 2023Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation7 Jun 2023
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models4 Jun 2023
- 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Acceleration15 May 2023
- 2023Fast and Efficient Matching Algorithm with Deadline Instances15 May 2023
- 2023Structured and Fast Optimization: The Kronecker SGD Algorithm13 May 2023
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regression1 May 2023
- 2023Attention Scheme Inspired Softmax Regression20 Apr 2023
- 2023Solving Tensor Low Cycle Rank Approximation13 Apr 2023
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimension10 Apr 2023
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problems28 Mar 2023
- 2022A Faster k-means++ Algorithm28 Nov 2022
- 2023Attention Scheme Inspired Softmax Regressioncited by 49
- 2023Solving Regularized Exp, Cosh and Sinh Regression Problemscited by 44
- 2023Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimensioncited by 37
- 2023An Iterative Algorithm for Rescaled Hyperbolic Functions Regressioncited by 35
- 2023InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understandingcited by 30
- 2023A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Modelscited by 29
- 2023GradientCoin: A Peer-to-Peer Decentralized Large Language Modelscited by 23
- 2023Solving Attention Kernel Regression Problem via Pre-conditionercited by 20
- 2023A Unified Scheme of ResNet and Softmaxcited by 12
- 2023Toward Highly Efficient and Private Submodular Maximization via Matrix-Based Accelerationcited by 11
- 2023Efficient SGD Neural Network Training via Sublinear Activated Neuron Identificationcited by 11
- 2023Efficient Alternating Minimization with Applications to Weighted Low Rank Approximationcited by 9
12 most cited of 28 All 28 (JSON)
- 2026Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Model18 Jun 2026
- 2026Swap Regret Minimization Through Response-Based Approachability5 Feb 2026
- 2025When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?24 Feb 2025
- 2024Inverting the Leverage Score Gradient: An Efficient Approximate Newton Method21 Aug 2024
- 2024Fast John Ellipsoid Computation with Differential Privacy Optimization12 Aug 2024
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Models9 May 2024
- 2023Local Convergence of Approximate Newton Method for Two Layer Nonlinear Regression26 Nov 2023
- 2023A Theoretical Insight into Attack and Defense of Gradient Leakage in Transformer22 Nov 2023
- 2023Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training19 Nov 2023
- 2023A Unified Scheme of ResNet and Softmax23 Sep 2023
- 2023Is Solving Graph Neural Tangent Kernel Equivalent to Training Graph Neural Network?14 Sep 2023
- 2023Online Adaptive Mahalanobis Distance Estimation2 Sep 2023
12 newest of 28 All 28 (JSON)