Fast John Ellipsoid Computation with Differential Privacy Optimization
Not on the map. Why?
Abstract (arXiv)
Determining the John ellipsoid - the largest volume ellipsoid contained within a convex polytope - is a fundamental problem with applications in machine learning, optimization, and data analytics. Recent work has developed fast algorithms for approximating the John ellipsoid using sketching and leverage score sampling techniques. However, these algorithms do not provide privacy guarantees for sensitive input data. In this paper, we present the first differentially private algorithm for fast John ellipsoid computation. Our method integrates noise perturbation with sketching and leverages score sampling to achieve both efficiency and privacy. We prove that (1) our algorithm provides (ε,δ)-differential privacy and the privacy guarantee holds for neighboring datasets that are ε0-close, allowing flexibility in the privacy definition; (2) our algorithm still converges to a (1+xi)-approximation of the optimal John ellipsoid in Theta(xi-2(log(n/δ0) + (Lε0)-2)) iterations where n is the number of data point, L is the Lipschitz constant, δ0 is the failure probability, and ε0 is the closeness of neighboring input datasets. Our theoretical analysis demonstrates the algorithm's convergence and privacy properties, providing a robust approach for balancing utility and privacy in John ellipsoid computation. This is the first differentially private algorithm for fast John ellipsoid computation, opening avenues for future research in privacy-preserving optimization techniques.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 71 of its 131 references that are in the map. First posted on arXiv 12 Aug 2024.
Builds on
71 of 131 references.
References · 71
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
- 2019Deep Leakage from Gradientscited by 1,021
- 2014Understanding Deep Image Representations by Inverting Themcited by 403
- 2018Split learning for health: Distributed deep learning without sharing raw patient datacited by 395
- 2021Evaluating Gradient Inversion Attacks and Defenses in Federated Learningcited by 196
- 2015Inverting Visual Representations with Convolutional Networkscited by 170
- 2018Solving Linear Programs in the Current Matrix Multiplication Timecited by 100
- 2020InstaHide: Instance-hiding Schemes for Private Distributed Learningcited by 90
- 2020A Refined Laser Method and Faster Matrix Multiplicationcited by 56
- 2019Solving Empirical Risk Minimization in the Current Matrix Multiplication Timecited by 53
- 2020A Faster Interior Point Method for Semidefinite Programmingcited by 53
- 2022Private Convex Optimization via Exponential Mechanismcited by 49
38 more
- 2022Robustness Implies Privacy in Statistical Estimationcited by 47
- 2017Relative Error Tensor Low Rank Approximationcited by 45
- 2020Faster Dynamic Matrix Inverse for Faster LPscited by 44
- 2019A Deterministic Linear Program Solver in Current Matrix Multiplication Timecited by 42
- 2018On Fast Leverage Score Sampling and Optimal Learningcited by 41
- 2019A New Analysis of Differential Privacy's Generalization Guaranteescited by 36
- 2022A Faster Small Treewidth SDP Solvercited by 36
- 2023New Bounds for Matrix Multiplication: from Alpha to Omegacited by 34
- 2020TextHide: Tackling Data Privacy in Language Understanding Taskscited by 33
- 2021Solving SDP Faster: A Robust IPM Framework and Efficient Implementationcited by 33
- 2021Fast Sketching of Polynomial Kernels of Polynomial Degreecited by 33
- 2023A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Timecited by 30
- 2017Sketching for Kronecker Product Regression and P-splinescited by 29
- 2020A Nearly-Linear Time Algorithm for Linear Programs with Small Treewidth: A Multiscale Representation of Robust Central Pathcited by 29
- 2022Faster Algorithm for Structured John Ellipsoid Computationcited by 28
- 2024Mind the Inconspicuous: Revealing the Hidden Weakness in Aligned LLMs' Refusal Boundariescited by 28
- 2024More Asymmetry Yields Faster Matrix Multiplicationcited by 27
- 2020Generalized Leverage Score Sampling for Neural Networkscited by 26
- 2021Tight and Robust Private Mean Estimation with Few Userscited by 26
- 2022Sketching for First Order Method: Efficient Algorithm for Low-Bandwidth Channel and Vulnerabilitycited by 25
- 2013Volumetric Spanners: an Efficient Exploration Basis for Learningcited by 24
- 2015Optimal Principal Component Analysis in Distributed and Streaming Modelscited by 24
- 2019A near-optimal algorithm for approximating the John Ellipsoidcited by 23
- 2018BourGAN: Generative Networks with Metric Embeddingscited by 22
- 2022Speeding Up Sparsification using Inner Product Search Data Structurescited by 22
- 2022Sketching Meets Differential Privacy: Fast Algorithm for Dynamic Kronecker Projection Maintenancecited by 22
- 2020Solving Tall Dense Linear Programs in Nearly Linear Timecited by 21
- 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
- 2017Fast MCMC sampling algorithms on polytopescited by 17
- 2021Dynamic Algorithms Against an Adaptive Adversary: Generic Constructions and Lower Boundscited by 17
- 2023Better and Simpler Lower Bounds for Differentially Private Statistical Estimationcited by 17
- 2020Fourier Sparse Leverage Scores and Approximate Kernel Learningcited by 16
- 2019Solving Linear Programs with Sqrt(rank) Linear System Solvescited by 15
- 2024Differential Privacy Mechanisms in Neural Tangent Kernel Regressioncited by 14
- 2024Provable Differentially Private Computation of the Cross-Attention Mechanismcited by 14
- 2017Improved Rectangular Matrix Multiplication using Powers of the Coppersmith-Winograd Tensorcited by 13
- 2022Private Convex Optimization in General Normscited by 13
- 2023Task-Agnostic Privacy-Preserving Representation Learning for Federated Learning Against Attribute Inference Attackscited by 13
50 most cited of 71 All 71 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 3; 2026: 1.
7 papers.
- 2024Circuit Complexity Bounds for RoPE-based Transformer Architecturecited by 26
- 2024Theoretical Constraints on the Expressive Power of mathsfRoPE-based Tensor Attention Transformerscited by 12
- 2025Theoretical Guarantees for High Order Trajectory Refinement in Generative Flowscited by 10
- 2025Neural Algorithmic Reasoning for Hypergraphs with Looped Transformerscited by 4
- 2024Inverting the Leverage Score Gradient: An Efficient Approximate Newton Methodcited by 3
- 2025Theoretical Foundation of Flow-Based Time Series Generation: Provable Approximation, Generalization, and Efficiencycited by 2
- 2026Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Modelcited by 0
- 2026Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Model18 Jun 2026
- 2025Theoretical Foundation of Flow-Based Time Series Generation: Provable Approximation, Generalization, and Efficiency18 Mar 2025
- 2025Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows12 Mar 2025
- 2025Neural Algorithmic Reasoning for Hypergraphs with Looped Transformers18 Jan 2025
- 2024Theoretical Constraints on the Expressive Power of mathsfRoPE-based Tensor Attention Transformers23 Dec 2024
- 2024Circuit Complexity Bounds for RoPE-based Transformer Architecture12 Nov 2024
- 2024Inverting the Leverage Score Gradient: An Efficient Approximate Newton Method21 Aug 2024