mlsanityData to 14 Oct 2026

Fast John Ellipsoid Computation with Differential Privacy Optimization

arXiv 2408.06395 ↗First posted 12 Aug 2024cs.DS cs.CR cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Determining the John ellipsoid - the largest volume ellipsoid contained within a convex polytope - is a fundamental problem with applications in machine learning, optimization, and data analytics. Recent work has developed fast algorithms for approximating the John ellipsoid using sketching and leverage score sampling techniques. However, these algorithms do not provide privacy guarantees for sensitive input data. In this paper, we present the first differentially private algorithm for fast John ellipsoid computation. Our method integrates noise perturbation with sketching and leverages score sampling to achieve both efficiency and privacy. We prove that (1) our algorithm provides (ε,δ)-differential privacy and the privacy guarantee holds for neighboring datasets that are ε0-close, allowing flexibility in the privacy definition; (2) our algorithm still converges to a (1+xi)-approximation of the optimal John ellipsoid in Theta(xi-2(log(n/δ0) + (Lε0)-2)) iterations where n is the number of data point, L is the Lipschitz constant, δ0 is the failure probability, and ε0 is the closeness of neighboring input datasets. Our theoretical analysis demonstrates the algorithm's convergence and privacy properties, providing a robust approach for balancing utility and privacy in John ellipsoid computation. This is the first differentially private algorithm for fast John ellipsoid computation, opening avenues for future research in privacy-preserving optimization techniques.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 71 of its 131 references that are in the map. First posted on arXiv 12 Aug 2024.

Builds on

71 of 131 references.

References · 71

  1. 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
  2. 2019Deep Leakage from Gradientscited by 1,021
  3. 2014Understanding Deep Image Representations by Inverting Themcited by 403
  4. 2018Split learning for health: Distributed deep learning without sharing raw patient datacited by 395
  5. 2021Evaluating Gradient Inversion Attacks and Defenses in Federated Learningcited by 196
  6. 2015Inverting Visual Representations with Convolutional Networkscited by 170
  7. 2018Solving Linear Programs in the Current Matrix Multiplication Timecited by 100
  8. 2020InstaHide: Instance-hiding Schemes for Private Distributed Learningcited by 90
  9. 2020A Refined Laser Method and Faster Matrix Multiplicationcited by 56
  10. 2019Solving Empirical Risk Minimization in the Current Matrix Multiplication Timecited by 53
  11. 2020A Faster Interior Point Method for Semidefinite Programmingcited by 53
  12. 2022Private Convex Optimization via Exponential Mechanismcited by 49
38 more
  1. 2022Robustness Implies Privacy in Statistical Estimationcited by 47
  2. 2017Relative Error Tensor Low Rank Approximationcited by 45
  3. 2020Faster Dynamic Matrix Inverse for Faster LPscited by 44
  4. 2019A Deterministic Linear Program Solver in Current Matrix Multiplication Timecited by 42
  5. 2018On Fast Leverage Score Sampling and Optimal Learningcited by 41
  6. 2019A New Analysis of Differential Privacy's Generalization Guaranteescited by 36
  7. 2022A Faster Small Treewidth SDP Solvercited by 36
  8. 2023New Bounds for Matrix Multiplication: from Alpha to Omegacited by 34
  9. 2020TextHide: Tackling Data Privacy in Language Understanding Taskscited by 33
  10. 2021Solving SDP Faster: A Robust IPM Framework and Efficient Implementationcited by 33
  11. 2021Fast Sketching of Polynomial Kernels of Polynomial Degreecited by 33
  12. 2023A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Timecited by 30
  13. 2017Sketching for Kronecker Product Regression and P-splinescited by 29
  14. 2020A Nearly-Linear Time Algorithm for Linear Programs with Small Treewidth: A Multiscale Representation of Robust Central Pathcited by 29
  15. 2022Faster Algorithm for Structured John Ellipsoid Computationcited by 28
  16. 2024Mind the Inconspicuous: Revealing the Hidden Weakness in Aligned LLMs' Refusal Boundariescited by 28
  17. 2024More Asymmetry Yields Faster Matrix Multiplicationcited by 27
  18. 2020Generalized Leverage Score Sampling for Neural Networkscited by 26
  19. 2021Tight and Robust Private Mean Estimation with Few Userscited by 26
  20. 2022Sketching for First Order Method: Efficient Algorithm for Low-Bandwidth Channel and Vulnerabilitycited by 25
  21. 2013Volumetric Spanners: an Efficient Exploration Basis for Learningcited by 24
  22. 2015Optimal Principal Component Analysis in Distributed and Streaming Modelscited by 24
  23. 2019A near-optimal algorithm for approximating the John Ellipsoidcited by 23
  24. 2018BourGAN: Generative Networks with Metric Embeddingscited by 22
  25. 2022Speeding Up Sparsification using Inner Product Search Data Structurescited by 22
  26. 2022Sketching Meets Differential Privacy: Fast Algorithm for Dynamic Kronecker Projection Maintenancecited by 22
  27. 2020Solving Tall Dense Linear Programs in Nearly Linear Timecited by 21
  28. 2021Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structurescited by 19
  29. 2017Fast MCMC sampling algorithms on polytopescited by 17
  30. 2021Dynamic Algorithms Against an Adaptive Adversary: Generic Constructions and Lower Boundscited by 17
  31. 2023Better and Simpler Lower Bounds for Differentially Private Statistical Estimationcited by 17
  32. 2020Fourier Sparse Leverage Scores and Approximate Kernel Learningcited by 16
  33. 2019Solving Linear Programs with Sqrt(rank) Linear System Solvescited by 15
  34. 2024Differential Privacy Mechanisms in Neural Tangent Kernel Regressioncited by 14
  35. 2024Provable Differentially Private Computation of the Cross-Attention Mechanismcited by 14
  36. 2017Improved Rectangular Matrix Multiplication using Powers of the Coppersmith-Winograd Tensorcited by 13
  37. 2022Private Convex Optimization in General Normscited by 13
  38. 2023Task-Agnostic Privacy-Preserving Representation Learning for Federated Learning Against Attribute Inference Attackscited by 13

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 3; 2026: 1.

7 papers.