Finding Differentially Private Second Order Stationary Points in Stochastic Minimax Optimization
Not on the map. Why?
Abstract (arXiv)
We provide the first study of the problem of finding differentially private (DP) second-order stationary points (SOSP) in stochastic (non-convex) minimax optimization. Existing literature either focuses only on first-order stationary points for minimax problems or on SOSP for classical stochastic minimization problems. This work provides, for the first time, a unified and detailed treatment of both empirical and population risks. Specifically, we propose a purely first-order method that combines a nested gradient descent--ascent scheme with SPIDER-style variance reduction and Gaussian perturbations to ensure privacy. A key technical device is a block-wise (q-period) analysis that controls the accumulation of stochastic variance and privacy noise without summing over the full iteration horizon, yielding a unified treatment of both empirical-risk and population formulations. Under standard smoothness, Hessian-Lipschitzness, and strong concavity assumptions, we establish high-probability guarantees for reaching an (α,√ρ_Phi α)-approximate second-order stationary point with α = O( (frac√dnvarepsilon)2/3) for empirical risk objectives and O(frac1n1/3 + (frac√dnvarepsilon)1/2) for population objectives, matching the best known rates for private first-order stationarity.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 27 references that are in the map. First posted on arXiv 1 Feb 2026.
Builds on
19 of 27 references.
References · 19
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2018SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimatorcited by 283
- 2015Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decompositioncited by 241
- 2016Global Optimality of Local Search for Low Rank Matrix Recoverycited by 81
- 2020Stochastic Recursive Gradient Descent Ascent for Stochastic Nonconvex-Strongly-Concave Minimax Problemscited by 75
- 2018Weakly-Convex Concave Min-Max Optimization: Provable Algorithms and Applications in Machine Learningcited by 62
- 2018Multi-Agent Reinforcement Learning via Double Averaging Primal-Dual Optimizationcited by 40
- 2022Faster Rates of Convergence to Stationary Points in Differentially Private Optimizationcited by 32
- 2018Linear Convergence of the Primal-Dual Gradient Method for Convex-Concave Saddle Point Problems without Strong Convexitycited by 28
- 2022Differentially Private SGDA for Minimax Problemscited by 23
- 2022Bring Your Own Algorithm for Optimal Differentially Private Stochastic Minimax Optimizationcited by 22
- 2023Accelerating Inexact HyperGradient Descent for Bilevel Optimizationcited by 15
7 more
- 2021Finding Second-Order Stationary Points in Nonconvex-Strongly-Concave Minimax Optimizationcited by 12
- 2023Private (Stochastic) Non-Convex Optimization Revisited: Second-Order Stationary Points and Excess Riskscited by 12
- 2024Differentially Private Worst-group Risk Minimizationcited by 9
- 2022Differentially Private Temporal Difference Learning with Stochastic Nonconvex-Strongly-Concave Optimizationcited by 7
- 2025Improved Rates of Differentially Private Nonconvex-Strongly-Concave Minimax Optimizationcited by 5
- 2025Second-Order Convergence in Private Stochastic Non-Convex Optimizationcited by 3
- 2024Adaptive Batch Size for Privately Finding Second-Order Stationary Pointscited by 2
Built on by
Not cited yet.