A stochastic smoothing framework for nonconvex-nonconcave minEmax problems with applications to Wasserstein distributionally robust optimization
Not on the map. Why?
Abstract (arXiv)
We study a class of stochastic nonsmooth optimization problems in which an outer variable minimizes the expectation of a pointwise maximum. This minimization--expectation--maximization (minEmax) problem arises in Wasserstein distributionally robust optimization and adversarially robust training, and it cannot in general be reformulated as a finite-dimensional minimax problem when the underlying distribution is not empirical. We propose a stochastic smoothing proximal gradient method based on log-mean-exp smoothing of the value function. Under compactness and Lipschitz-type assumptions, we present nonasymptotic analysis in terms of Goldstein stationarity and show that every almost-sure cluster point generated by our method is a Clarke stationary point; by Clarke regularity, such a point is also directional stationary for the original problem. Numerical experiments on newsvendor, robust regression, and adversarially robust learning problems show that the proposed method is competitive with existing baselines.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 33 of its 89 references that are in the map. First posted on arXiv 24 Feb 2025.
Builds on
33 of 89 references.
References · 33
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2014Striving for Simplicity: The All Convolutional Netcited by 990
- 2015Data-driven Distributionally Robust Optimization Using the Wasserstein Metric: Performance Guarantees and Tractable Reformulationscited by 291
- 2019Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Sufficescited by 227
- 2016Distributionally Robust Stochastic Optimization with Wasserstein Distancecited by 185
- 2019Solving a Class of Non-Convex Min-Max Games Using Iterative First Order Methodscited by 148
- 2018Analysis of Langevin Monte Carlo via convex optimizationcited by 127
- 2015Distributionally Robust Logistic Regressioncited by 126
- 2017Regularization via Mass Transportationcited by 81
- 2019Efficient Algorithms for Smooth Minimax Optimizationcited by 76
21 more
- 2015Learning with a Strong Adversarycited by 68
- 2022Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlocited by 63
- 2020A Unified Single-loop Alternating Gradient Projection Algorithm for Nonconvex-Concave and Convex-Nonconcave Minimax Problemscited by 57
- 2022Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimizationcited by 43
- 2021Sinkhorn Distributionally Robust Optimizationcited by 38
- 2018First-order Convergence Theory for Weakly-Convex-Weakly-Concave Min-max Problemscited by 34
- 2018Optimal Transport Based Distributionally Robust Optimization: Structural Properties and Iterative Schemescited by 30
- 2020On Linear Optimization over Wasserstein Ballscited by 24
- 2023An Algorithm with Optimal Dimension-Dependence for Zero-Order Nonsmooth Nonconvex Stochastic Optimizationcited by 23
- 2024Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimizationcited by 16
- 2015Computing B-Stationary Points of Nonsmooth DC Programscited by 12
- 2017Semi-supervised Learning based on Distributionally Robust Optimizationcited by 12
- 2018Composite Difference-Max Programs for Modern Statistical Estimation Problemscited by 10
- 2025A single-loop SPIDER-type stochastic subgradient method for expectation-constrained nonconvex nonsmooth optimizationcited by 9
- 2020Random Coordinate Underdamped Langevin Monte Carlocited by 6
- 2023Optimization and Optimizers for Adversarial Robustnesscited by 6
- 2021Linearly-constrained nonsmooth optimization for training autoencoderscited by 5
- 2022Optimality conditions for nonsmooth nonconvex-nonconcave min-max problems and generative adversarial networkscited by 5
- 2022Wasserstein Logistic Regression with Mixed Featurescited by 5
- 2024textttskwdro: a library for Wasserstein distributionally robust machine learningcited by 4
- 2017Global Convergence of the (1+1) Evolution Strategycited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.