mlsanityData to 7 Oct 2026

Worst-case generation via minimax optimization in Wasserstein space

arXiv 2512.08176 ↗First posted 9 Dec 2025stat.ML cs.LG math.OCcited by 7

Not on the map. Why?

Abstract (arXiv)

Worst-case generation plays a critical role in evaluating robustness and stress-testing systems under distribution shifts, in applications ranging from machine learning models to power grids and medical prediction systems. We develop a generative modeling framework for worst-case generation for a pre-specified risk, based on min-max optimization over continuous probability distributions, namely the Wasserstein space. Unlike traditional discrete distributionally robust optimization approaches, which often suffer from scalability issues, limited generalization, and costly worst-case inference, our framework exploits the Brenier theorem to characterize the least favorable (worst-case) distribution as the pushforward of a transport map from a continuous reference measure, enabling a continuous and expressive notion of risk-induced generation beyond classical discrete DRO formulations. Based on the min-max formulation, we propose a Gradient Descent Ascent (GDA)-type scheme that updates the decision model and the transport map in a single loop, establishing global convergence guarantees under mild regularity assumptions and possibly without convexity-concavity. We also propose to parameterize the transport map using a neural network that can be trained simultaneously with the GDA iterations by matching the transported training samples, thereby achieving a simulation-free approach. The efficiency of the proposed method as a risk-induced worst-case generator is validated by numerical experiments on synthetic and image data.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 52 of its 82 references that are in the map. First posted on arXiv 9 Dec 2025.

Builds on

52 of 82 references.

References · 52

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  5. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  6. 2023Consistency Modelscited by 1,778
  7. 2016Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Lojasiewicz Conditioncited by 526
  8. 2017Certifying Some Distributional Robustness with Principled Adversarial Trainingcited by 333
  9. 2015Data-driven Distributionally Robust Optimization Using the Wasserstein Metric: Performance Guarantees and Tractable Reformulationscited by 285
  10. 2019On Gradient Descent Ascent for Nonconvex-Concave Minimax Problemscited by 266
  11. 2017Training GANs with Optimismcited by 217
  12. 2016Distributionally Robust Stochastic Optimization with Wasserstein Distancecited by 182
38 more
  1. 2017Stein Variational Gradient Descent as Gradient Flowcited by 149
  2. 2019Solving a Class of Non-Convex Min-Max Games Using Iterative First Order Methodscited by 148
  3. 2018Constructing Unrestricted Adversarial Examples with Generative Modelscited by 135
  4. 2018Optimistic mirror descent in saddle-point problems: Going the extra (gradient) milecited by 132
  5. 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
  6. 2017Lower Bounds for Finding Stationary Points Icited by 125
  7. 2018Sampling as optimization in the space of measures: The Langevin dynamics as a composite optimization problemcited by 123
  8. 2020Efficient Methods for Structured Nonconvex-Nonconcave Min-Max Optimizationcited by 94
  9. 2020Adversarial Distributional Training for Robust Deep Learningcited by 79
  10. 2019Distributionally Robust Optimization: A Reviewcited by 75
  11. 2023Diffusion-Based Adversarial Sample Generation for Improved Stealthiness and Controllabilitycited by 66
  12. 2019Reducing Noise in GAN Training with Variance Reduced Extragradientcited by 61
  13. 2020A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problemscited by 57
  14. 2020A Unified Single-loop Alternating Gradient Projection Algorithm for Nonconvex-Concave and Convex-Nonconcave Minimax Problemscited by 56
  15. 2019Hybrid Block Successive Approximation for One-Sided Non-Convex Min-Max Problems: Algorithms and Applicationscited by 55
  16. 2022Convex Analysis of the Mean Field Langevin Dynamicscited by 53
  17. 2021Faster Single-loop Algorithms for Minimax Optimization without Strong Concavitycited by 47
  18. 2021The Complexity of Nonconvex-Strongly-Concave Minimax Optimizationcited by 44
  19. 2021Complexity Lower Bounds for Nonconvex-Strongly-Concave Min-Max Optimizationcited by 34
  20. 2023Convergence of flow-based generative models via proximal gradient descent in Wasserstein spacecited by 34
  21. 2018Optimal Transport Based Distributionally Robust Optimization: Structural Properties and Iterative Schemescited by 30
  22. 2021Modeling the Second Player in Distributionally Robust Optimizationcited by 29
  23. 2019On Lower Iteration Complexity Bounds for the Saddle Point Problemscited by 28
  24. 2020A mean-field analysis of two-player zero-sum gamescited by 28
  25. 2022Solving Nonconvex-Nonconcave Min-Max Problems exhibiting Weak Minty Solutionscited by 27
  26. 2020On Linear Optimization over Wasserstein Ballscited by 23
  27. 2020Information Newton's flow: second-order optimization method in probability spacecited by 22
  28. 2023Escaping limit cycles: Global convergence for constrained nonconvex-nonconcave minimax problemscited by 21
  29. 2022Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone Inclusioncited by 19
  30. 2013Likelihood Robust Optimization for Data-driven Problemscited by 13
  31. 2023Flow-based Distributionally Robust Optimizationcited by 13
  32. 2022Nonsmooth Nonconvex-Nonconcave Minimax Optimization: Primal-Dual Balancing and Iteration Complexity Analysiscited by 12
  33. 2022Universal Gradient Descent Ascent Method for Nonconvex-Nonconcave Minimax Optimizationcited by 11
  34. 2024Mirror and Preconditioned Gradient Descent in Wasserstein Spacecited by 11
  35. 2021Resilient Machine Learning for Networked Cyber Physical Systems: A Survey for Machine Learning Security to Securing Machine Learning for CPScited by 10
  36. 2021Convergence Rates of Two-Time-Scale Gradient Descent-Ascent Dynamics for Solving Nonconvex Min-Max Problemscited by 10
  37. 2024Distributionally Robust Optimization via Iterative Algorithms in Continuous Probability Spacescited by 8
  38. 2022On the Linear Convergence of Extra-Gradient Methods for Nonconvex-Nonconcave Minimax Problemscited by 7

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.