Convergence of empirical subgradients for optimal transport-based objectives
Not on the map. Why?
Abstract (arXiv)
Optimal transport is widely used to learn distributions, enforce distributional constraints, and model uncertainty. In applications, transport losses are often computed from samples through tractable representations, such as one-dimensional sorting formulas or sliced Wasserstein costs, making them practical components in training pipelines. We study parameterized objectives defined by sampled transport costs and prove graphical convergence of their subdifferentials to the subdifferential of the population objective. In particular, this ensures that standard subgradient methods consistently approach stationary points of the population-level problem. We illustrate the results in several settings, including risk-averse optimization, fairness-constrained learning, and sliced Wasserstein problems. Our analysis highlights that smooth parameterizations provide a favorable interface between statistical consistency and optimization. By contrast, transport objectives with nonsmooth costs and models may exhibit unstable derivatives in the large-sample limit.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 70 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
33 of 70 references.
References · 33
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2014Certifying and removing disparate impactcited by 715
- 2013Fast Computation of Wasserstein Barycenterscited by 216
- 2016Distributionally Robust Stochastic Optimization with Wasserstein Distancecited by 182
- 2019Wasserstein Distributionally Robust Optimization: Theory and Applications in Machine Learningcited by 169
- 2018Stochastic subgradient method converges on tame functionscited by 120
- 2019Differentiable Ranks and Sorting using Optimal Transportcited by 113
- 2018Generative Modeling using the Sliced Wasserstein Distancecited by 108
- 2022Optimal Transport Tools (OTT): A JAX Toolbox for all things Wassersteincited by 96
- 2020Statistical and Topological Properties of Sliced Probability Divergencescited by 83
- 2019Conservative set valued fields, automatic differentiation, stochastic gradient method and deep learningcited by 71
- 2021Minibatch optimal transport distances; analysis and applicationscited by 62
21 more
- 2019Quantitative stability of optimal transport maps and linearization of the 2-Wasserstein spacecited by 25
- 2023On diffusion-based generative models and their error bounds: The log-concave case with full convergence estimatescited by 24
- 2020Device Heterogeneity in Federated Learning: A Superquantile Approachcited by 20
- 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distancecited by 20
- 2019Tackling Algorithmic Bias in Neural-Network Classifiers using Wasserstein-2 Regularizationcited by 18
- 2022On the existence of Monge maps for the Gromov-Wasserstein problemcited by 16
- 2024Sliced Wasserstein with Random-Path Projecting Directionscited by 15
- 2023Properties of Discrete Sliced Wasserstein Lossescited by 12
- 2025Color Conditional Generation with Sliced Wasserstein Guidancecited by 10
- 2022The derivatives of Sinkhorn-Knopp convergecited by 9
- 2022Stochastic Optimization for Spectral Risk Measurescited by 7
- 2025Differentiable Generalized Sliced Wasserstein Planscited by 7
- 2022Metrizing Fairnesscited by 6
- 2021Randomized Stochastic Gradient Descent Ascentcited by 3
- 2022Superquantile-based learning: a direct approach using gradient-based optimizationcited by 3
- 2023A Unified Framework for Rank-based Loss Minimizationcited by 3
- 2025Towards Understanding Gradient Dynamics of the Sliced-Wasserstein Distance via Critical Point Analysiscited by 3
- 2019A Strong Law of Large Numbers for Random Monotone Operatorscited by 2
- 2024The gradient's limit of a definable family of functions admits a variational stratificationcited by 2
- 2025Learning with Differentially Private (Sliced) Wasserstein Gradientscited by 2
- 2025A Characterization of Law-Invariant and Coherent Risk Measures through Optimal Transportcited by 1
Built on by
Not cited yet.