Fast and Large-Scale Unbalanced Optimal Transport via its Semi-Dual and Adaptive Gradient Methods
Not on the map. Why?
Abstract (arXiv)
Unbalanced Optimal Transport (UOT) has emerged as a robust relaxation of standard Optimal Transport, particularly effective for handling outliers and mass variations. However, scalable algorithms for UOT, specifically those based on Gradient Descent (SGD), remain largely underexplored. In this work, we address this gap by analyzing the semi-dual formulation of Entropic UOT and demonstrating its suitability for adaptive gradient methods. While the semi-dual is a standard tool for large-scale balanced OT, its geometry in the unbalanced setting appears ill-conditioned under standard analysis. Specifically, worst-case bounds on the marginal penalties using chi2 divergence suggest a condition number scaling with n/varepsilon, implying poor scalability. In contrast, we show that the local condition number actually scales as O(1/varepsilon), effectively removing the ill-conditioned dependence on n. Exploiting this property, we prove that SGD methods adapt to this local curvature, achieving a convergence rate of O(n/varepsilon T) in the stochastic and online regimes, making it suitable for large-scale and semi-discrete applications. Finally, for the full batch discrete setting, we derive a nearly tight upper bound on local smoothness depending solely on the gradient. Using it to adapt step sizes, we propose a modified Adaptive Nesterov Accelerated Gradient (ANAG) method on the semi-dual functional and prove that it achieves a local complexity of O(n2√1/varepsilonln(1/δ)).
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 42 references that are in the map. First posted on arXiv 11 Feb 2026.
Builds on
24 of 42 references.
References · 24
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2019Introduction to Online Convex Optimizationcited by 793
- 2019Why gradient clipping accelerates training: A theoretical justification for adaptivitycited by 335
- 2016Stochastic Optimization for Large-scale Optimal Transportcited by 188
- 2015Optimal Entropy-Transport problems and a new Hellinger-Kantorovich distance between positive measurescited by 138
- 2017Large-Scale Optimal Transport and Mapping Estimationcited by 120
- 2018Computational Optimal Transport: Complexity by Accelerated Gradient Descent Is Better Than by Sinkhorn's Algorithmcited by 111
- 2019Unified Optimal Analysis of the (Stochastic) Gradient Methodcited by 81
- 2019Adaptive Gradient Descent without Descentcited by 79
- 2016Stabilized Sparse Scaling Algorithms for Entropy Regularized Transport Problemscited by 69
- 2020On Unbalanced Optimal Transport: An Analysis of Sinkhorn Algorithmcited by 61
- 2022Unbalanced Optimal Transport, from Theory to Numericscited by 45
12 more
- 2023Generative Modeling through the Semi-dual Formulation of Unbalanced Optimal Transportcited by 39
- 2017Generalized Self-Concordant Functions: A Recipe for Newton-Type Methodscited by 33
- 2013Adaptivity of averaged stochastic gradient descent to local strong convexity for logistic regressioncited by 32
- 2023Unbalancedness in Neural Monge Maps Improves Unpaired Domain Translationcited by 32
- 2021Unbalanced Optimal Transport through Non-negative Penalized Linear Regressioncited by 31
- 2024Methods for Convex (L0,L1)-Smooth Optimization: Clipping, Acceleration, and Adaptivitycited by 25
- 2022Faster Unbalanced Optimal Transport: Translation invariant Sinkhorn and 1-D Frank-Wolfecited by 22
- 2024Optimizing (L0, L1)-Smooth Functions by Gradient Methodscited by 18
- 2022On Unbalanced Optimal Transport: Gradient Methods, Sparsity and Approximation Errorcited by 16
- 2023DPM-OT: A New Diffusion Probabilistic Model Based on Optimal Transportcited by 14
- 2023Light Unbalanced Optimal Transportcited by 8
- 2025A Truncated Newton Method for Optimal Transportcited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Tight Nonasymptotic Local Convergence of Sinkhorn-Knoppcited by 0
- 2026A Unified Dual Method for Matching Problemscited by 0
- 2026A Unified Dual Method for Matching Problems30 Sep 2026
- 2026Tight Nonasymptotic Local Convergence of Sinkhorn-Knopp12 Aug 2026