On the Convergence of Semi-Relaxed Sinkhorn with Marginal Constraint and OT Distance Gaps
Not on the map. Why?
Abstract (arXiv)
This paper presents consideration of the Semi-Relaxed Sinkhorn (SR-Sinkhorn) algorithm for the semi-relaxed optimal transport (SROT) problem, which relaxes one marginal constraint of the standard OT problem. For evaluation of how the constraint relaxation affects the algorithm behavior and solution, it is vitally necessary to present the theoretical convergence analysis in terms not only of the functional value gap, but also of the marginal constraint gap as well as the OT distance gap. However, no existing work has addressed all analyses simultaneously. To this end, this paper presents a comprehensive convergence analysis for SR-Sinkhorn. After presenting the ε-approximation of the functional value gap based on a new proof strategy and exploiting this proof strategy, we give the upper bound of the marginal constraint gap. We also provide its convergence to the ε-approximation when two distributions are in the probability simplex. Furthermore, the convergence analysis of the OT distance gap to the ε-approximation is given as assisted by the obtained marginal constraint gap. The latter two theoretical results are the first results presented in the literature related to the SROT problem.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 53 references that are in the map. First posted on arXiv 27 May 2022.
Builds on
32 of 53 references.
References · 32
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2018Computational Optimal Transportcited by 765
- 2017Near-linear time approximation algorithms for optimal transport via Sinkhorn iterationcited by 219
- 2013Fast Computation of Wasserstein Barycenterscited by 216
- 2015Learning with a Wasserstein Losscited by 194
- 2019Style Transfer by Relaxed Optimal Transport and Self-Similaritycited by 167
- 2021Unbalanced minibatch Optimal Transport; applications to Domain Adaptationcited by 123
- 2018Computational Optimal Transport: Complexity by Accelerated Gradient Descent Is Better Than by Sinkhorn's Algorithmcited by 111
- 2019Wasserstein Weisfeiler-Lehman Graph Kernelscited by 104
- 2020Robust Optimal Transport with Applications in Generative Modeling and Domain Adaptationcited by 86
- 2017Smooth and Sparse Optimal Transportcited by 83
- 2018Optimal Transport for Multi-source Domain Adaptation under Target Shiftcited by 67
20 more
- 2020On Unbalanced Optimal Transport: An Analysis of Sinkhorn Algorithmcited by 61
- 2019On Efficient Optimal Transport: An Analysis of Greedy and Accelerated Mirror Descent Algorithmscited by 60
- 2013Regularized Discrete Optimal Transportcited by 54
- 2018Scalable Unbalanced Optimal Transport using Generative Adversarial Networkscited by 41
- 2021Improving Mini-batch Optimal Transport via Partial Transportationcited by 40
- 2016Scaling Algorithms for Unbalanced Transport Problemscited by 36
- 2021Unbalanced Optimal Transport through Non-negative Penalized Linear Regressioncited by 31
- 2021On Robust Optimal Transport: Computational Complexity and Barycenter Computationcited by 27
- 2021Outlier-Robust Optimal Transport: Duality, Structure, and Statistical Analysiscited by 27
- 2022Faster Unbalanced Optimal Transport: Translation invariant Sinkhorn and 1-D Frank-Wolfecited by 22
- 2021Semi-relaxed Gromov-Wasserstein divergence with applications on graphscited by 21
- 2019On a Combination of Alternating Minimization and Nesterov's Momentumcited by 18
- 2019Spatio-Temporal Alignments: Optimal transport through space and timecited by 17
- 2020Fast Unbalanced Optimal Transport on a Treecited by 16
- 2018Towards Optimal Running Times for Optimal Transportcited by 11
- 2021On Multimarginal Partial Optimal Transport: Equivalent Forms and Computational Complexitycited by 8
- 2020LCS Graph Kernel Based on Wasserstein Distance in Longest Common Subsequence Metric Spacecited by 7
- 2020Wasserstein k-means with sparse simplex projectioncited by 6
- 2019A Direct tildeO(1/ε) Iteration Parallel Algorithm for Optimal Transportcited by 4
- 2021Fast block-coordinate Frank-Wolfe algorithm for semi-relaxed optimal transportcited by 3
Built on by
Citing papers per year: 2024: 1.
1 paper.