mlsanityData to 7 Oct 2026

Faster Unbalanced Optimal Transport: Translation invariant Sinkhorn and 1-D Frank-Wolfe

arXiv 2201.00730 ↗First posted 3 Jan 2022math.OC cs.LGcited by 22

Not on the map. Why?

Abstract (arXiv)

Unbalanced optimal transport (UOT) extends optimal transport (OT) to take into account mass variations to compare distributions. This is crucial to make OT successful in ML applications, making it robust to data normalization and outliers. The baseline algorithm is Sinkhorn, but its convergence speed might be significantly slower for UOT than for OT. In this work, we identify the cause for this deficiency, namely the lack of a global normalization of the iterates, which equivalently corresponds to a translation of the dual OT potentials. Our first contribution leverages this idea to develop a provably accelerated Sinkhorn algorithm (coined 'translation invariant Sinkhorn') for UOT, bridging the computational gap with OT. Our second contribution focusses on 1-D UOT and proposes a Frank-Wolfe solver applied to this translation invariant formulation. The linear oracle of each steps amounts to solving a 1-D OT problems, resulting in a linear time complexity per iteration. Our last contribution extends this method to the computation of UOT barycenter of 1-D measures. Numerical simulations showcase the convergence speed improvement brought by these three approaches.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 26 of its 44 references that are in the map. First posted on arXiv 3 Jan 2022.

Builds on

26 of 44 references.

References · 26

  1. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  2. 2018Computational Optimal Transportcited by 765
  3. 2017Wasserstein GANcited by 635
  4. 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 633
  5. 2015Generative Moment Matching Networkscited by 252
  6. 2013Fast Computation of Wasserstein Barycenterscited by 216
  7. 2015Learning with a Wasserstein Losscited by 194
  8. 2015Optimal Entropy-Transport problems and a new Hellinger-Kantorovich distance between positive measurescited by 138
  9. 2021Unbalanced minibatch Optimal Transport; applications to Domain Adaptationcited by 123
  10. 2019Differentiable Ranks and Sorting using Optimal Transportcited by 113
  11. 2020Robust Optimal Transport with Applications in Generative Modeling and Domain Adaptationcited by 86
  12. 2015On the Global Linear Convergence of Frank-Wolfe Optimization Variantscited by 76
14 more
  1. 2020On Unbalanced Optimal Transport: An Analysis of Sinkhorn Algorithmcited by 61
  2. 2019Sinkhorn Divergences for Unbalanced Optimal Transportcited by 52
  3. 2020Outlier-Robust Optimal Transportcited by 45
  4. 2016Scaling Algorithms for Unbalanced Transport Problemscited by 36
  5. 2020Debiased Sinkhorn barycenterscited by 34
  6. 2021Unbalanced Optimal Transport through Non-negative Penalized Linear Regressioncited by 31
  7. 2019Sinkhorn Barycenters with Free Support via Frank-Wolfe Algorithmcited by 27
  8. 2015Submodular Functions: from Discrete to Continous Domainscited by 24
  9. 2020Wasserstein barycenters can be computed in polynomial time in fixed dimensioncited by 23
  10. 2016Regularized Nonlinear Accelerationcited by 18
  11. 2019Interior-Point Methods Strike Back: Solving the Wasserstein Barycenter Problemcited by 9
  12. 2017A Framework for Wasserstein-1-Type Metricscited by 8
  13. 2019Parallel Unbalanced Optimal Transport Regularization for Large Scale Imaging Problemscited by 8
  14. 2021Sliced Multi-Marginal Optimal Transportcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 6; 2023: 5; 2024: 0; 2025: 4; 2026: 7.

22 papers.

Sort:

  1. 2022Unbalanced Optimal Transport, from Theory to Numericscited by 45
  2. 2023Optimal Transport for Treatment Effect Estimationcited by 32
  3. 2022On Unbalanced Optimal Transport: Gradient Methods, Sparsity and Approximation Errorcited by 16
  4. 2022Neural Unbalanced Optimal Transport via Cycle-Consistent Semi-Couplingscited by 16
  5. 2022Rethinking Initialization of the Sinkhorn Algorithmcited by 14
  6. 2023Scalable Unbalanced Sobolev Transport for Measures on a Graphcited by 10
  7. 2023Unbalanced Low-rank Optimal Transport Solverscited by 7
  8. 2023Outlier-Robust Gromov-Wasserstein for Graph Datacited by 6
  9. 2023Importance Sparsification for Sinkhorn Algorithmcited by 6
  10. 2022Centered plug-in estimation of Wasserstein distancescited by 2
  11. 2025Bayesian Experimental Design for Model Discrepancy Calibration: An Auto-Differentiable Ensemble Kalman Inversion Approachcited by 2
  12. 2026Fast and Large-Scale Unbalanced Optimal Transport via its Semi-Dual and Adaptive Gradient Methodscited by 2
10 more
  1. 2026Amortized Optimal Transport from Sliced Potentialscited by 2
  2. 2022On the Convergence of Semi-Relaxed Sinkhorn with Marginal Constraint and OT Distance Gapscited by 1
  3. 2025Control, Optimal Transport and Neural Differential Equations in Supervised Learningcited by 1
  4. 2025An Efficient Orlicz-Sobolev Approach for Transporting Unbalanced Measures on a Graphcited by 0
  5. 2025Potent but Stealthy: Rethink Profile Pollution against Sequential Recommendation via Bi-level Constrained Reinforcement Paradigmcited by 0
  6. 2026Bayesian Experimental Design for Model Discrepancy Calibration: A Rivalry between Kullback--Leibler Divergence and Wasserstein Distancecited by 0
  7. 2026Sample complexity of unbalanced entropic OTcited by 0
  8. 2026Density-Reweighted Entropic Optimal Transport: Decoupling Geometry from Sampling Densitycited by 0
  9. 2026Partial Optimal Transport on the Circle for All Transported Masses in O(N log N)cited by 0
  10. 2026Dual-guided Hierarchical Edge Localization for Large-scale Optimal Transport Across Dimensionscited by 0