Annealed Sinkhorn with Momentum: Certified Unregularized Optimal Transport in Linear Memory
Not on the map. Why?
Abstract (arXiv)
We characterize Bregman Douglas-Rachford splitting (BDRS) for unregularized discrete optimal transport and develop an anytime primal-dual certificate in linear memory. We first establish that BDRS coincides with warm-started Inexact Proximal point method for exact Optimal Transport (IPOT) using a single inner Sinkhorn iteration. By eliminating the primal transport plan from the updates, we derive an equivalent dual formulation that reveals BDRS as annealed Sinkhorn under an implicit inverse-linear temperature schedule, with an additional log-scaling momentum term and a cooler kernel. While this explains the role of the temperature parameter in BDRS as an initial temperature, it also reduces the solver's memory requirement from quadratic to linear. Utilizing this annealing perspective, we introduce overrelaxed BDRS, which combines annealing and overrelaxed scaling within a single recursion. We derive a primal-dual certificate for both methods that can be evaluated in linear memory without transport plan construction, thus providing a computable stopping rule. On the DOTmark benchmark, combining momentum with the cooler kernel produces substantially smaller optimality gaps than annealed Sinkhorn under the same schedule. For pixel-level color transfer between 1024×1024 images, BDRS attains a lower repaired transport cost than MDOT-TNT with a 9× speed up, reaching a relative duality gap of 1.59% in 24 minutes. We further demonstrate a color transfer with 4238×2365 images, yielding 10 million pixels per image and approximately one hundred trillion implicit transport entries, reaching a best relative duality gap of 2.41% and 2.80% within 35 hours in each direction on a single NVIDIA L40S GPU.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 34 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
19 of 34 references.
References · 19
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2018Computational Optimal Transportcited by 780
- 2017Near-linear time approximation algorithms for optimal transport via Sinkhorn iterationcited by 223
- 2018Computational Optimal Transport: Complexity by Accelerated Gradient Descent Is Better Than by Sinkhorn's Algorithmcited by 112
- 2016Stabilized Sparse Scaling Algorithms for Entropy Regularized Transport Problemscited by 73
- 2017Overrelaxed Sinkhorn-Knopp Algorithm for Regularized Optimal Transportcited by 18
- 2016DOTmark - A Benchmark for Discrete Optimal Transportcited by 16
- 2021A Fast and Accurate Splitting Method for Optimal Transport: Analysis and Implementationcited by 9
- 2021Bregman Proximal Point Algorithm Revisited: A New Inexact Version and its Inertial Variantcited by 8
- 2023Efficient and Accurate Optimal Transport with Mirror Descent and Conjugate Gradientscited by 7
- 2024Annealed Sinkhorn for Optimal Transport: convergence, regularization path and debiasingcited by 7
- 2025A Truncated Newton Method for Optimal Transportcited by 6
7 more
- 2025PINS: Proximal Iterations with Sparse Newton and Sinkhorn for Optimal Transportcited by 5
- 2024PDOT: a Practical Primal-Dual Algorithm and a GPU-Based Solver for Optimal Transportcited by 4
- 2023Bringing regularized optimal transport to lightspeed: a splitting method adapted for GPUscited by 3
- 2023Fast and Accurate Approximations of the Optimal Transport in Semi-Discrete and Discrete Settingscited by 2
- 2025Bregman Douglas-Rachford Splitting Methodcited by 2
- 2025Log-Averaged Mirror Prox for Fast, Large-Scale Optimal Transport in Linear Spacecited by 1
- 2026Inexact Bregman Sparse Newton Method for Efficient Optimal Transportcited by 1
Built on by
Not cited yet.