SinkSLOT: Sinkhorn via Sparse Lifted Optimal Transport
Not on the map. Why?
Abstract (arXiv)
Entropic optimal transport (EOT) has been shown to offer a computationally tractable approximation to exact optimal transport. However, the standard Sinkhorn-Knopp algorithm has two main limitations. First, given discrete measures with N points, each iteration requires O(N2) operations, which restricts its use on large-scale datasets (e.g. N≥104). Second, it uses the independent coupling as a reference measure for regularisation. This assigns mass to high-cost transport edges at moderate regularisation strengths. We propose SinkSLOT, which addresses both limitations by putting forth the expected sliced lifted transport plan as a natural way to sparsify the Gibbs kernel with a non-independent prior coupling. We prove that: 1) SinkSLOT converges; 2) with L slices, each resulting sparse Sinkhorn iteration costs O(LN); and 3) the resulting objective is a divergence requiring no debiasing. Experiments on synthetic benchmarks show that SinkSLOT delivers substantial speedups over state-of-the-art dense and sparse EOT methods. We also demonstrate the applicability of the proposed divergence in a gradient flow experiment. The code is publicly available at https://github.com/cai4cai/SinkSLOT.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 38 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
22 of 38 references.
References · 22
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2013A survey of the Schr"odinger problem and some of its connections with optimal transportcited by 286
- 2018Online normalizer calculation for softmaxcited by 154
- 2017Smooth and Sparse Optimal Transportcited by 83
- 2016Stabilized Sparse Scaling Algorithms for Entropy Regularized Transport Problemscited by 69
- 2020Distributional Sliced-Wasserstein and Applications to Generative Modelingcited by 69
- 2021Low-Rank Sinkhorn Factorizationcited by 66
- 2018Statistical Optimal Transport via Factored Couplingscited by 38
- 2019Orthogonal Estimation of Wasserstein Distancescited by 32
- 2022Sparsity-Constrained Optimal Transportcited by 32
- 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Surveycited by 27
10 more
- 2022Low-rank Optimal Transport: Approximation, Statistics and Debiasingcited by 21
- 2019Subspace Detours: Building Transport Plans that are Optimal on Subspace Projectionscited by 19
- 2024Expected Sliced Transport Planscited by 19
- 2021Scalable Optimal Transport in High Dimensions for Graph Distances, Embedding Alignment, and Morecited by 10
- 2025Optimal Transport for Machine Learnerscited by 8
- 2026FlashSinkhorn: IO-Aware Entropic Optimal Transport on GPUcited by 7
- 2023Importance Sparsification for Sinkhorn Algorithmcited by 6
- 2021Approximating Optimal Transport via Low-rank and Sparse Factorizationcited by 4
- 2025Entropic optimal transport beyond product reference couplings: the Gaussian case on Euclidean spacecited by 2
- 2026Sliced-Regularized Optimal Transportcited by 2
Built on by
Not cited yet.