Fast Computation of Optimal Transport via Entropy-Regularized Extragradient Methods
Not on the map. Why?
Abstract (arXiv)
Efficient computation of the optimal transport distance between two distributions serves as an algorithm subroutine that empowers various applications. This paper develops a scalable first-order optimization-based method that computes optimal transport to within varepsilon additive accuracy with runtime widetildeO( n2/varepsilon), where n denotes the dimension of the probability distributions of interest. Our algorithm achieves the state-of-the-art computational guarantees among all first-order methods, while exhibiting favorable numerical performance compared to classical algorithms like Sinkhorn and Greenkhorn. Underlying our algorithm designs are two key elements: (a) converting the original problem into a bilinear minimax problem over probability distributions; (b) exploiting the extragradient idea -- in conjunction with entropy regularization and adaptive learning rates -- to accelerate convergence.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 39 of its 75 references that are in the map. First posted on arXiv 30 Jan 2023.
Builds on
39 of 75 references.
References · 39
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2018Computational Optimal Transportcited by 765
- 2019A Theory of Regularized Markov Decision Processescited by 279
- 2020On the Global Convergence Rates of Softmax Policy Gradient Methodscited by 258
- 2017Near-linear time approximation algorithms for optimal transport via Sinkhorn iterationcited by 219
- 2016Stochastic Optimization for Large-scale Optimal Transportcited by 188
- 2013Optimization, Learning, and Games with Predictable Sequencescited by 187
- 2017A unified view of entropy-regularized Markov decision processescited by 174
- 2020Fast Global Convergence of Natural Policy Gradient Methods with Entropy Regularizationcited by 170
- 2021Policy Mirror Descent for Reinforcement Learning: Linear Convergence, New Sampling Complexity, and Generalized Problem Classescited by 149
- 2019A Unified Analysis of Extra-gradient and Optimistic Gradient Methods for Saddle Point Problems: Proximal Point Approachcited by 142
- 2018Optimistic mirror descent in saddle-point problems: Going the extra (gradient) milecited by 132
27 more
- 2017Cycles in adversarial regularized learningcited by 122
- 2018Computational Optimal Transport: Complexity by Accelerated Gradient Descent Is Better Than by Sinkhorn's Algorithmcited by 111
- 2018Last-Iterate Convergence: Zero-Sum Games and Constrained Min-Max Optimizationcited by 97
- 2019On the convergence of single-call stochastic extra-gradient methodscited by 88
- 2021Policy Mirror Descent for Regularized Reinforcement Learning: A Generalized Framework with Linear Convergencecited by 83
- 2018Interaction Matters: A Note on Non-asymptotic Local Convergence of Generative Adversarial Networkscited by 68
- 2021Fast Policy Extragradient Methods for Competitive Games with Entropy Regularizationcited by 61
- 2018Massively scalable Sinkhorn distances via the Nystr"om methodcited by 40
- 2019On the Efficiency of Entropic Regularized Algorithms for Optimal Transportcited by 34
- 2022Faster Last-iterate Convergence of Policy Optimization in Zero-Sum Markov Gamescited by 25
- 2019On a Combination of Alternating Minimization and Nesterov's Momentumcited by 18
- 2022On the Convergence Rate of Sinkhorn's Algorithmcited by 16
- 2018Better and Simpler Error Analysis of the Sinkhorn-Knopp Algorithm for Matrix Scalingcited by 14
- 2018Towards Optimal Running Times for Optimal Transportcited by 11
- 2020Bipartite Matching in Nearly-linear Time on Moderately Dense Graphscited by 11
- 2017Much Faster Algorithms for Matrix Scalingcited by 10
- 2018Approximating optimal transport with linear programscited by 10
- 2022Independent Natural Policy Gradient Methods for Potential Games: Finite-time Global Convergence with Entropy Regularizationcited by 10
- 2019A Graph Theoretic Additive Approximation of Optimal Transportcited by 9
- 2021A Fast and Accurate Splitting Method for Optimal Transport: Analysis and Implementationcited by 8
- 2022Accelerated Bregman Primal-Dual methods applied to Optimal Transport and Wasserstein Barycenter problemscited by 7
- 2020A note on overrelaxation in the Sinkhorn algorithmcited by 6
- 2022An Accelerated Stochastic Variance-Reduced Algorithm for Entropic Wasserstein Barycenterscited by 6
- 2022Asynchronous Gradient Play in Zero-Sum Multi-agent Gamescited by 5
- 2019Entropy-Regularized Stochastic Gamescited by 4
- 2022Solving a Special Type of Optimal Transport Problem by a Modified Hungarian Algorithmcited by 3
- 2022Flows, Scaling, and Entropy Revisited: a Unified Perspective via Optimizing Joint Distributionscited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.