Sliced-Wasserstein Flows: Nonparametric Generative Modeling via Optimal Transport and Diffusions
Not on the map. Why?
Abstract (arXiv)
By building upon the recent theory that established the connection between implicit generative modeling (IGM) and optimal transport, in this study, we propose a novel parameter-free algorithm for learning the underlying distributions of complicated datasets and sampling from them. The proposed algorithm is based on a functional optimization problem, which aims at finding a measure that is close to the data distribution as much as possible and also expressive enough for generative modeling purposes. We formulate the problem as a gradient flow in the space of probability measures. The connections between gradient flows and stochastic differential equations let us develop a computationally efficient algorithm for solving the optimization problem. We provide formal theoretical analysis where we prove finite-time error guarantees for the proposed algorithm. To the best of our knowledge, the proposed algorithm is the first nonparametric IGM algorithm with explicit theoretical guarantees. Our experimental results support our theory and show that our algorithm is able to successfully capture the structure of different types of data distributions.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 11; 2023: 22; 2024: 11; 2025: 7; 2026: 12.
77 papers.
Sort:
By area:
- 2021Unbalanced minibatch Optimal Transport; applications to Domain Adaptationcited by 123
- 2021Deep Generative Learning via Schr"odinger Bridgecited by 103
- 2021Large-Scale Wasserstein Gradient Flowscited by 76
- 2021Minibatch optimal transport distances; analysis and applicationscited by 62
- 2021Optimizing Functionals on the Space of Probabilities with Input Convex Neural Networkscited by 53
- 2021Distributionally Robust Learningcited by 44
- 2022Understanding and Mitigating Overfitting in Prompt Tuning for Vision-Language Modelscited by 40
- 2022Normalizing flow neural networks by JKO schemecited by 39
- 2023Energy-Based Sliced Wasserstein Distancecited by 39
- 2023Generative Sliced MMD Flows with Riesz Kernelscited by 36
- 2021Fast Approximation of the Sliced-Wasserstein Distance Using Concentration of Random Projectionscited by 33
- 2023A mean-field games laboratory for generative modelingcited by 28
38 more
- 2024AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportationcited by 27
- 2022Revisiting Sliced Wasserstein on Images: From Vectorization to Convolutioncited by 25
- 2023Posterior Sampling Based on Gradient Flows of the MMD with Negative Distance Kernelcited by 25
- 2022Hierarchical Sliced Wasserstein Distancecited by 23
- 2021Efficient Gradient Flows in Sliced-Wasserstein Spacecited by 21
- 2023Unifying GANs and Score-Based Diffusion as Generative Particle Modelscited by 21
- 2022Sliced Optimal Partial Transportcited by 19
- 2023Gaussian Interpolation Flowscited by 17
- 2022Hyperbolic Sliced-Wasserstein via Geodesic and Horospherical Projectionscited by 16
- 2021On Transportation of Mini-batches: A Hierarchical Approachcited by 15
- 2021Stein Variational Gradient Descent: many-particle and long-time asymptoticscited by 15
- 2023Nonparametric Generative Modeling with Conditional Sliced-Wasserstein Flowscited by 15
- 2024A Practical Guide to Sample-based Statistical Distances for Evaluating Generative Models in Sciencecited by 14
- 2021Entropy Partial Transport with Tree Metrics: Theory and Practicecited by 13
- 2021Entropic Gromov-Wasserstein between Gaussian Distributionscited by 12
- 2023Properties of Discrete Sliced Wasserstein Lossescited by 12
- 2023Markovian Sliced Wasserstein Distances: Beyond Independent Projectionscited by 11
- 2024Efficient Prior Calibration From Indirect Datacited by 11
- 2023Dynamic Flows on Curved Space Generated by Labeled Datacited by 10
- 2021SLOSH: Set LOcality Sensitive Hashing via Sliced-Wasserstein Embeddingscited by 9
- 2022Optimal Neural Network Approximation of Wasserstein Gradient Direction via Convex Optimizationcited by 9
- 2024Neural Sinkhorn Gradient Flowcited by 8
- 2024Sliced-Wasserstein Estimation with Spherical Harmonics as Control Variatescited by 8
- 2022Shedding a PAC-Bayesian Light on Adaptive Sliced-Wasserstein Distancescited by 7
- 2024Tree-Sliced Wasserstein Distance: A Geometric Perspectivecited by 7
- 2024Importance Corrected Neural JKO Samplingcited by 7
- 2025Slicing the Gaussian Mixture Wasserstein Distancecited by 7
- 2021Learning to Generate Wasserstein Barycenterscited by 6
- 2023Measure transfer via stochastic slicing and matchingcited by 6
- 2023Scalable Counterfactual Distribution Estimation in Multivariate Causal Modelscited by 6
- 2024Hierarchical Hybrid Sliced Wasserstein: A Scalable Metric for Heterogeneous Joint Distributionscited by 6
- 2026On the Wasserstein Gradient Flow Interpretation of Drifting Modelscited by 6
- 2023On the Convergence Rate of Gaussianization with Random Rotationscited by 5
- 2023One-Line-of-Code Data Mollification Improves Optimization of Likelihood-based Generative Modelscited by 4
- 2023Convergence of SGD for Training Neural Networks with Sliced Wasserstein Lossescited by 4
- 2023Module-wise Training of Neural Networks via the Minimizing Movement Schemecited by 4
- 2023Differentially Private Gradient Flow based on the Sliced Wasserstein Distancecited by 4
- 2024WeiPer: OOD Detection using Weight Perturbations of Class Projectionscited by 4
50 most cited of 77 All 77 (JSON)
- 2026From Scores to Samples: Elastic Forcing for Autoregressive Video Generation28 Sep 2026
- 2026Distribution Steering via Sliced Optimal Transport Control13 Aug 2026
- 2026All in One: Generative Modeling as Mean-Field Game Design25 Jul 2026
- 2026Highly Data Parallelizable Estimation of the Sliced-Wasserstein Distance Using Cumulative Distribution Functions29 Jun 2026
- 2026Difference of Convex Programming in the Wasserstein Space with Applications to MMD Optimization26 Jun 2026
- 2026On the Wasserstein Gradient Flow Interpretation of Drifting Models6 May 2026
- 2026Sliced Wasserstein Steering between Gaussian Measures14 Apr 2026
- 2026Generative models for decision-making under distributional shift6 Apr 2026
- 2026Convergence Rates for Distribution Matching with Sliced Optimal Transport11 Feb 2026
- 2026Well-Posed KL-Regularized Control via Wasserstein and Kalman-Wasserstein KL Divergences2 Feb 2026
- 2026Robust Generalization with Adaptive Optimal Transport Priors for Decision-Focused Learning1 Feb 2026
- 2026Approximating f-Divergences with Rank Statistics30 Jan 2026
38 more
- 2025Repulsive Monte Carlo on the sphere for the sliced Wasserstein distance12 Sep 2025
- 2025Liouville PDE-based sliced-Wasserstein flow22 May 2025
- 2025Streaming Sliced Optimal Transport11 May 2025
- 2025Boosting Statistic Learning with Synthetic Data from Pretrained Large Models8 May 2025
- 2025Slicing the Gaussian Mixture Wasserstein Distance11 Apr 2025
- 2025DDEQs: Distributional Deep Equilibrium Models through Wasserstein Gradient Flows3 Mar 2025
- 2025Towards Understanding Gradient Dynamics of the Sliced-Wasserstein Distance via Critical Point Analysis10 Feb 2025
- 2024Robust training of implicit generative models for multivariate and heavy-tailed distributions with an invariant statistical loss29 Oct 2024
- 2024Statistical and Geometrical properties of regularized Kernel Kullback-Leibler divergence29 Aug 2024
- 2024Importance Corrected Neural JKO Sampling29 Jul 2024
- 2024AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportation5 Jul 2024
- 2024Tree-Sliced Wasserstein Distance: A Geometric Perspective19 Jun 2024
- 2024Efficient Prior Calibration From Indirect Data28 May 2024
- 2024WeiPer: OOD Detection using Weight Perturbations of Class Projections27 May 2024
- 2024Hierarchical Hybrid Sliced Wasserstein: A Scalable Metric for Heterogeneous Joint Distributions23 Apr 2024
- 2024A Practical Guide to Sample-based Statistical Distances for Evaluating Generative Models in Science19 Mar 2024
- 2024Sliced-Wasserstein Estimation with Spherical Harmonics as Control Variates2 Feb 2024
- 2024Neural Sinkhorn Gradient Flow25 Jan 2024
- 2023Differentially Private Gradient Flow based on the Sliced Wasserstein Distance13 Dec 2023
- 2023Gaussian Interpolation Flows20 Nov 2023
- 2023Convolve and Conquer: Data Comparison with Wiener Filters11 Nov 2023
- 2023Scalable Counterfactual Distribution Estimation in Multivariate Causal Models2 Nov 2023
- 2023Posterior Sampling Based on Gradient Flows of the MMD with Negative Distance Kernel4 Oct 2023
- 2023Module-wise Training of Neural Networks via the Minimizing Movement Scheme29 Sep 2023
- 2023Partial Transport for Point-Cloud Registration27 Sep 2023
- 2023Convergence of SGD for Training Neural Networks with Sliced Wasserstein Losses21 Jul 2023
- 2023Properties of Discrete Sliced Wasserstein Losses19 Jul 2023
- 2023Measure transfer via stochastic slicing and matching11 Jul 2023
- 2023Towards Optimal Randomized Strategies in Adversarial Example Game29 Jun 2023
- 2023On the Convergence Rate of Gaussianization with Random Rotations23 Jun 2023
- 2023One-Line-of-Code Data Mollification Improves Optimization of Likelihood-based Generative Models30 May 2023
- 2023Unifying GANs and Score-Based Diffusion as Generative Particle Models25 May 2023
- 2023Generative Sliced MMD Flows with Riesz Kernels19 May 2023
- 2023Nonparametric Generative Modeling with Conditional Sliced-Wasserstein Flows3 May 2023
- 2023Energy-Based Sliced Wasserstein Distance26 Apr 2023
- 2023A mean-field games laboratory for generative modeling26 Apr 2023
- 2023Generative Modeling with Flow-Guided Density Ratio Learning7 Mar 2023
- 2023Interpolation for Robust Learning: Data Augmentation on Wasserstein Geodesics4 Feb 2023
50 newest of 77 All 77 (JSON)
- 2021Unbalanced minibatch Optimal Transport; applications to Domain Adaptationcited by 123
- 2021Deep Generative Learning via Schr"odinger Bridgecited by 103
- 2021Large-Scale Wasserstein Gradient Flowscited by 76
- 2021Minibatch optimal transport distances; analysis and applicationscited by 62
- 2021Optimizing Functionals on the Space of Probabilities with Input Convex Neural Networkscited by 53
- 2021Distributionally Robust Learningcited by 44
- 2022Normalizing flow neural networks by JKO schemecited by 39
- 2023Energy-Based Sliced Wasserstein Distancecited by 39
- 2023Generative Sliced MMD Flows with Riesz Kernelscited by 36
- 2021Fast Approximation of the Sliced-Wasserstein Distance Using Concentration of Random Projectionscited by 33
- 2023A mean-field games laboratory for generative modelingcited by 28
- 2022Revisiting Sliced Wasserstein on Images: From Vectorization to Convolutioncited by 25
12 most cited of 72 All 72 (JSON)
- 2026From Scores to Samples: Elastic Forcing for Autoregressive Video Generation28 Sep 2026
- 2026Distribution Steering via Sliced Optimal Transport Control13 Aug 2026
- 2026Highly Data Parallelizable Estimation of the Sliced-Wasserstein Distance Using Cumulative Distribution Functions29 Jun 2026
- 2026Difference of Convex Programming in the Wasserstein Space with Applications to MMD Optimization26 Jun 2026
- 2026On the Wasserstein Gradient Flow Interpretation of Drifting Models6 May 2026
- 2026Sliced Wasserstein Steering between Gaussian Measures14 Apr 2026
- 2026Generative models for decision-making under distributional shift6 Apr 2026
- 2026Convergence Rates for Distribution Matching with Sliced Optimal Transport11 Feb 2026
- 2026Well-Posed KL-Regularized Control via Wasserstein and Kalman-Wasserstein KL Divergences2 Feb 2026
- 2026Robust Generalization with Adaptive Optimal Transport Priors for Decision-Focused Learning1 Feb 2026
- 2026Approximating f-Divergences with Rank Statistics30 Jan 2026
- 2025Repulsive Monte Carlo on the sphere for the sliced Wasserstein distance12 Sep 2025
12 newest of 72 All 72 (JSON)