Generative Modeling using the Sliced Wasserstein Distance
Not on the map. Why?
Abstract (arXiv)
Generative Adversarial Nets (GANs) are very successful at modeling distributions from given samples, even in the high-dimensional case. However, their formulation is also known to be hard to optimize and often not stable. While this is particularly true for early GAN formulations, there has been significant empirically motivated and theoretically founded progress to improve stability, for instance, by using the Wasserstein distance rather than the Jenson-Shannon divergence. Here, we consider an alternative formulation for generative modeling based on random projections which, in its simplest form, results in a single objective rather than a saddle-point formulation. By augmenting this approach with a discriminator we improve its accuracy. We found our approach to be significantly more stable compared to even the improved Wasserstein GAN. Further, unlike the traditional GAN loss, the loss formulated in our method is a good measure of the actual distance between the distributions and, for the first time for GAN training, we are able to show estimates for the same.
Key facts. Cited by 108 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 21; 2023: 18; 2024: 20; 2025: 16; 2026: 15.
108 papers.
Sort:
By area:
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
- 2021Generative Modeling with Optimal Transport Mapscited by 82
- 2022Generative Multiplane Images: Making a 2D GAN 3D-Awarecited by 57
- 2021GFINNs: GENERIC Formalism Informed Neural Networks for Deterministic and Stochastic Dynamical Systemscited by 49
- 2021Point-set Distances for Learning Representations of 3D Point Cloudscited by 48
- 2021ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Imagescited by 48
- 2023Class-Balancing Diffusion Modelscited by 48
- 2021Improving Mini-batch Optimal Transport via Partial Transportationcited by 41
- 2022Statistical, Robustness, and Computational Guarantees for Sliced Wasserstein Distancescited by 41
- 2023Energy-Based Sliced Wasserstein Distancecited by 39
- 2026Representation Fr'echet Loss for Visual Generationcited by 37
- 2021Wasserstein GANs Work Because They Fail (to Approximate the Wasserstein Distance)cited by 35
38 more
- 2021Fast Approximation of the Sliced-Wasserstein Distance Using Concentration of Random Projectionscited by 33
- 2024An Aggregation-Free Federated Learning for Tackling Data Heterogeneitycited by 33
- 2022Generating natural images with direct Patch Distributions Matchingcited by 27
- 2023Energy-guided Entropic Neural Optimal Transportcited by 26
- 2022Revisiting Sliced Wasserstein on Images: From Vectorization to Convolutioncited by 25
- 2022Hierarchical Sliced Wasserstein Distancecited by 23
- 2022Self-Supervised Learning for Real-World Super-Resolution from Dual Zoomed Observationscited by 20
- 2021Differentially Private Sliced Wasserstein Distancecited by 19
- 2022Distribution Regression with Sliced Wasserstein Kernelscited by 18
- 2022Sliced Wasserstein Variational Inferencecited by 18
- 2022Amortized Projection Optimization for Sliced Wasserstein Generative Modelscited by 17
- 2021On Transportation of Mini-batches: A Hierarchical Approachcited by 16
- 2022Hyperbolic Sliced-Wasserstein via Geodesic and Horospherical Projectionscited by 16
- 2023Sliced Wasserstein Estimation with Control Variatescited by 16
- 2026VISReg: Variance-Invariance-Sketching Regularization for JEPA trainingcited by 16
- 2023Nonparametric Generative Modeling with Conditional Sliced-Wasserstein Flowscited by 15
- 2024Sliced Wasserstein with Random-Path Projecting Directionscited by 15
- 2021Understanding Overparameterization in Generative Adversarial Networkscited by 14
- 2024A Practical Guide to Sample-based Statistical Distances for Evaluating Generative Models in Sciencecited by 14
- 2024Multiscale Sliced Wasserstein Distances as Perceptual Color Difference Measurescited by 14
- 2022OTAdapt: Optimal Transport-based Approach For Unsupervised Domain Adaptationcited by 12
- 2023Properties of Discrete Sliced Wasserstein Lossescited by 12
- 2023Markovian Sliced Wasserstein Distances: Beyond Independent Projectionscited by 11
- 2026Representation Distribution Matching for One-Step Visual Generationcited by 11
- 2024Sharp bounds for max-sliced Wasserstein distancescited by 10
- 2021Weakly Supervised High-Fidelity Clothing Model Generationcited by 9
- 2022One Loss for Quantization: Deep Hashing with Discrete Wasserstein Distributional Matchingcited by 9
- 2023Scalable Infomin Learningcited by 8
- 2024Privacy-preserving data release leveraging optimal transport and particle gradient descentcited by 8
- 2024Sliced-Wasserstein Estimation with Spherical Harmonics as Control Variatescited by 8
- 2021A Quantum Generative Adversarial Network for distributionscited by 7
- 2022Shedding a PAC-Bayesian Light on Adaptive Sliced-Wasserstein Distancescited by 7
- 2022DigGAN: Discriminator gradIent Gap Regularization for GAN Training with Limited Datacited by 7
- 2023Self-Attention Amortized Distributional Projection Optimization for Sliced Wasserstein Point-Cloud Reconstructioncited by 7
- 2024Tree-Sliced Wasserstein Distance: A Geometric Perspectivecited by 7
- 2025A User's Guide to Sampling Strategies for Sliced Optimal Transportcited by 7
- 2025Slicing the Gaussian Mixture Wasserstein Distancecited by 7
- 2025Hierarchical Rectified Flow Matching with Mini-Batch Couplingscited by 7
50 most cited of 108 All 108 (JSON)
- 2026From Scores to Samples: Elastic Forcing for Autoregressive Video Generation28 Sep 2026
- 2026Representation Distribution Matching for One-Step Visual Generation2 Jul 2026
- 2026Highly Data Parallelizable Estimation of the Sliced-Wasserstein Distance Using Cumulative Distribution Functions29 Jun 2026
- 2026VISReg: Variance-Invariance-Sketching Regularization for JEPA training1 Jun 2026
- 2026Convergence of empirical subgradients for optimal transport-based objectives27 May 2026
- 2026Sliced Inner Product Gromov-Wasserstein Distances8 May 2026
- 2026Representation Fr'echet Loss for Visual Generation30 Apr 2026
- 2026Can Heterogeneous Language Models Be Fused?2 Apr 2026
- 2026Do Generative Metrics Predict YOLO Performance? An Evaluation Across Models, Augmentation Ratios, and Dataset Complexity20 Feb 2026
- 2026Magnitude Distance: A Geometric Measure of Dataset Similarity9 Feb 2026
- 2026Revisiting the Sliced Wasserstein Kernel for persistence diagrams: a Figalli-Gigli approach6 Feb 2026
- 2026HP-GAN: Harnessing pretrained networks for GAN improvement with FakeTwins and discriminator consistency3 Feb 2026
38 more
- 2026Robust Generalization with Adaptive Optimal Transport Priors for Decision-Focused Learning1 Feb 2026
- 2026A Unified Kantorovich Duality for Multimarginal Optimal Transport23 Jan 2026
- 2026One Prompt, Many Sounds: Modeling Listener Variability in LLM-Based Equalization14 Jan 2026
- 2025On the Information Processing of One-Dimensional Wasserstein Distances with Finite Samples17 Nov 2025
- 2025Repulsive Monte Carlo on the sphere for the sliced Wasserstein distance12 Sep 2025
- 2025On optimal solutions of classical and sliced Wasserstein GANs with non-Gaussian data8 Sep 2025
- 2025Differentiable Expectation-Maximisation and Applications to Gaussian Mixture Model Optimal Transport2 Sep 2025
- 2025Hierarchical Rectified Flow Matching with Mini-Batch Couplings17 Jul 2025
- 2025Relation-Aware Slicing in Cross-Domain Alignment17 Jul 2025
- 2025Weakly Supervised Object Segmentation by Background Conditional Divergence25 Jun 2025
- 2025Quantization-based Bounds on the Wasserstein Metric1 Jun 2025
- 2025Kernel Quantile Embeddings and Associated Probability Metrics26 May 2025
- 2025Liouville PDE-based sliced-Wasserstein flow22 May 2025
- 2025Streaming Sliced Optimal Transport11 May 2025
- 2025RAID: An In-Training Defense against Attribute Inference Attacks in Recommender Systems15 Apr 2025
- 2025Slicing the Gaussian Mixture Wasserstein Distance11 Apr 2025
- 2025Fast rigid alignment of heterogeneous images in sliced Wasserstein distance17 Mar 2025
- 2025A User's Guide to Sampling Strategies for Sliced Optimal Transport4 Feb 2025
- 2025Learning with Differentially Private (Sliced) Wasserstein Gradients3 Feb 2025
- 2024WassFFed: Wasserstein Fair Federated Learning11 Nov 2024
- 2024Robust training of implicit generative models for multivariate and heavy-tailed distributions with an invariant statistical loss29 Oct 2024
- 2024Privacy without Noisy Gradients: Slicing Mechanism for Generative Model Training25 Oct 2024
- 2024Tensor-Train Point Cloud Compression and Efficient Approximate Nearest-Neighbor Search6 Oct 2024
- 2024Multiscale Sliced Wasserstein Distances as Perceptual Color Difference Measures14 Jul 2024
- 2024MCNC: Manifold-Constrained Reparameterization for Neural Compression27 Jun 2024
- 2024Tree-Sliced Wasserstein Distance: A Geometric Perspective19 Jun 2024
- 2024Statistical and Computational Guarantees of Kernel Max-Sliced Wasserstein Distances24 May 2024
- 2024Max-sliced Wasserstein concentration and uniform ratio bounds of empirical measures on RKHS21 May 2024
- 2024Self-Supervised Learning for Real-World Super-Resolution from Dual and Multiple Zoomed Observations3 May 2024
- 2024An Aggregation-Free Federated Learning for Tackling Data Heterogeneity29 Apr 2024
- 2024Hierarchical Hybrid Sliced Wasserstein: A Scalable Metric for Heterogeneous Joint Distributions23 Apr 2024
- 2024A Copula Graphical Model for Multi-Attribute Data using Optimal Transport10 Apr 2024
- 2024A Practical Guide to Sample-based Statistical Distances for Evaluating Generative Models in Science19 Mar 2024
- 2024Sharp bounds for max-sliced Wasserstein distances1 Mar 2024
- 2024DeepDRK: Deep Dependency Regularized Knockoff for Feature Selection27 Feb 2024
- 2024Training Implicit Generative Models via an Invariant Statistical Loss26 Feb 2024
- 2024Sliced-Wasserstein Estimation with Spherical Harmonics as Control Variates2 Feb 2024
- 2024Privacy-preserving data release leveraging optimal transport and particle gradient descent31 Jan 2024
50 newest of 108 All 108 (JSON)
- 2023Class-Balancing Diffusion Modelscited by 48
- 2025Hierarchical Rectified Flow Matching with Mini-Batch Couplingscited by 7
- 2025Hierarchical Rectified Flow Matching with Mini-Batch Couplings17 Jul 2025
- 2023Class-Balancing Diffusion Models30 Apr 2023
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
- 2021Generative Modeling with Optimal Transport Mapscited by 82
- 2022Generative Multiplane Images: Making a 2D GAN 3D-Awarecited by 57
- 2021GFINNs: GENERIC Formalism Informed Neural Networks for Deterministic and Stochastic Dynamical Systemscited by 49
- 2021Point-set Distances for Learning Representations of 3D Point Cloudscited by 48
- 2021Improving Mini-batch Optimal Transport via Partial Transportationcited by 41
- 2022Statistical, Robustness, and Computational Guarantees for Sliced Wasserstein Distancescited by 41
- 2023Energy-Based Sliced Wasserstein Distancecited by 39
- 2026Representation Fr'echet Loss for Visual Generationcited by 37
- 2021Wasserstein GANs Work Because They Fail (to Approximate the Wasserstein Distance)cited by 35
- 2021Fast Approximation of the Sliced-Wasserstein Distance Using Concentration of Random Projectionscited by 33
- 2024An Aggregation-Free Federated Learning for Tackling Data Heterogeneitycited by 33
12 most cited of 105 All 105 (JSON)
- 2026From Scores to Samples: Elastic Forcing for Autoregressive Video Generation28 Sep 2026
- 2026Representation Distribution Matching for One-Step Visual Generation2 Jul 2026
- 2026Highly Data Parallelizable Estimation of the Sliced-Wasserstein Distance Using Cumulative Distribution Functions29 Jun 2026
- 2026VISReg: Variance-Invariance-Sketching Regularization for JEPA training1 Jun 2026
- 2026Convergence of empirical subgradients for optimal transport-based objectives27 May 2026
- 2026Sliced Inner Product Gromov-Wasserstein Distances8 May 2026
- 2026Representation Fr'echet Loss for Visual Generation30 Apr 2026
- 2026Can Heterogeneous Language Models Be Fused?2 Apr 2026
- 2026Do Generative Metrics Predict YOLO Performance? An Evaluation Across Models, Augmentation Ratios, and Dataset Complexity20 Feb 2026
- 2026Magnitude Distance: A Geometric Measure of Dataset Similarity9 Feb 2026
- 2026Revisiting the Sliced Wasserstein Kernel for persistence diagrams: a Figalli-Gigli approach6 Feb 2026
- 2026HP-GAN: Harnessing pretrained networks for GAN improvement with FakeTwins and discriminator consistency3 Feb 2026
12 newest of 105 All 105 (JSON)