Max-Sliced Wasserstein Distance and its use for GANs
Not on the map. Why?
Abstract (arXiv)
Generative adversarial nets (GANs) and variational auto-encoders have significantly improved our distribution modeling capabilities, showing promise for dataset augmentation, image-to-image translation and feature learning. However, to model high-dimensional distributions, sequential training and stacked architectures are common, increasing the number of tunable hyper-parameters as well as the training time. Nonetheless, the sample complexity of the distance metrics remains one of the factors affecting GAN training. We first show that the recently proposed sliced Wasserstein distance has compelling sample complexity properties when compared to the Wasserstein distance. To further improve the sliced Wasserstein distance we then analyze its `projection complexity' and develop the max-sliced Wasserstein distance which enjoys compelling sample complexity while reducing projection complexity, albeit necessitating a max estimation. We finally illustrate that the proposed distance trains GANs on high-dimensional images up to a resolution of 256x256 easily.
Key facts. Cited by 118 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 20; 2023: 25; 2024: 24; 2025: 18; 2026: 11.
118 papers.
Sort:
By area:
- 2022Tutorial on amortized optimizationcited by 83
- 2023Recent Advances in Optimal Transport for Machine Learningcited by 66
- 2022Generative Multiplane Images: Making a 2D GAN 3D-Awarecited by 57
- 2021Point-set Distances for Learning Representations of 3D Point Cloudscited by 48
- 2022Statistical, Robustness, and Computational Guarantees for Sliced Wasserstein Distancescited by 41
- 2021Improving Mini-batch Optimal Transport via Partial Transportationcited by 40
- 2023Energy-Based Sliced Wasserstein Distancecited by 39
- 2021Fast Approximation of the Sliced-Wasserstein Distance Using Concentration of Random Projectionscited by 33
- 2022Spherical Sliced-Wassersteincited by 31
- 20213D Pose Transfer with Correspondence Learning and Mesh Refinementcited by 30
- 2022Meta Optimal Transportcited by 28
- 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Surveycited by 27
38 more
- 2022Revisiting Sliced Wasserstein on Images: From Vectorization to Convolutioncited by 25
- 2022Hierarchical Sliced Wasserstein Distancecited by 23
- 2023Beyond Statistical Similarity: Rethinking Metrics for Deep Generative Models in Engineering Designcited by 22
- 2021Efficient Gradient Flows in Sliced-Wasserstein Spacecited by 21
- 2022Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstructioncited by 21
- 2022Sliced Optimal Partial Transportcited by 19
- 2022Distribution Regression with Sliced Wasserstein Kernelscited by 18
- 2022Amortized Projection Optimization for Sliced Wasserstein Generative Modelscited by 17
- 2023Monge, Bregman and Occam: Interpretable Optimal Transport in High-Dimensions with Feature-Sparse Mapscited by 16
- 2021Smooth p-Wasserstein Distance: Structure, Empirical Approximation, and Statistical Applicationscited by 15
- 2021On Transportation of Mini-batches: A Hierarchical Approachcited by 15
- 2023Nonparametric Generative Modeling with Conditional Sliced-Wasserstein Flowscited by 15
- 2024Sliced Wasserstein with Random-Path Projecting Directionscited by 15
- 2023SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layercited by 14
- 2024A Practical Guide to Sample-based Statistical Distances for Evaluating Generative Models in Sciencecited by 14
- 2021Entropic Gromov-Wasserstein between Gaussian Distributionscited by 12
- 2022Efficient Approximation of Gromov-Wasserstein Distance Using Importance Sparsificationcited by 11
- 2023Markovian Sliced Wasserstein Distances: Beyond Independent Projectionscited by 11
- 2024Efficient Prior Calibration From Indirect Datacited by 11
- 2021Supervised Tree-Wasserstein Distancecited by 10
- 2021Fixed Support Tree-Sliced Wasserstein Barycentercited by 10
- 2023Max-Sliced Mutual Informationcited by 10
- 2024Sharp bounds for max-sliced Wasserstein distancescited by 10
- 2025ESPFormer: Doubly-Stochastic Attention with Expected Sliced Transport Planscited by 10
- 2025Color Conditional Generation with Sliced Wasserstein Guidancecited by 10
- 2022Hilbert Curve Projection Distance for Distribution Comparisoncited by 9
- 2022One Loss for Quantization: Deep Hashing with Discrete Wasserstein Distributional Matchingcited by 9
- 2022Approximating 1-Wasserstein Distance with Treescited by 9
- 2024Accelerating Sinkhorn Algorithm with Sparse Newton Iterationscited by 9
- 2024Validating Climate Models with Spherical Convolutional Wasserstein Distancecited by 9
- 2021Manifold optimization for non-linear optimal transport problemscited by 8
- 2023Lidar Upsampling with Sliced Wasserstein Distancecited by 8
- 2023Structured Transforms Across Spaces with Cost-Regularized Optimal Transportcited by 8
- 2024Privacy-preserving data release leveraging optimal transport and particle gradient descentcited by 8
- 2024Sliced-Wasserstein Estimation with Spherical Harmonics as Control Variatescited by 8
- 2024Quantum State Generation with Structure-Preserving Diffusion Modelcited by 8
- 2024Time-Causal VAE: Robust Financial Time Series Generatorcited by 8
- 2026Image Generation with a Sphere Encodercited by 8
50 most cited of 118 All 118 (JSON)
- 2026Linear Independent Component Analysis via Optimal Transport15 Jul 2026
- 2026Mind the Residual Gap: Probabilistic Downscaling under Real-World Bias29 Jun 2026
- 2026Highly Data Parallelizable Estimation of the Sliced-Wasserstein Distance Using Cumulative Distribution Functions29 Jun 2026
- 2026Adjusted Wasserstein distances for bridging empirical and true distributions with applications to MDS29 Jun 2026
- 2026Sliced Inner Product Gromov-Wasserstein Distances8 May 2026
- 2026SRRM: Improving Recursive Transport Surrogates in the Small-Discrepancy Regime19 Mar 2026
- 2026Image Generation with a Sphere Encoder16 Feb 2026
- 2026Convergence Rates for Distribution Matching with Sliced Optimal Transport11 Feb 2026
- 2026Revisiting the Sliced Wasserstein Kernel for persistence diagrams: a Figalli-Gigli approach6 Feb 2026
- 2026Approximating f-Divergences with Rank Statistics30 Jan 2026
- 2026Sliced-Wasserstein Distribution Alignment Loss Improves the Ultra-Low-Bit Quantization of Large Language Models11 Jan 2026
- 2025Minimax-Optimal Two-Sample Test with Sliced Wasserstein31 Oct 2025
38 more
- 2025ReSWD: ReSTIR'd, not shaken. Combining Reservoir Sampling and Sliced Wasserstein Distance for Variance Reduction1 Oct 2025
- 2025Fast Estimation of Wasserstein Distances via Regression on Sliced Wasserstein Distances24 Sep 2025
- 2025Hierarchical Rectified Flow Matching with Mini-Batch Couplings17 Jul 2025
- 2025Relation-Aware Slicing in Cross-Domain Alignment17 Jul 2025
- 2025CLOT: Closed Loop Optimal Transport for Unsupervised Action Segmentation4 Jul 2025
- 2025Weakly Supervised Object Segmentation by Background Conditional Divergence25 Jun 2025
- 2025Machine-Learning-Assisted Photonic Device Development: A Multiscale Approach from Theory to Characterization24 Jun 2025
- 2025Constrained Sliced Wasserstein Embedding2 Jun 2025
- 2025Differentiable Generalized Sliced Wasserstein Plans28 May 2025
- 2025Streaming Sliced Optimal Transport11 May 2025
- 2025Tree-Sliced Wasserstein Distance with Nonlinear Projection2 May 2025
- 2025Slicing the Gaussian Mixture Wasserstein Distance11 Apr 2025
- 2025Color Conditional Generation with Sliced Wasserstein Guidance24 Mar 2025
- 2025Fast rigid alignment of heterogeneous images in sliced Wasserstein distance17 Mar 2025
- 2025Distance-Based Tree-Sliced Wasserstein Distance14 Mar 2025
- 2025ESPFormer: Doubly-Stochastic Attention with Expected Sliced Transport Plans11 Feb 2025
- 2025Towards Understanding Gradient Dynamics of the Sliced-Wasserstein Distance via Critical Point Analysis10 Feb 2025
- 2024Time-Causal VAE: Robust Financial Time Series Generator5 Nov 2024
- 2024Robust training of implicit generative models for multivariate and heavy-tailed distributions with an invariant statistical loss29 Oct 2024
- 2024Off-Policy Reinforcement Learning with High Dimensional Reward14 Aug 2024
- 2024Tree-Sliced Wasserstein Distance: A Geometric Perspective19 Jun 2024
- 2024Linkage on Security, Privacy and Fairness in Federated Learning: New Balances and New Perspectives16 Jun 2024
- 2024LaCoOT: Layer Collapse through Optimal Transport13 Jun 2024
- 2024Efficient Prior Calibration From Indirect Data28 May 2024
- 2024Canonical Variates in Wasserstein Metric Space24 May 2024
- 2024Statistical and Computational Guarantees of Kernel Max-Sliced Wasserstein Distances24 May 2024
- 2024Max-sliced Wasserstein concentration and uniform ratio bounds of empirical measures on RKHS21 May 2024
- 2024Hierarchical Hybrid Sliced Wasserstein: A Scalable Metric for Heterogeneous Joint Distributions23 Apr 2024
- 2024Quantum State Generation with Structure-Preserving Diffusion Model9 Apr 2024
- 2024Gaussian-Smoothed Sliced Probability Divergences4 Apr 2024
- 2024A Practical Guide to Sample-based Statistical Distances for Evaluating Generative Models in Science19 Mar 2024
- 2024A Sinkhorn-type Algorithm for Constrained Optimal Transport8 Mar 2024
- 2024Sharp bounds for max-sliced Wasserstein distances1 Mar 2024
- 2024DeepDRK: Deep Dependency Regularized Knockoff for Feature Selection27 Feb 2024
- 2024A Class of Topological Pseudodistances for Fast Comparison of Persistence Diagrams22 Feb 2024
- 2024Gaussian process regression with Sliced Wasserstein Weisfeiler-Lehman graph kernels6 Feb 2024
- 2024Sliced-Wasserstein Estimation with Spherical Harmonics as Control Variates2 Feb 2024
- 2024Privacy-preserving data release leveraging optimal transport and particle gradient descent31 Jan 2024
50 newest of 118 All 118 (JSON)
- 2023Beyond Statistical Similarity: Rethinking Metrics for Deep Generative Models in Engineering Designcited by 22
- 2024Quantum State Generation with Structure-Preserving Diffusion Modelcited by 8
- 2026Image Generation with a Sphere Encodercited by 8
- 2025Hierarchical Rectified Flow Matching with Mini-Batch Couplingscited by 6
- 2026Image Generation with a Sphere Encoder16 Feb 2026
- 2025Hierarchical Rectified Flow Matching with Mini-Batch Couplings17 Jul 2025
- 2024Quantum State Generation with Structure-Preserving Diffusion Model9 Apr 2024
- 2023Beyond Statistical Similarity: Rethinking Metrics for Deep Generative Models in Engineering Design6 Feb 2023
- 2022Tutorial on amortized optimizationcited by 83
- 2023Recent Advances in Optimal Transport for Machine Learningcited by 66
- 2022Generative Multiplane Images: Making a 2D GAN 3D-Awarecited by 57
- 2021Point-set Distances for Learning Representations of 3D Point Cloudscited by 48
- 2022Statistical, Robustness, and Computational Guarantees for Sliced Wasserstein Distancescited by 41
- 2021Improving Mini-batch Optimal Transport via Partial Transportationcited by 40
- 2023Energy-Based Sliced Wasserstein Distancecited by 39
- 2021Fast Approximation of the Sliced-Wasserstein Distance Using Concentration of Random Projectionscited by 33
- 2022Spherical Sliced-Wassersteincited by 31
- 20213D Pose Transfer with Correspondence Learning and Mesh Refinementcited by 30
- 2022Meta Optimal Transportcited by 28
- 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Surveycited by 27
12 most cited of 114 All 114 (JSON)
- 2026Linear Independent Component Analysis via Optimal Transport15 Jul 2026
- 2026Mind the Residual Gap: Probabilistic Downscaling under Real-World Bias29 Jun 2026
- 2026Highly Data Parallelizable Estimation of the Sliced-Wasserstein Distance Using Cumulative Distribution Functions29 Jun 2026
- 2026Adjusted Wasserstein distances for bridging empirical and true distributions with applications to MDS29 Jun 2026
- 2026Sliced Inner Product Gromov-Wasserstein Distances8 May 2026
- 2026SRRM: Improving Recursive Transport Surrogates in the Small-Discrepancy Regime19 Mar 2026
- 2026Convergence Rates for Distribution Matching with Sliced Optimal Transport11 Feb 2026
- 2026Revisiting the Sliced Wasserstein Kernel for persistence diagrams: a Figalli-Gigli approach6 Feb 2026
- 2026Approximating f-Divergences with Rank Statistics30 Jan 2026
- 2026Sliced-Wasserstein Distribution Alignment Loss Improves the Ultra-Low-Bit Quantization of Large Language Models11 Jan 2026
- 2025Minimax-Optimal Two-Sample Test with Sliced Wasserstein31 Oct 2025
- 2025ReSWD: ReSTIR'd, not shaken. Combining Reservoir Sampling and Sliced Wasserstein Distance for Variance Reduction1 Oct 2025
12 newest of 114 All 114 (JSON)