On gradient regularizers for MMD GANs
Not on the map. Why?
Abstract (arXiv)
We propose a principled method for gradient-based regularization of the critic of GAN-like models trained by adversarially optimizing the kernel of a Maximum Mean Discrepancy (MMD). We show that controlling the gradient of the critic is vital to having a sensible loss function, and devise a method to enforce exact, analytical gradient constraints at no additional cost compared to existing approximate techniques based on additive regularizers. The new loss function is provably continuous, and experiments show that it stabilizes and accelerates training, giving image generation models that outperform state-of-the art methods on 160 × 160 CelebA and 64 × 64 unconditional ImageNet.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 10; 2022: 3; 2023: 5; 2024: 2; 2025: 6; 2026: 1.
28 papers.
Sort:
By area:
- 2021Deep Generative Learning via Schr"odinger Bridgecited by 103
- 2023Optimizing DDPM Sampling with Shortcut Fine-Tuningcited by 81
- 2021Variational Wasserstein gradient flowcited by 53
- 2021RoMA: Robust Model Adaptation for Offline Model-based Optimizationcited by 39
- 2022Why neural networks find simple solutions: the many regularizers of geometric complexitycited by 38
- 2021KALE Flow: A Relaxed KL Gradient Flow for Probabilities with Disjoint Supportcited by 37
- 2020On Computation and Generalization of Generative Adversarial Imitation Learningcited by 27
- 2021Disentangled Recurrent Wasserstein Autoencodercited by 22
- 2024Deep MMD Gradient Flow without adversarial trainingcited by 18
- 2023Differentially Private Neural Tangent Kernels for Privacy-Preserving Data Generationcited by 15
- 2021Controlling Wasserstein Distances by Kernel Norms with Application to Compressive Statistical Learningcited by 13
- 2021The Geometric Occam's Razor Implicit in Deep Learningcited by 7
16 more
- 2022Evaluating Graph Generative Models with Contrastively Learned Featurescited by 5
- 2021DuelGAN: A Duel Between Two Discriminators Stabilizes the GAN Trainingcited by 4
- 2021Adversarially Robust Kernel Smoothingcited by 4
- 2022Multi-level Latent Space Structuring for Generative Controlcited by 4
- 2025Optimality and Adaptivity of Deep Neural Features for Instrumental Variable Regressioncited by 3
- 2026Sobolev Regularized MMD Gradient Flowcited by 3
- 2021Learning High-Dimensional Distributions with Latent Neural Fokker-Planck Kernelscited by 2
- 2023Data Interpolants -- That's What Discriminators in Higher-order Gradient-regularized GANs Arecited by 2
- 2024Learning Representations for Independence Testingcited by 2
- 2025Stationary MMD Pointscited by 2
- 2023Hoeffding's Inequality for Markov Chains under Generalized Concentrability Conditioncited by 1
- 2023Stability Analysis Framework for Particle-based Distance GANs with Wasserstein Gradient Flowcited by 0
- 2025CKGAN: Training Generative Adversarial Networks Using Characteristic Kernel Integral Probability Metricscited by 0
- 2025Smooth Model Compression without Fine-Tuningcited by 0
- 2025Exploring Image Generation via Mutually Exclusive Probability Spaces and Local Correlation Hypothesiscited by 0
- 2025Adaptive generative moment matching networks for improved learning of dependence structurescited by 0
- 2026Sobolev Regularized MMD Gradient Flow12 May 2026
- 2025Adaptive generative moment matching networks for improved learning of dependence structures29 Aug 2025
- 2025Exploring Image Generation via Mutually Exclusive Probability Spaces and Local Correlation Hypothesis26 Jun 2025
- 2025Smooth Model Compression without Fine-Tuning30 May 2025
- 2025Stationary MMD Points27 May 2025
- 2025CKGAN: Training Generative Adversarial Networks Using Characteristic Kernel Integral Probability Metrics8 Apr 2025
- 2025Optimality and Adaptivity of Deep Neural Features for Instrumental Variable Regression9 Jan 2025
- 2024Learning Representations for Independence Testing10 Sep 2024
- 2024Deep MMD Gradient Flow without adversarial training10 May 2024
- 2023Hoeffding's Inequality for Markov Chains under Generalized Concentrability Condition4 Oct 2023
- 2023Stability Analysis Framework for Particle-based Distance GANs with Wasserstein Gradient Flow4 Jul 2023
- 2023Data Interpolants -- That's What Discriminators in Higher-order Gradient-regularized GANs Are1 Jun 2023
16 more
- 2023Differentially Private Neural Tangent Kernels for Privacy-Preserving Data Generation3 Mar 2023
- 2023Optimizing DDPM Sampling with Shortcut Fine-Tuning31 Jan 2023
- 2022Why neural networks find simple solutions: the many regularizers of geometric complexity27 Sep 2022
- 2022Evaluating Graph Generative Models with Contrastively Learned Features13 Jun 2022
- 2022Multi-level Latent Space Structuring for Generative Control11 Feb 2022
- 2021Variational Wasserstein gradient flow4 Dec 2021
- 2021Controlling Wasserstein Distances by Kernel Norms with Application to Compressive Statistical Learning1 Dec 2021
- 2021The Geometric Occam's Razor Implicit in Deep Learning30 Nov 2021
- 2021RoMA: Robust Model Adaptation for Offline Model-based Optimization27 Oct 2021
- 2021Deep Generative Learning via Schr"odinger Bridge19 Jun 2021
- 2021KALE Flow: A Relaxed KL Gradient Flow for Probabilities with Disjoint Support16 Jun 2021
- 2021Learning High-Dimensional Distributions with Latent Neural Fokker-Planck Kernels10 May 2021
- 2021Adversarially Robust Kernel Smoothing16 Feb 2021
- 2021DuelGAN: A Duel Between Two Discriminators Stabilizes the GAN Training19 Jan 2021
- 2021Disentangled Recurrent Wasserstein Autoencoder19 Jan 2021
- 2020On Computation and Generalization of Generative Adversarial Imitation Learning9 Jan 2020
- 2023Optimizing DDPM Sampling with Shortcut Fine-Tuningcited by 81
- 2023Optimizing DDPM Sampling with Shortcut Fine-Tuning31 Jan 2023
- 2021Deep Generative Learning via Schr"odinger Bridgecited by 103
- 2021Variational Wasserstein gradient flowcited by 53
- 2021RoMA: Robust Model Adaptation for Offline Model-based Optimizationcited by 39
- 2022Why neural networks find simple solutions: the many regularizers of geometric complexitycited by 38
- 2021KALE Flow: A Relaxed KL Gradient Flow for Probabilities with Disjoint Supportcited by 37
- 2021Disentangled Recurrent Wasserstein Autoencodercited by 22
- 2024Deep MMD Gradient Flow without adversarial trainingcited by 18
- 2023Differentially Private Neural Tangent Kernels for Privacy-Preserving Data Generationcited by 15
- 2021Controlling Wasserstein Distances by Kernel Norms with Application to Compressive Statistical Learningcited by 13
- 2021The Geometric Occam's Razor Implicit in Deep Learningcited by 7
- 2022Evaluating Graph Generative Models with Contrastively Learned Featurescited by 5
- 2021DuelGAN: A Duel Between Two Discriminators Stabilizes the GAN Trainingcited by 4
12 most cited of 26 All 26 (JSON)
- 2026Sobolev Regularized MMD Gradient Flow12 May 2026
- 2025Adaptive generative moment matching networks for improved learning of dependence structures29 Aug 2025
- 2025Exploring Image Generation via Mutually Exclusive Probability Spaces and Local Correlation Hypothesis26 Jun 2025
- 2025Smooth Model Compression without Fine-Tuning30 May 2025
- 2025Stationary MMD Points27 May 2025
- 2025CKGAN: Training Generative Adversarial Networks Using Characteristic Kernel Integral Probability Metrics8 Apr 2025
- 2025Optimality and Adaptivity of Deep Neural Features for Instrumental Variable Regression9 Jan 2025
- 2024Learning Representations for Independence Testing10 Sep 2024
- 2024Deep MMD Gradient Flow without adversarial training10 May 2024
- 2023Hoeffding's Inequality for Markov Chains under Generalized Concentrability Condition4 Oct 2023
- 2023Stability Analysis Framework for Particle-based Distance GANs with Wasserstein Gradient Flow4 Jul 2023
- 2023Data Interpolants -- That's What Discriminators in Higher-order Gradient-regularized GANs Are1 Jun 2023
12 newest of 26 All 26 (JSON)