Adversarial Lipschitz Regularization
Not on the map. Why?
Abstract (arXiv)
Generative adversarial networks (GANs) are one of the most popular approaches when it comes to training generative models, among which variants of Wasserstein GANs are considered superior to the standard GAN formulation in terms of learning stability and sample quality. However, Wasserstein GANs require the critic to be 1-Lipschitz, which is often enforced implicitly by penalizing the norm of its gradient, or by globally restricting its Lipschitz constant via weight normalization techniques. Training with a regularization term penalizing the violation of the Lipschitz constraint explicitly, instead of through the norm of the gradient, was found to be practically infeasible in most situations. Inspired by Virtual Adversarial Training, we propose a method called Adversarial Lipschitz Regularization, and show that using an explicit Lipschitz penalty is indeed viable and leads to competitive performance when applied to Wasserstein GANs, highlighting an important connection between Lipschitz regularization and adversarial training.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 5; 2023: 12; 2024: 3; 2025: 0; 2026: 2.
30 papers.
Sort:
By area:
- 2023Extracting Training Data from Diffusion Modelscited by 732
- 2021Robust Learning Meets Generative Models: Can Proxy Distributions Improve Adversarial Robustness?cited by 113
- 2022Learning Smooth Neural Functions via Lipschitz Regularizationcited by 86
- 2022PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Latticescited by 73
- 2021CLIP: Cheap Lipschitz Training of Neural Networkscited by 29
- 2023Some Fundamental Aspects about Lipschitz Continuity of Neural Networkscited by 26
- 2021Gradient Normalization for Generative Adversarial Networkscited by 25
- 2023Banana: Banach Fixed-Point Network for Pointcloud Segmentation with Inter-Part Equivariancecited by 19
- 2023Improving the Accuracy-Robustness Trade-Off of Classifiers via Adaptive Smoothingcited by 18
- 2023Advancing Bayesian Optimization via Learning Correlated Latent Spacecited by 18
- 2022A Quantitative Geometric Approach to Neural-Network Smoothnesscited by 16
- 2023SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layercited by 14
18 more
- 2023Robust low-rank training via approximate orthonormal constraintscited by 13
- 2021Analytical bounds on the local Lipschitz constants of ReLU networkscited by 12
- 2021Self-Supervised GANs with Label Augmentationcited by 9
- 2021Moreau-Yosida f-divergencescited by 5
- 2024Accelerate Neural Subspace-Based Reduced-Order Solver of Deformable Simulation by Lipschitz Optimizationcited by 5
- 2022GAN-based Domain Inference Attackcited by 4
- 2023Gradient Shaping: Enhancing Backdoor Attack Against Reverse Engineeringcited by 4
- 2024Careful with that Scalpel: Improving Gradient Surgery with an EMAcited by 4
- 2023Data Interpolants -- That's What Discriminators in Higher-order Gradient-regularized GANs Arecited by 2
- 2021Stein Latent Optimization for Generative Adversarial Networkscited by 1
- 2022On Deep Learning in Password Guessing, a Surveycited by 1
- 2026Variation Brownian Kernel Ladderscited by 1
- 2021Variational Autoencoders: A Harmonic Perspectivecited by 0
- 2023Lamarr: LHCb ultra-fast simulation based on machine learning models deployed within Gausscited by 0
- 2023Penalty Gradient Normalization for Generative Adversarial Networkscited by 0
- 2023Stability Analysis Framework for Particle-based Distance GANs with Wasserstein Gradient Flowcited by 0
- 2024DataFreeShield: Defending Adversarial Attacks without Training Datacited by 0
- 2026Dreaming Smoothly and Sample Efficiently with Gradient Penalized Latent Dynamicscited by 0
- 2026Variation Brownian Kernel Ladders14 Aug 2026
- 2026Dreaming Smoothly and Sample Efficiently with Gradient Penalized Latent Dynamics21 May 2026
- 2024Accelerate Neural Subspace-Based Reduced-Order Solver of Deformable Simulation by Lipschitz Optimization5 Sep 2024
- 2024DataFreeShield: Defending Adversarial Attacks without Training Data21 Jun 2024
- 2024Careful with that Scalpel: Improving Gradient Surgery with an EMA5 Feb 2024
- 2023Advancing Bayesian Optimization via Learning Correlated Latent Space31 Oct 2023
- 2023Stability Analysis Framework for Particle-based Distance GANs with Wasserstein Gradient Flow4 Jul 2023
- 2023Penalty Gradient Normalization for Generative Adversarial Networks23 Jun 2023
- 2023Robust low-rank training via approximate orthonormal constraints2 Jun 2023
- 2023Data Interpolants -- That's What Discriminators in Higher-order Gradient-regularized GANs Are1 Jun 2023
- 2023Banana: Banach Fixed-Point Network for Pointcloud Segmentation with Inter-Part Equivariance25 May 2023
- 2023Lamarr: LHCb ultra-fast simulation based on machine learning models deployed within Gauss20 Mar 2023
18 more
- 2023Some Fundamental Aspects about Lipschitz Continuity of Neural Networks21 Feb 2023
- 2023Extracting Training Data from Diffusion Models30 Jan 2023
- 2023SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layer30 Jan 2023
- 2023Improving the Accuracy-Robustness Trade-Off of Classifiers via Adaptive Smoothing29 Jan 2023
- 2023Gradient Shaping: Enhancing Backdoor Attack Against Reverse Engineering29 Jan 2023
- 2022GAN-based Domain Inference Attack22 Dec 2022
- 2022PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Lattices22 Nov 2022
- 2022On Deep Learning in Password Guessing, a Survey22 Aug 2022
- 2022A Quantitative Geometric Approach to Neural-Network Smoothness2 Mar 2022
- 2022Learning Smooth Neural Functions via Lipschitz Regularization16 Feb 2022
- 2021Gradient Normalization for Generative Adversarial Networks6 Sep 2021
- 2021Self-Supervised GANs with Label Augmentation16 Jun 2021
- 2021Stein Latent Optimization for Generative Adversarial Networks9 Jun 2021
- 2021Variational Autoencoders: A Harmonic Perspective31 May 2021
- 2021Analytical bounds on the local Lipschitz constants of ReLU networks29 Apr 2021
- 2021Robust Learning Meets Generative Models: Can Proxy Distributions Improve Adversarial Robustness?19 Apr 2021
- 2021CLIP: Cheap Lipschitz Training of Neural Networks23 Mar 2021
- 2021Moreau-Yosida f-divergences26 Feb 2021
- 2023Extracting Training Data from Diffusion Modelscited by 732
- 2023Extracting Training Data from Diffusion Models30 Jan 2023
- 2021Robust Learning Meets Generative Models: Can Proxy Distributions Improve Adversarial Robustness?cited by 113
- 2022Learning Smooth Neural Functions via Lipschitz Regularizationcited by 86
- 2022PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Latticescited by 73
- 2021CLIP: Cheap Lipschitz Training of Neural Networkscited by 29
- 2023Some Fundamental Aspects about Lipschitz Continuity of Neural Networkscited by 26
- 2021Gradient Normalization for Generative Adversarial Networkscited by 25
- 2023Banana: Banach Fixed-Point Network for Pointcloud Segmentation with Inter-Part Equivariancecited by 19
- 2023Improving the Accuracy-Robustness Trade-Off of Classifiers via Adaptive Smoothingcited by 18
- 2023Advancing Bayesian Optimization via Learning Correlated Latent Spacecited by 18
- 2022A Quantitative Geometric Approach to Neural-Network Smoothnesscited by 16
- 2023SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layercited by 14
- 2023Robust low-rank training via approximate orthonormal constraintscited by 13
12 most cited of 28 All 28 (JSON)
- 2026Variation Brownian Kernel Ladders14 Aug 2026
- 2024Accelerate Neural Subspace-Based Reduced-Order Solver of Deformable Simulation by Lipschitz Optimization5 Sep 2024
- 2024DataFreeShield: Defending Adversarial Attacks without Training Data21 Jun 2024
- 2024Careful with that Scalpel: Improving Gradient Surgery with an EMA5 Feb 2024
- 2023Advancing Bayesian Optimization via Learning Correlated Latent Space31 Oct 2023
- 2023Stability Analysis Framework for Particle-based Distance GANs with Wasserstein Gradient Flow4 Jul 2023
- 2023Penalty Gradient Normalization for Generative Adversarial Networks23 Jun 2023
- 2023Robust low-rank training via approximate orthonormal constraints2 Jun 2023
- 2023Data Interpolants -- That's What Discriminators in Higher-order Gradient-regularized GANs Are1 Jun 2023
- 2023Banana: Banach Fixed-Point Network for Pointcloud Segmentation with Inter-Part Equivariance25 May 2023
- 2023Lamarr: LHCb ultra-fast simulation based on machine learning models deployed within Gauss20 Mar 2023
- 2023Some Fundamental Aspects about Lipschitz Continuity of Neural Networks21 Feb 2023
12 newest of 28 All 28 (JSON)