Stabilizing Training of Generative Adversarial Networks through Regularization
Not on the map. Why?
Abstract (arXiv)
Deep generative models based on Generative Adversarial Networks (GANs) have demonstrated impressive sample quality but in order to work they require a careful choice of architecture, parameter initialization, and selection of hyper-parameters. This fragility is in part due to a dimensional mismatch or non-overlapping support between the model distribution and the data distribution, causing their density ratio and the associated f-divergence to be undefined. We overcome this fundamental limitation and propose a new regularization approach with low computational cost that yields a stable GAN training procedure. We demonstrate the effectiveness of this regularizer across several architectures trained on common benchmark image generation tasks. Our regularization turns GAN models into reliable building blocks for deep learning.
Key facts. Cited by 118 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 2; 2021: 34; 2022: 22; 2023: 20; 2024: 16; 2025: 15; 2026: 9.
118 papers.
Sort:
By area:
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 203
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
- 2021Regularizing Generative Adversarial Networks under Limited Datacited by 105
- 2021Towards Principled Disentanglement for Domain Generalizationcited by 91
- 2021Generative Models as Distributions of Functionscited by 89
- 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 84
- 2020Predicting Goal-directed Human Attention Using Inverse Reinforcement Learningcited by 53
- 2021Text to Image Generation with Semantic-Spatial Aware GANcited by 53
- 2021Deceive D: Adaptive Pseudo Augmentation for GAN Training with Limited Datacited by 53
- 2023Better Generative Replay for Continual Federated Learningcited by 53
- 20213D Shape Generation with Grid-based Implicit Functionscited by 48
38 more
- 2023Class-Balancing Diffusion Modelscited by 47
- 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Trainingcited by 45
- 2022Modeling Image Composition for Complex Scene Generationcited by 43
- 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 43
- 2021Context-Aware Layout to Image Generation with Enhanced Object Appearancecited by 41
- 2023Generative Modeling through the Semi-dual Formulation of Unbalanced Optimal Transportcited by 39
- 2022Achieving Fairness at No Utility Cost via Data Reweighing with Influencecited by 38
- 2021EigenGAN: Layer-Wise Eigen-Learning for GANscited by 34
- 2023Free Lunch for Domain Adversarial Training: Environment Label Smoothingcited by 33
- 2021Statistical Analysis of Wasserstein Distributionally Robust Estimatorscited by 27
- 2024Training Unbiased Diffusion Models From Biased Datasetcited by 25
- 2021Disentangled Recurrent Wasserstein Autoencodercited by 22
- 2024Scalable Wasserstein Gradient Flow for Generative Modeling through Unbalanced Optimal Transportcited by 22
- 2021Representing 3D Shapes with Probabilistic Directed Distance Fieldscited by 21
- 2024Diffusive Gibbs Samplingcited by 21
- 2022SpoofGAN: Synthetic Fingerprint Spoof Imagescited by 17
- 2020Lipschitzness Is All You Need To Tame Off-policy Generative Adversarial Imitation Learningcited by 15
- 2021Manifold Learning Benefits GANscited by 14
- 2021Learning quantum data with the quantum Earth Mover's distancecited by 13
- 2021A review of Generative Adversarial Networks (GANs) and its applications in a wide variety of disciplines -- From Medical to Remote Sensingcited by 13
- 2022AHP: Learning to Negative Sample for Hyperedge Predictioncited by 12
- 2025Adversarial Flow Modelscited by 10
- 2022Non-Iterative Recovery from Nonlinear Observations using Generative Modelscited by 9
- 2023PPGenCDR: A Stable and Robust Framework for Privacy-Preserving Cross-Domain Recommendationcited by 9
- 2021Solving Min-Max Optimization with Hidden Structure via Gradient Descent Ascentcited by 8
- 2022Generalization Metrics for Practical Quantum Advantage in Generative Modelscited by 8
- 2022Interpretability Guarantees with Merlin-Arthur Classifierscited by 8
- 2023Nash Equilibria, Regularization and Computation in Optimal Transport-Based Distributionally Robust Optimizationcited by 8
- 2023Analyzing and Improving Optimal-Transport-based Adversarial Networkscited by 8
- 2025DiffRatio: Training One-Step Diffusion Models Without Teacher Supervisioncited by 8
- 2022Generator Knows What Discriminator Should Learn in Unconditional GANscited by 7
- 2022DigGAN: Discriminator gradIent Gap Regularization for GAN Training with Limited Datacited by 7
- 2024Improving Neural Optimal Transport via Displacement Interpolationcited by 7
- 2025MoGAN: Improving Motion Quality in Video Diffusion via Few-Step Motion Adversarial Post-Trainingcited by 7
- 2023Matching aggregate posteriors in the variational autoencodercited by 6
- 2023On the Noise Scheduling for Generating Plausible Designs with Diffusion Modelscited by 6
- 2021Generative Convolution Layer for Image Generationcited by 5
- 2022Evaluating Graph Generative Models with Contrastively Learned Featurescited by 5
50 most cited of 118 All 118 (JSON)
- 2026Multi-Dataset Inverse Problem Solving with Distributed Generative AI26 Aug 2026
- 2026Guidance for Prior Change via Density Ratio Estimation22 Aug 2026
- 2026Lens: Rethinking Training Efficiency for Foundational Text-to-Image Models20 May 2026
- 2026Sobolev Regularized MMD Gradient Flow12 May 2026
- 2026Continuous Adversarial Flow Models13 Apr 2026
- 2026Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolution6 Mar 2026
- 2026Learning To Sample From Diffusion Models Via Inverse Reinforcement Learning9 Feb 2026
- 2026HP-GAN: Harnessing pretrained networks for GAN improvement with FakeTwins and discriminator consistency3 Feb 2026
- 2026Stabilizing the Q-Gradient Field for Policy Smoothness in Actor-Critic Methods30 Jan 2026
- 2025Experts-Guided Unbalanced Optimal Transport for ISP Learning from Unpaired and/or Paired Data5 Dec 2025
- 2025SpriteHand: Real-Time Versatile Hand-Object Interaction with Autoregressive Video Generation1 Dec 2025
- 2025Adversarial Flow Models27 Nov 2025
38 more
- 2025MoGAN: Improving Motion Quality in Video Diffusion via Few-Step Motion Adversarial Post-Training26 Nov 2025
- 2025Distribution Matching Distillation Meets Reinforcement Learning17 Nov 2025
- 2025Beyond Data Scarcity Optimizing R3GAN for Medical Image Generation from Small Datasets29 Oct 2025
- 2025Bridging GANs and Bayesian Neural Networks via Partial Stochasticity1 Jul 2025
- 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generation11 Jun 2025
- 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Training5 Jun 2025
- 2025Boosting Statistic Learning with Synthetic Data from Pretrained Large Models8 May 2025
- 2025Unsupervised Anomaly Detection in Multivariate Time Series across Heterogeneous Domains29 Mar 2025
- 2025Generative Adversarial Networks for High-Dimensional Item Factor Analysis: A Deep Adversarial Learning Algorithm15 Feb 2025
- 2025DiffRatio: Training One-Step Diffusion Models Without Teacher Supervision11 Feb 2025
- 2025Nested Annealed Training Scheme for Generative Adversarial Networks20 Jan 2025
- 2025Diffusion Adversarial Post-Training for One-Step Video Generation14 Jan 2025
- 2024Soft Diamond Regularizers for Deep Learning30 Dec 2024
- 2024Stylish and Functional: Guided Interpolation Subject to Physical Constraints20 Dec 2024
- 2024Imitation from Diverse Behaviors: Wasserstein Quality Diversity Imitation Learning with Single-Step Archive Exploration11 Nov 2024
- 2024Scaling-based Data Augmentation for Generative Models and its Theoretical Extension28 Oct 2024
- 2024Improving Neural Optimal Transport via Displacement Interpolation3 Oct 2024
- 2024Unsupervised Point Cloud Completion through Unbalanced Optimal Transport3 Oct 2024
- 2024CLoG: Benchmarking Continual Learning of Image Generation Models7 Jun 2024
- 2024Does Diffusion Beat GAN in Image Super Resolution?27 May 2024
- 2024Probabilistic Directed Distance Fields for Ray-Based Shape Representations13 Apr 2024
- 2024CHAIN: Enhancing Generalization in Data-Efficient GANs via lipsCHitz continuity constrAIned Normalization31 Mar 2024
- 2024Training Unbiased Diffusion Models From Biased Dataset2 Mar 2024
- 2024Training Class-Imbalanced Diffusion Model Via Overlap Optimization16 Feb 2024
- 2024Scalable Wasserstein Gradient Flow for Generative Modeling through Unbalanced Optimal Transport8 Feb 2024
- 2024Diffusive Gibbs Sampling5 Feb 2024
- 2024Alpha-divergence loss function for neural density ratio estimation3 Feb 2024
- 2024Representation Learning of Multivariate Time Series using Attention and Adversarial Training3 Jan 2024
- 2023D3A-TS: Denoising-Driven Data Augmentation in Time Series9 Dec 2023
- 2023On the Noise Scheduling for Generating Plausible Designs with Diffusion Models19 Nov 2023
- 2023Matching aggregate posteriors in the variational autoencoder13 Nov 2023
- 2023MCRAGE: Synthetic Healthcare Data for Fairness27 Oct 2023
- 2023Training Image Derivatives: Increased Accuracy and Universal Robustness21 Oct 2023
- 2023Analyzing and Improving Optimal-Transport-based Adversarial Networks4 Oct 2023
- 2023Statistically Optimal Generative Modeling with Maximum Deviation from the Empirical Distribution31 Jul 2023
- 2023Synthesis of Batik Motifs using a Diffusion -- Generative Adversarial Network22 Jul 2023
- 2023Adversarial Latent Autoencoder with Self-Attention for Structural Image Synthesis19 Jul 2023
- 2023Stability Analysis Framework for Particle-based Distance GANs with Wasserstein Gradient Flow4 Jul 2023
50 newest of 118 All 118 (JSON)
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
- 2023Class-Balancing Diffusion Modelscited by 47
- 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Trainingcited by 45
- 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 43
- 2024Training Unbiased Diffusion Models From Biased Datasetcited by 25
- 2025DiffRatio: Training One-Step Diffusion Models Without Teacher Supervisioncited by 8
- 2025MoGAN: Improving Motion Quality in Video Diffusion via Few-Step Motion Adversarial Post-Trainingcited by 7
- 2023On the Noise Scheduling for Generating Plausible Designs with Diffusion Modelscited by 6
- 2024Training Class-Imbalanced Diffusion Model Via Overlap Optimizationcited by 5
- 2026Continuous Adversarial Flow Modelscited by 4
- 2023MCRAGE: Synthetic Healthcare Data for Fairnesscited by 1
- 2026Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolutioncited by 1
12 most cited of 16 All 16 (JSON)
- 2026Continuous Adversarial Flow Models13 Apr 2026
- 2026Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolution6 Mar 2026
- 2026Learning To Sample From Diffusion Models Via Inverse Reinforcement Learning9 Feb 2026
- 2025MoGAN: Improving Motion Quality in Video Diffusion via Few-Step Motion Adversarial Post-Training26 Nov 2025
- 2025Distribution Matching Distillation Meets Reinforcement Learning17 Nov 2025
- 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Training5 Jun 2025
- 2025Boosting Statistic Learning with Synthetic Data from Pretrained Large Models8 May 2025
- 2025DiffRatio: Training One-Step Diffusion Models Without Teacher Supervision11 Feb 2025
- 2025Nested Annealed Training Scheme for Generative Adversarial Networks20 Jan 2025
- 2025Diffusion Adversarial Post-Training for One-Step Video Generation14 Jan 2025
- 2024Training Unbiased Diffusion Models From Biased Dataset2 Mar 2024
- 2024Training Class-Imbalanced Diffusion Model Via Overlap Optimization16 Feb 2024
12 newest of 16 All 16 (JSON)
- 2020Predicting Goal-directed Human Attention Using Inverse Reinforcement Learningcited by 53
- 2020Lipschitzness Is All You Need To Tame Off-policy Generative Adversarial Imitation Learningcited by 15
- 2024Imitation from Diverse Behaviors: Wasserstein Quality Diversity Imitation Learning with Single-Step Archive Explorationcited by 4
- 2022Safe Imitation Learning of Nonlinear Model Predictive Control for Flexible Robotscited by 3
- 2024Imitation from Diverse Behaviors: Wasserstein Quality Diversity Imitation Learning with Single-Step Archive Exploration11 Nov 2024
- 2022Safe Imitation Learning of Nonlinear Model Predictive Control for Flexible Robots6 Dec 2022
- 2020Lipschitzness Is All You Need To Tame Off-policy Generative Adversarial Imitation Learning28 Jun 2020
- 2020Predicting Goal-directed Human Attention Using Inverse Reinforcement Learning28 May 2020
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 203
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
- 2021Regularizing Generative Adversarial Networks under Limited Datacited by 105
- 2021Towards Principled Disentanglement for Domain Generalizationcited by 91
- 2021Generative Models as Distributions of Functionscited by 89
- 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 84
- 2021Text to Image Generation with Semantic-Spatial Aware GANcited by 53
- 2021Deceive D: Adaptive Pseudo Augmentation for GAN Training with Limited Datacited by 53
- 2023Better Generative Replay for Continual Federated Learningcited by 53
- 20213D Shape Generation with Grid-based Implicit Functionscited by 48
- 2022Modeling Image Composition for Complex Scene Generationcited by 43
- 2021Context-Aware Layout to Image Generation with Enhanced Object Appearancecited by 41
12 most cited of 98 All 98 (JSON)
- 2026Multi-Dataset Inverse Problem Solving with Distributed Generative AI26 Aug 2026
- 2026Guidance for Prior Change via Density Ratio Estimation22 Aug 2026
- 2026Lens: Rethinking Training Efficiency for Foundational Text-to-Image Models20 May 2026
- 2026Sobolev Regularized MMD Gradient Flow12 May 2026
- 2026HP-GAN: Harnessing pretrained networks for GAN improvement with FakeTwins and discriminator consistency3 Feb 2026
- 2026Stabilizing the Q-Gradient Field for Policy Smoothness in Actor-Critic Methods30 Jan 2026
- 2025Experts-Guided Unbalanced Optimal Transport for ISP Learning from Unpaired and/or Paired Data5 Dec 2025
- 2025SpriteHand: Real-Time Versatile Hand-Object Interaction with Autoregressive Video Generation1 Dec 2025
- 2025Adversarial Flow Models27 Nov 2025
- 2025Beyond Data Scarcity Optimizing R3GAN for Medical Image Generation from Small Datasets29 Oct 2025
- 2025Bridging GANs and Bayesian Neural Networks via Partial Stochasticity1 Jul 2025
- 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generation11 Jun 2025
12 newest of 98 All 98 (JSON)