Towards Principled Methods for Training Generative Adversarial Networks
Not on the map. Why?
Cited by 55 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
The goal of this paper is not to introduce a single algorithm or method, but to make theoretical steps towards fully understanding the training dynamics of generative adversarial networks. In order to substantiate our theoretical analysis, we perform targeted experiments to verify our assumptions, illustrate our claims, and quantify the phenomena. This paper is divided into three sections. The first section introduces the problem at hand. The second section is dedicated to studying and proving rigorously the problems including instability and saturation that arize when training generative adversarial networks. The third section examines a practical and theoretically grounded direction towards solving these problems, while introducing new tools to study them.
Key facts. Cited by 464 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Jan 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 2; 2019: 1; 2020: 5; 2021: 126; 2022: 100; 2023: 80; 2024: 63; 2025: 52; 2026: 35.
464 papers.
Sort:
By area:
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
- 2021Projected GANs Converge Fastercited by 208
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
- 2021ST++: Make Self-training Work Better for Semi-supervised Semantic Segmentationcited by 184
- 2022Correct-N-Contrast: A Contrastive Approach for Improving Robustness to Spurious Correlationscited by 172
- 2021A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challengescited by 154
- 2023A Survey of Imitation Learning: Algorithms, Recent Developments, and Challengescited by 148
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 144
- 2023Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generationcited by 142
- 2021Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesiscited by 140
38 more
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusioncited by 127
- 2022Differentially Private Diffusion Modelscited by 119
- 2018Variational Discriminator Bottleneck: Improving Imitation Learning, Inverse RL, and GANs by Constraining Information Flowcited by 105
- 2021Deep Generative Models in Engineering Design: A Reviewcited by 105
- 2021An Introduction to Deep Generative Modelingcited by 104
- 2021Generative Modeling with Optimal Transport Mapscited by 82
- 2023NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Modelscited by 76
- 2021Enhancing Photorealism Enhancementcited by 74
- 2020Fighting Copycat Agents in Behavioral Cloning from Observation Historiescited by 71
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
- 2021Risk-Averse Offline Reinforcement Learningcited by 65
- 2021GANs for Medical Image Synthesis: An Empirical Studycited by 65
- 2021Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regressioncited by 58
- 2021Data-Efficient Instance Generation from Instance Discriminationcited by 58
- 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
- 2021Rebooting ACGAN: Auxiliary Classifier GANs with Stable Trainingcited by 57
- 2022High-resolution Face Swapping via Latent Semantics Disentanglementcited by 57
- 2021Don't Generate Me: Training Differentially Private Generative Models with Sinkhorn Divergencecited by 54
- 2021Deceive D: Adaptive Pseudo Augmentation for GAN Training with Limited Datacited by 53
- 2022Entropic Neural Optimal Transport via Diffusion Processescited by 50
- 2023Vector Quantized Time Series Generation with a Bidirectional Prior Modelcited by 50
- 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 50
- 2023Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Modelscited by 49
- 2021Adversarially Guided Actor-Criticcited by 47
- 2021Posterior Meta-Replay for Continual Learningcited by 45
- 2022Learning Agile Skills via Adversarial Imitation of Rough Partial Demonstrationscited by 45
- 2023Instant3D: Instant Text-to-3D Generationcited by 45
- 2024Exploring Diverse Methods in Visual Question Answeringcited by 45
- 2025Dataset Distillation with Neural Characteristic Function: A Minmax Perspectivecited by 45
- 2023Identifying Spurious Biases Early in Training through the Lens of Simplicity Biascited by 44
- 2022Modeling Image Composition for Complex Scene Generationcited by 43
- 2019Random Expert Distillation: Imitation Learning via Expert Policy Support Estimationcited by 42
- 2022Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoderscited by 42
- 2021Context-Aware Layout to Image Generation with Enhanced Object Appearancecited by 41
- 2022Data Augmentation techniques in time series domain: A survey and taxonomycited by 41
- 2022Can Push-forward Generative Models Fit Multimodal Distributions?cited by 41
- 2024Language Generation in the Limitcited by 40
50 most cited of 464 All 464 (JSON)
- 2026Domain-informed Adaptive Sampling for Generalizable PINNs in Metal Additive Manufacturing via Conditional Flow Matching6 Oct 2026
- 2026Anatomy-preserving unpaired cone-beam CT refinement for image-guided radiotherapy using pseudo-label guided diffusion5 Oct 2026
- 2026Integrated Imputation-Classification for Supervised Learning with Missing Data3 Oct 2026
- 2026Nonlocal Hamiltonian Dynamics on Sparse L'evy Graphs: Spectral Analysis and Multimodal Sampling1 Oct 2026
- 2026FUND: Density Flow for Sampling Unnormalised Distributions26 Sep 2026
- 2026EmbeddGAN: A Novel GAN Framework Using an Embedding Network and Gini Distance Correlation18 Sep 2026
- 2026Assessment of Conditional Diffusion Model for Synthetic Histopathology Image Generation4 Aug 2026
- 2026Transformer-based Diffusion models for Hydrological Time Series Probabilistic Imputation and Forecasting23 Jul 2026
- 2026MTVDiff: Multimodal Conditional Latent Diffusion for Enhanced Thermal-to-Visible Face Translation22 Jul 2026
- 2026ROMS-IMLE: A Minimalist Approach to Competitive Single-Step Generative Modelling21 Jul 2026
- 2026From Jumps to Signatures: a Generative Method for Temporal Point Processes7 Jul 2026
- 2026Asymptotic Preservation and Uniform Accuracy of Diffusion and Flow-Matching Samplers5 Jul 2026
38 more
- 2026Understanding electricity consumption behaviour through Inverse Reinforcement Learning3 Jul 2026
- 2026Not all Jensen-Shannon Divergence Estimators are Equal15 Jun 2026
- 2026Distilling Drifting Transformers with Representation Autoencoders14 Jun 2026
- 2026CoFi-UCGen: Coarse-to-Fine Unsupervised Conditional Generation without Label Priors4 Jun 2026
- 2026Latent Geometric Chords for Query-Efficient Decision-Based Adversarial Attacks29 May 2026
- 2026How to Mitigate the Distribution Shift Problem in Robotics Control: A Robust and Adaptive Approach Based on Offline to Online Imitation Learning25 May 2026
- 2026TabKDE: Simple and Scalable Tabular Data Generation with Kernel Density Estimates17 May 2026
- 2026DriftXpress: Faster Drifting Models via Projected RKHS Fields12 May 2026
- 2026A Theory of Time-Sensitive Language Generation: Sparse Hallucination Beats Mode Collapse11 May 2026
- 2026A Unified Measure-Theoretic View of Diffusion, Score-Based, and Flow Matching Generative Models7 May 2026
- 2026LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulation23 Apr 2026
- 2026A Dual Perspective on Synthetic Trajectory Generators: Utility Framework and Privacy Vulnerabilities21 Apr 2026
- 2026Continuous Adversarial Flow Models13 Apr 2026
- 2026Cross-Machine Anomaly Detection Leveraging Pre-trained Time-series Model7 Apr 2026
- 2026Boosted Distributional Reinforcement Learning: Analysis and Healthcare Applications6 Apr 2026
- 2026Learning to Recorrupt: Noise Distribution Agnostic Self-Supervised Image Denoising26 Mar 2026
- 2026On Interpolation Formulas Describing Neural Network Generalization14 Mar 2026
- 2026Diffusion-Based Data Augmentation for Image Recognition: A Systematic Analysis and Evaluation9 Mar 2026
- 2026Surprisal-R'enyi Free Energy3 Mar 2026
- 2026ZeroDiff++: Substantial Unseen Visual-semantic Correlation in Zero-shot Learning12 Feb 2026
- 2026HP-GAN: Harnessing pretrained networks for GAN improvement with FakeTwins and discriminator consistency3 Feb 2026
- 2026Structure-constrained Language-informed Diffusion Model for Unpaired Low-dose Computed Tomography Angiography Reconstruction28 Jan 2026
- 2026Length-Aware Adversarial Training for Variable-Length Trajectories: Digital Twins for Mall Shopper Paths4 Jan 2026
- 2025A Reinforcement Learning Approach to Synthetic Data Generation24 Dec 2025
- 2025SFBD-OMNI: Bridge models for lossy measurement restoration with limited clean samples18 Dec 2025
- 2025Time-Varying Audio Effect Modeling by End-to-End Adversarial Training17 Dec 2025
- 2025A Novel Wasserstein Quaternion Generative Adversarial Network for Color Image Generation9 Dec 2025
- 2025Advancing Marine Bioacoustics with Deep Generative Models: A Hybrid Augmentation Strategy for Southern Resident Killer Whale Detection26 Nov 2025
- 2025Synergizing Deconfounding and Temporal Generalization For Time-series Counterfactual Outcome Estimation20 Nov 2025
- 2025Distribution Matching Distillation Meets Reinforcement Learning17 Nov 2025
- 2025Adaptive Symmetrization of the KL Divergence14 Nov 2025
- 2025Language Generation and Identification From Partial Enumeration: Tight Density Bounds and Topological Characterizations7 Nov 2025
- 2025Quantum Synthetic Data Generation for Industrial Bioprocess Monitoring20 Oct 2025
- 2025Blade: A Derivative-free Bayesian Inversion Method using Diffusion Priors13 Oct 2025
- 2025A mathematical theory for understanding when abstract representations emerge in neural networks10 Oct 2025
- 2025Biology-driven assessment of deep learning super-resolution imaging of the porosity network in dentin9 Oct 2025
- 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Models7 Oct 2025
- 2025UCD: Unconditional Discriminator Promotes Nash Equilibrium in GANs1 Oct 2025
50 newest of 464 All 464 (JSON)
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
- 2023Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generationcited by 142
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusioncited by 127
- 2022Differentially Private Diffusion Modelscited by 119
- 2023NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Modelscited by 76
- 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 50
- 2023Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Modelscited by 49
- 2022Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoderscited by 42
- 2025Harnessing Diffusion-Yielded Score Priors for Image Restorationcited by 36
- 2023Generate Your Own Scotland: Satellite Image Generation Conditioned on Mapscited by 30
- 2024Fast, Scale-Adaptive, and Uncertainty-Aware Downscaling of Earth System Model Fields with Generative Machine Learningcited by 27
12 most cited of 55 All 55 (JSON)
- 2026Domain-informed Adaptive Sampling for Generalizable PINNs in Metal Additive Manufacturing via Conditional Flow Matching6 Oct 2026
- 2026Anatomy-preserving unpaired cone-beam CT refinement for image-guided radiotherapy using pseudo-label guided diffusion5 Oct 2026
- 2026Assessment of Conditional Diffusion Model for Synthetic Histopathology Image Generation4 Aug 2026
- 2026Transformer-based Diffusion models for Hydrological Time Series Probabilistic Imputation and Forecasting23 Jul 2026
- 2026MTVDiff: Multimodal Conditional Latent Diffusion for Enhanced Thermal-to-Visible Face Translation22 Jul 2026
- 2026ROMS-IMLE: A Minimalist Approach to Competitive Single-Step Generative Modelling21 Jul 2026
- 2026Asymptotic Preservation and Uniform Accuracy of Diffusion and Flow-Matching Samplers5 Jul 2026
- 2026A Unified Measure-Theoretic View of Diffusion, Score-Based, and Flow Matching Generative Models7 May 2026
- 2026LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulation23 Apr 2026
- 2026Continuous Adversarial Flow Models13 Apr 2026
- 2026Structure-constrained Language-informed Diffusion Model for Unpaired Low-dose Computed Tomography Angiography Reconstruction28 Jan 2026
- 2025Distribution Matching Distillation Meets Reinforcement Learning17 Nov 2025
12 newest of 55 All 55 (JSON)
- 2023A Survey of Imitation Learning: Algorithms, Recent Developments, and Challengescited by 148
- 2018Variational Discriminator Bottleneck: Improving Imitation Learning, Inverse RL, and GANs by Constraining Information Flowcited by 105
- 2020Fighting Copycat Agents in Behavioral Cloning from Observation Historiescited by 71
- 2021Risk-Averse Offline Reinforcement Learningcited by 65
- 2019Random Expert Distillation: Imitation Learning via Expert Policy Support Estimationcited by 42
- 2018Sample-Efficient Imitation Learning via Generative Adversarial Netscited by 36
- 2021Domain-Robust Visual Imitation Learning with Mutual Information Constraintscited by 20
- 2020Non-Adversarial Imitation Learning and its Connections to Adversarial Methodscited by 17
- 2020Lipschitzness Is All You Need To Tame Off-policy Generative Adversarial Imitation Learningcited by 15
- 2022IL-flOw: Imitation Learning from Observation using Normalizing Flowscited by 12
- 2023Imitation Learning from Observation through Optimal Transportcited by 7
- 2020Support-weighted Adversarial Imitation Learningcited by 3
12 most cited of 19 All 19 (JSON)
- 2026How to Mitigate the Distribution Shift Problem in Robotics Control: A Robust and Adaptive Approach Based on Offline to Online Imitation Learning25 May 2026
- 2025Unsupervised Data Generation for Offline Reinforcement Learning: A Perspective from Model24 Jun 2025
- 2025Noise-conditioned Energy-based Annealed Rewards (NEAR): A Generative Framework for Imitation Learning from Observation24 Jan 2025
- 2024Expert Proximity as Surrogate Rewards for Single Demonstration Imitation Learning1 Feb 2024
- 2023Imitation Learning from Observation through Optimal Transport2 Oct 2023
- 2023A Survey of Imitation Learning: Algorithms, Recent Developments, and Challenges5 Sep 2023
- 2022IL-flOw: Imitation Learning from Observation using Normalizing Flows19 May 2022
- 2021Smooth Imitation Learning via Smooth Costs and Smooth Policies3 Nov 2021
- 2021GAN-Based Interactive Reinforcement Learning from Demonstration and Human Evaluative Feedback14 Apr 2021
- 2021Domain-Robust Visual Imitation Learning with Mutual Information Constraints8 Mar 2021
- 2021Risk-Averse Offline Reinforcement Learning10 Feb 2021
- 2020Fighting Copycat Agents in Behavioral Cloning from Observation Histories28 Oct 2020
12 newest of 19 All 19 (JSON)
- 2024Sinkhorn Distance Minimization for Knowledge Distillationcited by 15
- 2022Data-Free Adversarial Knowledge Distillation for Graph Neural Networkscited by 7
- 2022Discriminator-Cooperated Feature Map Distillation for GAN Compressioncited by 4
- 2023Synthetic data generation method for data-free knowledge distillation in regression neural networkscited by 4
- 2021Evolutionary Generative Adversarial Networks with Crossover Based Knowledge Distillationcited by 2
- 2024Sinkhorn Distance Minimization for Knowledge Distillation27 Feb 2024
- 2023Synthetic data generation method for data-free knowledge distillation in regression neural networks11 Jan 2023
- 2022Discriminator-Cooperated Feature Map Distillation for GAN Compression29 Dec 2022
- 2022Data-Free Adversarial Knowledge Distillation for Graph Neural Networks8 May 2022
- 2021Evolutionary Generative Adversarial Networks with Crossover Based Knowledge Distillation27 Jan 2021
- 2022On the Privacy Properties of GAN-generated Samplescited by 17
- 2021The Devil is in the GAN: Backdoor Attacks and Defenses in Deep Generative Modelscited by 12
- 2021Machine unlearning via GANcited by 6
- 2025A Reinforcement Learning Approach to Synthetic Data Generationcited by 0
- 2025A Reinforcement Learning Approach to Synthetic Data Generation24 Dec 2025
- 2022On the Privacy Properties of GAN-generated Samples3 Jun 2022
- 2021Machine unlearning via GAN22 Nov 2021
- 2021The Devil is in the GAN: Backdoor Attacks and Defenses in Deep Generative Models3 Aug 2021
- 2024Reinforcement Learning for Unsupervised Video Summarization with Reward Generator Trainingcited by 0
- 2025Learn A Flexible Exploration Model for Parameterized Action Markov Decision Processescited by 0
- 2026Boosted Distributional Reinforcement Learning: Analysis and Healthcare Applicationscited by 0
- 2026Boosted Distributional Reinforcement Learning: Analysis and Healthcare Applications6 Apr 2026
- 2025Learn A Flexible Exploration Model for Parameterized Action Markov Decision Processes6 Jan 2025
- 2024Reinforcement Learning for Unsupervised Video Summarization with Reward Generator Training5 Jul 2024
- 2024Offline Reinforcement Learning with Imputed Rewardscited by 2
- 2024Offline Reinforcement Learning with Imputed Rewards15 Jul 2024
- 2023Human-Like Autonomous Driving on Dense Trafficcited by 0
- 2023Human-Like Autonomous Driving on Dense Traffic3 Oct 2023
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
- 2021Projected GANs Converge Fastercited by 208
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
- 2021ST++: Make Self-training Work Better for Semi-supervised Semantic Segmentationcited by 184
- 2022Correct-N-Contrast: A Contrastive Approach for Improving Robustness to Spurious Correlationscited by 172
- 2021A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challengescited by 154
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 144
- 2021Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesiscited by 140
- 2021Deep Generative Models in Engineering Design: A Reviewcited by 105
- 2021An Introduction to Deep Generative Modelingcited by 104
- 2021Generative Modeling with Optimal Transport Mapscited by 82
- 2021Enhancing Photorealism Enhancementcited by 74
12 most cited of 373 All 373 (JSON)
- 2026Integrated Imputation-Classification for Supervised Learning with Missing Data3 Oct 2026
- 2026Nonlocal Hamiltonian Dynamics on Sparse L'evy Graphs: Spectral Analysis and Multimodal Sampling1 Oct 2026
- 2026FUND: Density Flow for Sampling Unnormalised Distributions26 Sep 2026
- 2026EmbeddGAN: A Novel GAN Framework Using an Embedding Network and Gini Distance Correlation18 Sep 2026
- 2026From Jumps to Signatures: a Generative Method for Temporal Point Processes7 Jul 2026
- 2026Understanding electricity consumption behaviour through Inverse Reinforcement Learning3 Jul 2026
- 2026Not all Jensen-Shannon Divergence Estimators are Equal15 Jun 2026
- 2026Distilling Drifting Transformers with Representation Autoencoders14 Jun 2026
- 2026CoFi-UCGen: Coarse-to-Fine Unsupervised Conditional Generation without Label Priors4 Jun 2026
- 2026Latent Geometric Chords for Query-Efficient Decision-Based Adversarial Attacks29 May 2026
- 2026TabKDE: Simple and Scalable Tabular Data Generation with Kernel Density Estimates17 May 2026
- 2026DriftXpress: Faster Drifting Models via Projected RKHS Fields12 May 2026
12 newest of 373 All 373 (JSON)