LOGAN: Latent Optimisation for Generative Adversarial Networks
Not on the map. Why?
Abstract (arXiv)
Training generative adversarial networks requires balancing of delicate adversarial dynamics. Even with careful tuning, training may diverge or end up in a bad equilibrium with dropped modes. In this work, we improve CS-GAN with natural gradient-based latent optimisation and show that it improves adversarial dynamics by enhancing interactions between the discriminator and the generator. Our experiments demonstrate that latent optimisation can significantly improve GAN training, obtaining state-of-the-art performance for the ImageNet (128 × 128) dataset. Our model achieves an Inception Score (IS) of 148 and an Fr'echet Inception Distance (FID) of 3.4, an improvement of 17% and 32% in IS and FID respectively, compared with the baseline BigGAN-deep model with the same architecture and number of parameters.
Key facts. Cited by 42 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 9; 2023: 7; 2024: 6; 2025: 1; 2026: 1.
42 papers.
Sort:
By area:
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Modelscited by 334
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noisecited by 276
- 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelscited by 205
- 2021Is Attention Better Than Matrix Decomposition?cited by 77
- 2021DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Datacited by 64
- 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
- 2023Conditional Text Image Generation with Diffusion Modelscited by 58
- 2021Rebooting ACGAN: Auxiliary Classifier GANs with Stable Trainingcited by 57
- 2022StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesiscited by 38
30 more
- 2024StableIdentity: Inserting Anybody into Anywhere at First Sightcited by 35
- 2024Generative AI for Synthetic Data Generation: Methods, Challenges and the Futurecited by 33
- 2023Cousins Of The Vendi Score: A Family Of Similarity-Based Diversity Metrics For Science And Machine Learningcited by 24
- 2022A Novel Unified Conditional Score-based Generative Framework for Multi-modal Medical Image Completioncited by 23
- 2021Intrinsic Dimension Estimation Using Wasserstein Distancescited by 20
- 2021Conditional GANs with Auxiliary Discriminative Classifiercited by 20
- 2021Class Balancing GAN with a Classifier in the Loopcited by 17
- 2021Closed-Loop Data Transcription to an LDR via Minimaxing Rate Reductioncited by 17
- 2021Joint inference and input optimization in equilibrium networkscited by 15
- 2023Synthesizing PET images from High-field and Ultra-high-field MR images Using Joint Diffusion Attention Modelcited by 14
- 2021Self-Diagnosing GAN: Diagnosing Underrepresented Samples in Generative Adversarial Networkscited by 13
- 2021TISE: Bag of Metrics for Text-to-Image Synthesis Evaluationcited by 13
- 2024A Multi-Armed Bandit Approach to Online Selection and Evaluation of Generative Modelscited by 13
- 2021Complex Momentum for Optimization in Gamescited by 11
- 2022Exploring Gradient-based Multi-directional Controls in GANscited by 10
- 2024Bring Metric Functions into Diffusion Modelscited by 7
- 2021Latent-Optimized Adversarial Neural Transfer for Sarcasm Detectioncited by 6
- 2022A Survey of Computer Vision Technologies In Urban and Controlled-environment Agriculturecited by 6
- 2023Adversarial Latent Autoencoder with Self-Attention for Structural Image Synthesiscited by 5
- 2024Deepfake Detection without Deepfakes: Generalization via Synthetic Frequency Patterns Injectioncited by 5
- 2025The Vendiscope: An Algorithmic Microscope For Data Collectionscited by 5
- 2022Reducing Training Sample Memorization in GANs by Training with Memorization Rejectioncited by 4
- 2024Compress Guidance in Conditional Diffusion Samplingcited by 4
- 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketchingcited by 3
- 2023NaturalFinger: Generating Natural Fingerprint with Generative Adversarial Networkscited by 2
- 2023Anomaly Score: Evaluating Generative Models and Individual Generated Images based on Complexity and Vulnerabilitycited by 2
- 2021Bridging the Gap between Label- and Reference-based Synthesis in Multi-attribute Image-to-Image Translationcited by 1
- 2021Generative Flows as a General Purpose Solution for Inverse Problemscited by 1
- 2021Unrealistic Feature Suppression for Generative Adversarial Networkscited by 0
- 2022A Review of the Convergence of 5G/6G Architecture and Deep Learningcited by 0
- 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketching12 Feb 2026
- 2025The Vendiscope: An Algorithmic Microscope For Data Collections15 Feb 2025
- 2024Compress Guidance in Conditional Diffusion Sampling20 Aug 2024
- 2024A Multi-Armed Bandit Approach to Online Selection and Evaluation of Generative Models11 Jun 2024
- 2024Deepfake Detection without Deepfakes: Generalization via Synthetic Frequency Patterns Injection20 Mar 2024
- 2024Generative AI for Synthetic Data Generation: Methods, Challenges and the Future7 Mar 2024
- 2024StableIdentity: Inserting Anybody into Anywhere at First Sight29 Jan 2024
- 2024Bring Metric Functions into Diffusion Models4 Jan 2024
- 2023Anomaly Score: Evaluating Generative Models and Individual Generated Images based on Complexity and Vulnerability17 Dec 2023
- 2023Cousins Of The Vendi Score: A Family Of Similarity-Based Diversity Metrics For Science And Machine Learning19 Oct 2023
- 2023Adversarial Latent Autoencoder with Self-Attention for Structural Image Synthesis19 Jul 2023
- 2023Conditional Text Image Generation with Diffusion Models19 Jun 2023
30 more
- 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models7 Jun 2023
- 2023NaturalFinger: Generating Natural Fingerprint with Generative Adversarial Networks29 May 2023
- 2023Synthesizing PET images from High-field and Ultra-high-field MR images Using Joint Diffusion Attention Model6 May 2023
- 2022Reducing Training Sample Memorization in GANs by Training with Memorization Rejection21 Oct 2022
- 2022A Survey of Computer Vision Technologies In Urban and Controlled-environment Agriculture20 Oct 2022
- 2022Exploring Gradient-based Multi-directional Controls in GANs1 Sep 2022
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noise19 Aug 2022
- 2022A Review of the Convergence of 5G/6G Architecture and Deep Learning16 Aug 2022
- 2022Classifier-Free Diffusion Guidance26 Jul 2022
- 2022A Novel Unified Conditional Score-based Generative Framework for Multi-modal Medical Image Completion7 Jul 2022
- 2022StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesis19 Jun 2022
- 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models17 Jan 2022
- 2021TISE: Bag of Metrics for Text-to-Image Synthesis Evaluation2 Dec 2021
- 2021Joint inference and input optimization in equilibrium networks25 Nov 2021
- 2021Closed-Loop Data Transcription to an LDR via Minimaxing Rate Reduction12 Nov 2021
- 2021Rebooting ACGAN: Auxiliary Classifier GANs with Stable Training1 Nov 2021
- 2021Generative Flows as a General Purpose Solution for Inverse Problems25 Oct 2021
- 2021Bridging the Gap between Label- and Reference-based Synthesis in Multi-attribute Image-to-Image Translation11 Oct 2021
- 2021Is Attention Better Than Matrix Decomposition?9 Sep 2021
- 2021Unrealistic Feature Suppression for Generative Adversarial Networks23 Jul 2021
- 2021Conditional GANs with Auxiliary Discriminative Classifier21 Jul 2021
- 2021Class Balancing GAN with a Classifier in the Loop17 Jun 2021
- 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Images15 Jun 2021
- 2021Intrinsic Dimension Estimation Using Wasserstein Distances8 Jun 2021
- 2021Cascaded Diffusion Models for High Fidelity Image Generation30 May 2021
- 2021Diffusion Models Beat GANs on Image Synthesis11 May 2021
- 2021DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Data5 May 2021
- 2021Latent-Optimized Adversarial Neural Transfer for Sarcasm Detection19 Apr 2021
- 2021Self-Diagnosing GAN: Diagnosing Underrepresented Samples in Generative Adversarial Networks24 Feb 2021
- 2021Complex Momentum for Optimization in Games16 Feb 2021
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Modelscited by 334
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noisecited by 276
- 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelscited by 205
- 2023Conditional Text Image Generation with Diffusion Modelscited by 58
- 2022A Novel Unified Conditional Score-based Generative Framework for Multi-modal Medical Image Completioncited by 23
- 2024Bring Metric Functions into Diffusion Modelscited by 7
- 2024Compress Guidance in Conditional Diffusion Samplingcited by 4
- 2024Compress Guidance in Conditional Diffusion Sampling20 Aug 2024
- 2024Bring Metric Functions into Diffusion Models4 Jan 2024
- 2023Conditional Text Image Generation with Diffusion Models19 Jun 2023
- 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models7 Jun 2023
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noise19 Aug 2022
- 2022Classifier-Free Diffusion Guidance26 Jul 2022
- 2022A Novel Unified Conditional Score-based Generative Framework for Multi-modal Medical Image Completion7 Jul 2022
- 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models17 Jan 2022
- 2021Cascaded Diffusion Models for High Fidelity Image Generation30 May 2021
- 2021Diffusion Models Beat GANs on Image Synthesis11 May 2021
- 2021Is Attention Better Than Matrix Decomposition?cited by 77
- 2021DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Datacited by 64
- 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
- 2021Rebooting ACGAN: Auxiliary Classifier GANs with Stable Trainingcited by 57
- 2022StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesiscited by 38
- 2024StableIdentity: Inserting Anybody into Anywhere at First Sightcited by 35
- 2023Cousins Of The Vendi Score: A Family Of Similarity-Based Diversity Metrics For Science And Machine Learningcited by 24
- 2021Intrinsic Dimension Estimation Using Wasserstein Distancescited by 20
- 2021Conditional GANs with Auxiliary Discriminative Classifiercited by 20
- 2021Class Balancing GAN with a Classifier in the Loopcited by 17
- 2021Closed-Loop Data Transcription to an LDR via Minimaxing Rate Reductioncited by 17
- 2021Joint inference and input optimization in equilibrium networkscited by 15
12 most cited of 31 All 31 (JSON)
- 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketching12 Feb 2026
- 2025The Vendiscope: An Algorithmic Microscope For Data Collections15 Feb 2025
- 2024A Multi-Armed Bandit Approach to Online Selection and Evaluation of Generative Models11 Jun 2024
- 2024Deepfake Detection without Deepfakes: Generalization via Synthetic Frequency Patterns Injection20 Mar 2024
- 2024StableIdentity: Inserting Anybody into Anywhere at First Sight29 Jan 2024
- 2023Anomaly Score: Evaluating Generative Models and Individual Generated Images based on Complexity and Vulnerability17 Dec 2023
- 2023Cousins Of The Vendi Score: A Family Of Similarity-Based Diversity Metrics For Science And Machine Learning19 Oct 2023
- 2023Adversarial Latent Autoencoder with Self-Attention for Structural Image Synthesis19 Jul 2023
- 2023NaturalFinger: Generating Natural Fingerprint with Generative Adversarial Networks29 May 2023
- 2023Synthesizing PET images from High-field and Ultra-high-field MR images Using Joint Diffusion Attention Model6 May 2023
- 2022Reducing Training Sample Memorization in GANs by Training with Memorization Rejection21 Oct 2022
- 2022A Survey of Computer Vision Technologies In Urban and Controlled-environment Agriculture20 Oct 2022
12 newest of 31 All 31 (JSON)