AutoGAN: Neural Architecture Search for Generative Adversarial Networks
Not on the map. Why?
Abstract (arXiv)
Neural architecture search (NAS) has witnessed prevailing success in image classification and (very recently) segmentation tasks. In this paper, we present the first preliminary study on introducing the NAS algorithm to generative adversarial networks (GANs), dubbed AutoGAN. The marriage of NAS and GANs faces its unique challenges. We define the search space for the generator architectural variations and use an RNN controller to guide the search, with parameter sharing and dynamic-resetting to accelerate the process. Inception score is adopted as the reward, and a multi-level search strategy is introduced to perform NAS in a progressive way. Experiments validate the effectiveness of AutoGAN on the task of unconditional image generation. Specifically, our discovered architectures achieve highly competitive performance compared to current state-of-the-art hand-crafted GANs, e.g., setting new state-of-the-art FID scores of 12.42 on CIFAR-10, and 31.01 on STL-10, respectively. We also conclude with a discussion of the current limitations and future potential of AutoGAN. The code is available at https://github.com/TAMU-VITA/AutoGAN
Key facts. Cited by 94 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 37; 2022: 18; 2023: 26; 2024: 8; 2025: 2; 2026: 3.
94 papers.
Sort:
By area:
- 2023Consistency Modelscited by 1,778
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2021Score-based Generative Modeling in Latent Spacecited by 634
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
- 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusioncited by 230
- 2021Likelihood Training of Schr"odinger Bridge using Forward-Backward SDEs Theorycited by 216
- 2021Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspectivecited by 168
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
- 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
- 2023DiffiT: Diffusion Vision Transformers for Image Generationcited by 104
- 2021Fourier Space Losses for Efficient Perceptual Image Super-Resolutioncited by 72
38 more
- 2021A Comprehensive Survey on Hardware-Aware Neural Architecture Searchcited by 60
- 2023One-Step Diffusion Distillation via Deep Equilibrium Modelscited by 60
- 2023ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradientscited by 57
- 2022Neural Architecture Search for Spiking Neural Networkscited by 52
- 2022Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoderscited by 42
- 2023Generative Modeling through the Semi-dual Formulation of Unbalanced Optimal Transportcited by 39
- 2021GANs Can Play Lottery Tickets Toocited by 32
- 2025D3: Training-Free AI-Generated Video Detection Using Second-Order Featurescited by 32
- 2022Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Trainingcited by 29
- 2021Styleformer: Transformer based Generative Adversarial Networks with Style Vectorcited by 27
- 2021Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspectivecited by 25
- 2021Gradient Normalization for Generative Adversarial Networkscited by 25
- 2021Online Multi-Granularity Distillation for GAN Compressioncited by 24
- 2022RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmarkcited by 24
- 2024Scalable Wasserstein Gradient Flow for Generative Modeling through Unbalanced Optimal Transportcited by 22
- 2023Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunitiescited by 21
- 2021WAS-VTON: Warping Architecture Search for Virtual Try-on Networkcited by 18
- 2024ClassDiffusion: More Aligned Personalization Tuning with Explicit Class Guidancecited by 18
- 2023PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editorcited by 17
- 2021Trilevel Neural Architecture Search for Efficient Single Image Super-Resolutioncited by 15
- 2021MFAGAN: A Compression Framework for Memory-Efficient On-Device Super-Resolution GANcited by 14
- 2022GhostNets on Heterogeneous Devices via Cheap Operationscited by 14
- 2023Catch-Up Distillation: You Only Need to Train Once for Accelerating Samplingcited by 13
- 2022Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesiscited by 12
- 2021T-AutoML: Automated Machine Learning for Lesion Segmentation using Transformers in 3D Medical Imagingcited by 11
- 2021Partition-Guided GANscited by 9
- 2021RANK-NOSH: Efficient Predictor-Based Architecture Search via Non-Uniform Successive Halvingcited by 9
- 2022Bi-level Alignment for Cross-Domain Crowd Countingcited by 8
- 2023Analyzing and Improving Optimal-Transport-based Adversarial Networkscited by 8
- 2021Sandwich Batch Normalization: A Drop-In Replacement for Feature Distribution Heterogeneitycited by 7
- 2021Understanding and Accelerating Neural Architecture Search with Training-Free and Theory-Grounded Metricscited by 7
- 2022Generator Knows What Discriminator Should Learn in Unconditional GANscited by 7
- 2023Restoration based Generative Modelscited by 6
- 2023EGANS: Evolutionary Generative Adversarial Network Search for Zero-Shot Learningcited by 6
- 2023SMaRt: Improving GANs with Score Matching Regularitycited by 6
- 2021Contrastive Self-supervised Neural Architecture Searchcited by 5
- 2021Combining Transformer Generators with Convolutional Discriminatorscited by 5
- 2021Dynamically Grown Generative Adversarial Networkscited by 5
50 most cited of 94 All 94 (JSON)
- 2026NepScript Genesis: Neural Architecture Search for Handwritten Devanagari Digit Synthesis30 Aug 2026
- 2026Agentic Neural Architecture Search8 Jul 2026
- 2026Neural Architecture Search for Generative Adversarial Networks: A Comprehensive Review and Critical Analysis24 Jun 2026
- 2025D3: Training-Free AI-Generated Video Detection Using Second-Order Features1 Aug 2025
- 2025TART: Token-based Architecture Transformer for Neural Network Performance Prediction2 Jan 2025
- 2024Versatile Cataract Fundus Image Restoration Model Utilizing Unpaired Cataract and High-quality Images19 Nov 2024
- 2024Learning Morphisms with Gauss-Newton Approximation for Growing Networks7 Nov 2024
- 2024Double Oracle Neural Architecture Search for Game Theoretic Deep Learning Models7 Oct 2024
- 2024Rethinking Image Skip Connections in StyleGAN28 Jul 2024
- 2024Latent Denoising Diffusion GAN: Faster sampling, Higher image quality17 Jun 2024
- 2024SNED: Superposition Network Architecture Search for Efficient Video Diffusion Model31 May 2024
- 2024ClassDiffusion: More Aligned Personalization Tuning with Explicit Class Guidance27 May 2024
38 more
- 2024Scalable Wasserstein Gradient Flow for Generative Modeling through Unbalanced Optimal Transport8 Feb 2024
- 2023One-Step Diffusion Distillation via Deep Equilibrium Models12 Dec 2023
- 2023DiffiT: Diffusion Vision Transformers for Image Generation4 Dec 2023
- 2023One-step Diffusion with Distribution Matching Distillation30 Nov 2023
- 2023SMaRt: Improving GANs with Score Matching Regularity30 Nov 2023
- 2023ACT-Diffusion: Efficient Adversarial Consistency Training for One-step Diffusion Models23 Nov 2023
- 2023CycleGANAS: Differentiable Neural Architecture Search for CycleGAN13 Nov 2023
- 2023Energy-Calibrated VAE with Test Time Free Lunch7 Nov 2023
- 2023A Chronological Survey of Theoretical Advancements in Generative Adversarial Networks for Computer Vision2 Nov 2023
- 2023Analyzing and Improving Optimal-Transport-based Adversarial Networks4 Oct 2023
- 2023UGC: Unified GAN Compression for Efficient Image-to-Image Translation17 Sep 2023
- 2023Deep Generative Modeling-based Data Augmentation with Demonstration using the BFBT Benchmark Void Fraction Datasets19 Aug 2023
- 2023EGANS: Evolutionary Generative Adversarial Network Search for Zero-Shot Learning19 Aug 2023
- 2023Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities5 Jul 2023
- 2023Penalty Gradient Normalization for Generative Adversarial Networks23 Jun 2023
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Models29 May 2023
- 2023Generative Modeling through the Semi-dual Formulation of Unbalanced Optimal Transport24 May 2023
- 2023Catch-Up Distillation: You Only Need to Train Once for Accelerating Sampling18 May 2023
- 2023TR0N: Translator Networks for 0-Shot Plug-and-Play Conditional Generation26 Apr 2023
- 2023PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editor30 Mar 2023
- 2023Are Neural Architecture Search Benchmarks Well Designed? A Deeper Look Into Operation Importance29 Mar 2023
- 2023Adapting U-Net for linear elastic stress estimation in polycrystal Zr microstructures15 Mar 2023
- 2023MotionVideoGAN: A Novel Video Generator Based on the Motion Space Learned from Image Pairs6 Mar 2023
- 2023Consistency Models2 Mar 2023
- 2023Restoration based Generative Models20 Feb 2023
- 2023ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients26 Jan 2023
- 2023Neural Architecture Search: Insights from 1000 Papers20 Jan 2023
- 2022Exploring Content Relationships for Distilling Efficient GANs21 Dec 2022
- 2022Adaptive adversarial training method for improving multi-scale GAN based on generalization bound theory30 Nov 2022
- 2022A Self-adaptive Neuroevolution Approach to Constructing Deep Neural Network Architectures Across Different Types27 Nov 2022
- 2022NEON: Enabling Efficient Support for Nonlinear Operations in Resistive RAM-based Neural Network Accelerators10 Nov 2022
- 2022Extensible Proxy for Efficient NAS17 Oct 2022
- 2022Generator Knows What Discriminator Should Learn in Unconditional GANs27 Jul 2022
- 2022Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesis11 Jul 2022
- 2022Cut Inner Layers: A Structured Pruning Strategy for Efficient U-Net GANs29 Jun 2022
- 2022Exploring the Intersection between Neural Architecture Search and Continual Learning11 Jun 2022
- 2022Bi-level Alignment for Cross-Domain Crowd Counting12 May 2022
- 2022Generative Adversarial Networks for Image Augmentation in Agriculture: A Systematic Review10 Apr 2022
50 newest of 94 All 94 (JSON)
- 2023Consistency Modelscited by 1,778
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2021Score-based Generative Modeling in Latent Spacecited by 634
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
- 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusioncited by 230
- 2023DiffiT: Diffusion Vision Transformers for Image Generationcited by 104
- 2023One-Step Diffusion Distillation via Deep Equilibrium Modelscited by 60
- 2022Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoderscited by 42
- 2024ClassDiffusion: More Aligned Personalization Tuning with Explicit Class Guidancecited by 18
- 2023PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editorcited by 17
- 2023Restoration based Generative Modelscited by 6
12 most cited of 16 All 16 (JSON)
- 2024Latent Denoising Diffusion GAN: Faster sampling, Higher image quality17 Jun 2024
- 2024SNED: Superposition Network Architecture Search for Efficient Video Diffusion Model31 May 2024
- 2024ClassDiffusion: More Aligned Personalization Tuning with Explicit Class Guidance27 May 2024
- 2023One-Step Diffusion Distillation via Deep Equilibrium Models12 Dec 2023
- 2023DiffiT: Diffusion Vision Transformers for Image Generation4 Dec 2023
- 2023One-step Diffusion with Distribution Matching Distillation30 Nov 2023
- 2023SMaRt: Improving GANs with Score Matching Regularity30 Nov 2023
- 2023ACT-Diffusion: Efficient Adversarial Consistency Training for One-step Diffusion Models23 Nov 2023
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Models29 May 2023
- 2023PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editor30 Mar 2023
- 2023Consistency Models2 Mar 2023
- 2023Restoration based Generative Models20 Feb 2023
12 newest of 16 All 16 (JSON)
- 2026Agentic Neural Architecture Searchcited by 1
- 2026Agentic Neural Architecture Search8 Jul 2026
- 2021Likelihood Training of Schr"odinger Bridge using Forward-Backward SDEs Theorycited by 216
- 2021Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspectivecited by 168
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
- 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
- 2021Fourier Space Losses for Efficient Perceptual Image Super-Resolutioncited by 72
- 2021A Comprehensive Survey on Hardware-Aware Neural Architecture Searchcited by 60
- 2023ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradientscited by 57
- 2022Neural Architecture Search for Spiking Neural Networkscited by 52
- 2023Generative Modeling through the Semi-dual Formulation of Unbalanced Optimal Transportcited by 39
- 2021GANs Can Play Lottery Tickets Toocited by 32
- 2025D3: Training-Free AI-Generated Video Detection Using Second-Order Featurescited by 32
- 2022Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Trainingcited by 29
12 most cited of 77 All 77 (JSON)
- 2026NepScript Genesis: Neural Architecture Search for Handwritten Devanagari Digit Synthesis30 Aug 2026
- 2026Neural Architecture Search for Generative Adversarial Networks: A Comprehensive Review and Critical Analysis24 Jun 2026
- 2025D3: Training-Free AI-Generated Video Detection Using Second-Order Features1 Aug 2025
- 2025TART: Token-based Architecture Transformer for Neural Network Performance Prediction2 Jan 2025
- 2024Versatile Cataract Fundus Image Restoration Model Utilizing Unpaired Cataract and High-quality Images19 Nov 2024
- 2024Learning Morphisms with Gauss-Newton Approximation for Growing Networks7 Nov 2024
- 2024Double Oracle Neural Architecture Search for Game Theoretic Deep Learning Models7 Oct 2024
- 2024Rethinking Image Skip Connections in StyleGAN28 Jul 2024
- 2024Scalable Wasserstein Gradient Flow for Generative Modeling through Unbalanced Optimal Transport8 Feb 2024
- 2023CycleGANAS: Differentiable Neural Architecture Search for CycleGAN13 Nov 2023
- 2023Energy-Calibrated VAE with Test Time Free Lunch7 Nov 2023
- 2023A Chronological Survey of Theoretical Advancements in Generative Adversarial Networks for Computer Vision2 Nov 2023
12 newest of 77 All 77 (JSON)