mlsanityData to 7 Oct 2026

StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets

arXiv 2202.00273 ↗First posted 1 Feb 2022cs.LG cs.CVcited by 489

Not on the map. Why?

Cited by 189 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Computer graphics has experienced a recent surge of data-centric approaches for photorealistic and controllable content creation. StyleGAN in particular sets new standards for generative modeling regarding image quality and controllability. However, StyleGAN's performance severely degrades on large unstructured datasets such as ImageNet. StyleGAN was designed for controllability; hence, prior works suspect its restrictive design to be unsuitable for diverse datasets. In contrast, we find the main limiting factor to be the current training strategy. Following the recently introduced Projected GAN paradigm, we leverage powerful neural network priors and a progressive growing strategy to successfully train the latest StyleGAN3 generator on ImageNet. Our final model, StyleGAN-XL, sets a new state-of-the-art on large-scale image synthesis and is the first to generate images at a resolution of 10242 at such a dataset scale. We demonstrate that this model can invert and edit images beyond the narrow domain of portraits or specific object classes.

Key facts. Cited by 489 papers in the map (data through 7 Oct 2026). Builds on 67 of its 76 references that are in the map. First posted on arXiv 1 Feb 2022.

Builds on

67 of 76 references.

References · 67

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2017Neural Discrete Representation Learningcited by 4,650
  9. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  10. 2014Going Deeper with Convolutionscited by 4,231
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  12. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
38 more
  1. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  2. 2016Improved Techniques for Training GANscited by 2,938
  3. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  4. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  5. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  6. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  7. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  8. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  9. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  10. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  11. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  12. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  13. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  14. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  15. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  16. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  17. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  18. 2018Which Training Methods for GANs do actually Converge?cited by 672
  19. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
  20. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  21. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  22. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  23. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
  24. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  25. 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
  26. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
  27. 2020Differentiable Augmentation for Data-Efficient GAN Trainingcited by 361
  28. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
  29. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
  30. 2021The Intrinsic Dimension of Images and Its Impact on Learningcited by 307
  31. 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 288
  32. 2021Generating Images with Sparse Representationscited by 262
  33. 2018cGANs with Projection Discriminatorcited by 253
  34. 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
  35. 2019On the "steerability" of generative adversarial networkscited by 247
  36. 2021Projected GANs Converge Fastercited by 204
  37. 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
  38. 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 184

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 52; 2023: 137; 2024: 132; 2025: 101; 2026: 67.

489 papers.

Sort:

By area:

  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  3. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  4. 2023Consistency Modelscited by 1,778
  5. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  6. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  7. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  8. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  9. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
  10. 2023Adversarial Diffusion Distillationcited by 741
  11. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
  12. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
38 more
  1. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  2. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
  3. 2025Mean Flows for One-step Generative Modelingcited by 524
  4. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 498
  5. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  6. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 448
  7. 2023Improved Techniques for Training Consistency Modelscited by 430
  8. 2023Simple diffusion: End-to-end diffusion for high resolution imagescited by 413
  9. 2023Analyzing and Improving the Training Dynamics of Diffusion Modelscited by 396
  10. 2024One Step Diffusion via Shortcut Modelscited by 373
  11. 2024The Platonic Representation Hypothesiscited by 362
  12. 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 289
  13. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
  14. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
  15. 2025Diffusion Transformers with Representation Autoencoderscited by 275
  16. 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizercited by 260
  17. 2023Efficient Diffusion Training via Min-SNR Weighting Strategycited by 242
  18. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
  19. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
  20. 2023StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesiscited by 212
  21. 2022The Role of ImageNet Classes in Fr'echet Inception Distancecited by 211
  22. 2023A Survey on Video Diffusion Modelscited by 203
  23. 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelscited by 199
  24. 2023On the Importance of Noise Scheduling for Diffusion Modelscited by 193
  25. 2023Fast Training of Diffusion Models with Masked Transformerscited by 172
  26. 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANscited by 165
  27. 2022Generative Modelling With Inverse Heat Dissipationcited by 164
  28. 2023Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorscited by 156
  29. 2023Flow Matching in Latent Spacecited by 155
  30. 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
  31. 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
  32. 2024Consistency Models Made Easycited by 140
  33. 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformerscited by 137
  34. 2022VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Gridscited by 133
  35. 2023Dataset Distillation: A Comprehensive Reviewcited by 126
  36. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 126
  37. 2023Generalizing Dataset Distillation via Deep Generative Priorcited by 125
  38. 2023CADS: Unleashing the Diversity of Diffusion Models through Condition-Annealed Samplingcited by 124

50 most cited of 489 All 489 (JSON)