mlsanityData to 14 Oct 2026

Art Creation with Multi-Conditional StyleGANs

arXiv 2202.11777 ↗First posted 23 Feb 2022cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Creating meaningful art is often viewed as a uniquely human endeavor. A human artist needs a combination of unique skills, understanding, and genuine intention to create artworks that evoke deep feelings and emotions. In this paper, we introduce a multi-conditional Generative Adversarial Network (GAN) approach trained on large amounts of human paintings to synthesize realistic-looking paintings that emulate human art. Our approach is based on the StyleGAN neural network architecture, but incorporates a custom multi-conditional control mechanism that provides fine-granular control over characteristics of the generated paintings, e.g., with regard to the perceived emotion evoked in a spectator. For better control, we introduce the conditional truncation trick, which adapts the standard truncation trick for the conditional setting and diverse datasets. Finally, we develop a diverse set of evaluation techniques tailored to multi-conditional generation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 56 references that are in the map. First posted on arXiv 23 Feb 2022.

Builds on

38 of 56 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  5. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  6. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  7. 2016Improved Techniques for Training GANscited by 2,970
  8. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  9. 2014Conditional Generative Adversarial Netscited by 2,162
  10. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  11. 2018Demystifying MMD GANscited by 1,293
  12. 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
26 more
  1. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
  2. 2017Deep Image Priorcited by 1,098
  3. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
  4. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  5. 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 565
  6. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  7. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  8. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 349
  9. 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 289
  10. 2018cGANs with Projection Discriminatorcited by 254
  11. 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
  12. 2017GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibriumcited by 213
  13. 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
  14. 2017Modulating early visual processing by languagecited by 167
  15. 2021ArtEmis: Affective Language for Visual Artcited by 104
  16. 2017CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Normscited by 96
  17. 2020Improved StyleGAN Embedding: Where are the Good Latents?cited by 88
  18. 2020Generative Hierarchical Features from Synthesizing Imagescited by 83
  19. 2019HYPE: A Benchmark for Human eYe Perceptual Evaluation of Generative Modelscited by 59
  20. 2019On the Evaluation of Conditional GANscited by 21
  21. 2019Autonomy, Authenticity, Authorship and Intention in computer generated artcited by 18
  22. 2015The Cross-Depiction Problem: Computer Vision Algorithms for Recognising Objects in Artwork and in Photographscited by 10
  23. 2018MC-GAN: Multi-conditional Generative Adversarial Network for Image Synthesiscited by 10
  24. 2020Sketch-to-Art: Synthesizing Stylized Art Images From Sketchescited by 10
  25. 2020Controllable Continuous Gaze Redirectioncited by 10
  26. 2018Disentangling Multiple Conditional Inputs in GANscited by 1

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.