Art Creation with Multi-Conditional StyleGANs
Not on the map. Why?
Abstract (arXiv)
Creating meaningful art is often viewed as a uniquely human endeavor. A human artist needs a combination of unique skills, understanding, and genuine intention to create artworks that evoke deep feelings and emotions. In this paper, we introduce a multi-conditional Generative Adversarial Network (GAN) approach trained on large amounts of human paintings to synthesize realistic-looking paintings that emulate human art. Our approach is based on the StyleGAN neural network architecture, but incorporates a custom multi-conditional control mechanism that provides fine-granular control over characteristics of the generated paintings, e.g., with regard to the perceived emotion evoked in a spectator. For better control, we introduce the conditional truncation trick, which adapts the standard truncation trick for the conditional setting and diverse datasets. Finally, we develop a diverse set of evaluation techniques tailored to multi-conditional generation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 56 references that are in the map. First posted on arXiv 23 Feb 2022.
Builds on
38 of 56 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2016Improved Techniques for Training GANscited by 2,970
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2014Conditional Generative Adversarial Netscited by 2,162
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2018Demystifying MMD GANscited by 1,293
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
26 more
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
- 2017Deep Image Priorcited by 1,098
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 565
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 349
- 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 289
- 2018cGANs with Projection Discriminatorcited by 254
- 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
- 2017GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibriumcited by 213
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2017Modulating early visual processing by languagecited by 167
- 2021ArtEmis: Affective Language for Visual Artcited by 104
- 2017CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Normscited by 96
- 2020Improved StyleGAN Embedding: Where are the Good Latents?cited by 88
- 2020Generative Hierarchical Features from Synthesizing Imagescited by 83
- 2019HYPE: A Benchmark for Human eYe Perceptual Evaluation of Generative Modelscited by 59
- 2019On the Evaluation of Conditional GANscited by 21
- 2019Autonomy, Authenticity, Authorship and Intention in computer generated artcited by 18
- 2015The Cross-Depiction Problem: Computer Vision Algorithms for Recognising Objects in Artwork and in Photographscited by 10
- 2018MC-GAN: Multi-conditional Generative Adversarial Network for Image Synthesiscited by 10
- 2020Sketch-to-Art: Synthesizing Stylized Art Images From Sketchescited by 10
- 2020Controllable Continuous Gaze Redirectioncited by 10
- 2018Disentangling Multiple Conditional Inputs in GANscited by 1
Built on by
Citing papers per year: 2023: 1.
1 paper.
- 2023Controllable Multi-domain Semantic Artwork Synthesiscited by 2
- 2023Controllable Multi-domain Semantic Artwork Synthesis19 Aug 2023