mlsanityData to 7 Oct 2026

Seeding Diversity into AI Art

arXiv 2205.00804 ↗First posted 2 May 2022cs.AI cs.GRcited by 4

Not on the map. Why?

Abstract (arXiv)

This paper argues that generative art driven by conformance to a visual and/or semantic corpus lacks the necessary criteria to be considered creative. Among several issues identified in the literature, we focus on the fact that generative adversarial networks (GANs) that create a single image, in a vacuum, lack a concept of novelty regarding how their product differs from previously created ones. We envision that an algorithm that combines the novelty preservation mechanisms in evolutionary algorithms with the power of GANs can deliberately guide its creative process towards output that is both good and novel. In this paper, we use recent advances in image generation based on semantic prompts using OpenAI's CLIP model, interrupting the GAN's iterative process with short cycles of evolutionary divergent search. The results of evolution are then used to continue the GAN's iterative process; we hypothesise that this intervention will lead to more novel outputs. Testing our hypothesis using novelty search with local competition, a quality-diversity evolutionary algorithm that can increase visual diversity while maintaining quality in the form of adherence to the semantic prompt, we explore how different notions of visual diversity can affect both the process and the product of the algorithm. Results show that even a simplistic measure of visual diversity can help counter a drift towards similar images caused by the GAN. This first experiment opens a new direction for introducing higher intentionality and a more nuanced drive for GANs.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 20 of its 51 references that are in the map. First posted on arXiv 2 May 2022.

Builds on

20 of 51 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  7. 2022Generative Adversarial Networkscited by 5,603
  8. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  9. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  10. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  11. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  12. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 575
8 more
  1. 2021ClipCap: CLIP Prefix for Image Captioningcited by 557
  2. 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 430
  3. 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 333
  4. 2020pymoo: Multi-objective Optimization in Pythoncited by 196
  5. 2016Learning What and Where to Drawcited by 105
  6. 2019Autonomy, Authenticity, Authorship and Intention in computer generated artcited by 18
  7. 2021Transforming Exploratory Creativity with DeLeNoXcited by 13
  8. 2021AffectGAN: Affect-Based Generative Art Driven by Semanticscited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 1; 2024: 1; 2025: 0; 2026: 1.

4 papers.