The Cultivated Practices of Text-to-Image Generation
Not on the map. Why?
Abstract (arXiv)
Humankind is entering a novel creative era in which anybody can synthesize digital information using generative artificial intelligence (AI). Text-to-image generation, in particular, has become vastly popular and millions of practitioners produce AI-generated images and AI art online. This chapter first gives an overview of the key developments that enabled a healthy co-creative online ecosystem around text-to-image generation to rapidly emerge, followed by a high-level description of key elements in this ecosystem. A particular focus is placed on prompt engineering, a creative practice that has been embraced by the AI art community. It is then argued that the emerging co-creative ecosystem constitutes an intelligent system on its own - a system that both supports human creativity, but also potentially entraps future generations and limits future development efforts in AI. The chapter discusses the potential risks and dangers of cultivating this co-creative ecosystem, such as the bias inherent in today's training data, potential quality degradation in future image generation systems due to synthetic data becoming common place, and the potential long-term effects of text-to-image generation on people's imagination, ambitions, and development.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 30 of its 61 references that are in the map. First posted on arXiv 20 Jun 2023.
Builds on
30 of 61 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2023Extracting Training Data from Diffusion Modelscited by 732
18 more
- 2019Does Learning Require Memorization? A Short Tale about a Long Tailcited by 460
- 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 458
- 2023Augmented Language Models: a Surveycited by 403
- 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 356
- 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
- 2018Manipulating and Measuring Model Interpretabilitycited by 256
- 2023Pretraining Language Models with Human Preferencescited by 247
- 2021Accelerating Sparse Deep Neural Networkscited by 223
- 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 218
- 2023Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Modelscited by 175
- 2022The Creativity of Text-to-Image Generationcited by 73
- 2022Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Modelscited by 64
- 2021Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviorscited by 50
- 2017Level Playing Field for Million Scale Face Recognitioncited by 43
- 2022The Birth of Bias: A case study on the evolution of gender bias in an English language modelcited by 16
- 2023Using Text-to-Image Generation for Architectural Design Ideationcited by 16
- 2022When happy accidents spark creativity: Bringing collaborative speculation to life with generative AIcited by 9
- 2023Perceptions and Realities of Text-to-Image Generationcited by 5
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.