mlsanityData to 14 Oct 2026

Exploring Language Patterns of Prompts in Text-to-Image Generation and Their Impact on Visual Diversity

arXiv 2504.14125 ↗First posted 19 Apr 2025cs.HC cs.AI cs.CYcited by 3

Not on the map. Why?

Abstract (arXiv)

Following the initial excitement, Text-to-Image (TTI) models are now being examined more critically. While much of the discourse has focused on biases and stereotypes embedded in large-scale training datasets, the sociotechnical dynamics of user interactions with these models remain underexplored. This study examines the linguistic and semantic choices users make when crafting prompts and how these choices influence the diversity of generated outputs. Analyzing over six million prompts from the Civiverse dataset on the CivitAI platform across seven months, we categorize users into three groups based on their levels of linguistic experimentation: consistent repeaters, occasional repeaters, and non-repeaters. Our findings reveal that as user participation grows over time, prompt language becomes increasingly homogenized through the adoption of popular community tags and descriptors, with repeated prompts comprising 40-50% of submissions. At the same time, semantic similarity and topic preferences remain relatively stable, emphasizing common subjects and surface aesthetics. Using Vendi scores to quantify visual diversity, we demonstrate a clear correlation between lexical similarity in prompts and the visual similarity of generated images, showing that linguistic repetition reinforces less diverse representations. These findings highlight the significant role of user-driven factors in shaping AI-generated imagery, beyond inherent model biases, and underscore the need for tools and practices that encourage greater linguistic and thematic experimentation within TTI systems to foster more inclusive and diverse AI-generated content.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 54 references that are in the map. First posted on arXiv 19 Apr 2025.

Builds on

23 of 54 references.

References · 23

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  4. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  5. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  6. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 379
  7. 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
  8. 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
  9. 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 205
  10. 2023Does Writing with Language Models Reduce Content Diversity?cited by 192
  11. 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
  12. 2021Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain?cited by 85
11 more
  1. 2022Large-scale Text-to-Image Generation Models for Visual Artists' Creative Workscited by 61
  2. 2021Understanding and Creating Art with AI: Review and Outlookcited by 60
  3. 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 60
  4. 2024Standardizing the Measurement of Text Diversity: A Tool and a Comparative Analysis of Scorescited by 50
  5. 2022Opal: Multimodal Image Generation for News Illustrationcited by 36
  6. 2023A Prompt Log Analysis of Text-to-Image Generation Systemscited by 24
  7. 2024Prompting in the Wild: An Empirical Study of Prompt Evolution in Software Repositoriescited by 18
  8. 2023Using Text-to-Image Generation for Architectural Design Ideationcited by 16
  9. 2022Self-Repetition in Abstractive Neural Summarizerscited by 13
  10. 2024No Longer Trending on Artstation: Prompt Analysis of Generative AI Artcited by 7
  11. 2019ProbMinHash -- A Class of Locality-Sensitive Hash Algorithms for the (Probability) Jaccard Similaritycited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.