mlsanityData to 7 Oct 2026

Homogenization Effects of Large Language Models on Human Creative Ideation

arXiv 2402.01536 ↗First posted 2 Feb 2024cs.HC cs.AIcited by 127

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are now being used in a wide variety of contexts, including as creativity support tools (CSTs) intended to help their users come up with new ideas. But do LLMs actually support user creativity? We hypothesized that the use of an LLM as a CST might make the LLM's users feel more creative, and even broaden the range of ideas suggested by each individual user, but also homogenize the ideas suggested by different users. We conducted a 36-participant comparative user study and found, in accordance with the homogenization hypothesis, that different users tended to produce less semantically distinct ideas with ChatGPT than with an alternative CST. Additionally, ChatGPT users generated a greater number of more detailed ideas, but felt less responsible for the ideas they generated. We discuss potential implications of these findings for users, designers, and developers of LLM-based CSTs.

Key facts. Cited by 127 papers in the map (data through 7 Oct 2026). Builds on 23 of its 99 references that are in the map. First posted on arXiv 2 Feb 2024.

Builds on

23 of 99 references.

References · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2022Text and Code Embeddings by Contrastive Pre-Trainingcited by 358
  5. 2023State of What Art? A Call for Multi-Prompt LLM Evaluationcited by 299
  6. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
  7. 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
  8. 2023Does Writing with Language Models Reduce Content Diversity?cited by 190
  9. 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 168
  10. 2023Co-Writing with Opinionated Language Models Affects Users' Viewscited by 145
  11. 2021Algorithmic Monoculture and Social Welfarecited by 98
  12. 2023Art and the science of generative AI: A deeper divecited by 93
11 more
  1. 2019Do Massively Pretrained Language Models Make Better Storytellers?cited by 90
  2. 2022Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?cited by 89
  3. 2022Designing for Responsible Trust in AI Systems: A Communication Perspectivecited by 48
  4. 2023PromptPaint: Steering Text-to-Image Generation Through Paint Medium-like Interactionscited by 34
  5. 2019Friend, Collaborator, Student, Manager: How Design of an AI-Driven Game Level Editor Affects Creatorscited by 31
  6. 2022Interacting with next-phrase suggestions: How suggestion systems aid and influence the cognitive processes of writingcited by 27
  7. 2023Experimental Narratives: A Comparison of Human Crowdsourced Storytelling and AI Storytellingcited by 26
  8. 2021Inspiration through Observation: Demonstrating the Influence of Automatically Generated Text on Creative Writingcited by 14
  9. 2021Nine Potential Pitfalls when Designing Human-AI Co-Creative Systemscited by 12
  10. 2023Inspire creativity with ORIBA: Transform Artists' Original Characters into Chatbots through Large Language Modelcited by 5
  11. 2020Designer Modeling through Design Style Clusteringcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 19; 2025: 47; 2026: 61.

127 papers.

Sort:

By area:

  1. 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
  2. 2024Can AI writing be salvaged? Mitigating Idiosyncrasies and Improving Human-AI Alignment in the Writing Process through Editscited by 49
  3. 2025Base Models Beat Aligned Models at Randomness and Creativitycited by 48
  4. 2024Echoes in AI: Quantifying lack of plot diversity in LLM outputscited by 47
  5. 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinkingcited by 43
  6. 2025We're Different, We're the Same: Creative Homogeneity Across LLMscited by 41
  7. 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedbackcited by 40
  8. 2024Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluationcited by 39
  9. 2025Modifying Large Language Model Post-Training for Diverse Creative Writingcited by 39
  10. 2025The Homogenizing Effect of Large Language Models on Human Expression and Thoughtcited by 35
  11. 2024Divergent Creativity in Humans and Large Language Modelscited by 29
  12. 2025The Shrinking Landscape of Linguistic Diversity in the Age of Large Language Modelscited by 28
38 more
  1. 2025Roll the dice & look before you leap: Going beyond the creative limits of next-token predictioncited by 28
  2. 2024Evaluating and Enhancing Large Language Models for Novelty Assessment in Scholarly Publicationscited by 26
  3. 2025AI-Slop to AI-Polish? Aligning Language Models through Edit-Based Writing Rewards and Test-time Computationcited by 24
  4. 2025Creative Preference Optimizationcited by 24
  5. 2024Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualizationcited by 23
  6. 2025Post-training Large Language Models for Diverse High-Quality Responsescited by 19
  7. 2024GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agencycited by 18
  8. 2024Regurgitative Training: The Value of Real Data in Training Large Language Modelscited by 15
  9. 2025What and Whose Knowledge? Measuring Epistemic Diversity in Large Language Modelscited by 14
  10. 2025Inkspire: Supporting Design Exploration with Generative AI through Analogical Sketchingcited by 13
  11. 2025The Lock-in Hypothesis: Stagnation by Algorithmcited by 11
  12. 2026Where does output diversity collapse in post-training?cited by 10
  13. 2024The Dearth of the Author in AI-Supported Writingcited by 9
  14. 2024Guiding and Diversifying LLM-Based Story Generation via Answer Set Programmingcited by 9
  15. 2024Large Language Models show both individual and collective creativity comparable to humanscited by 9
  16. 2025Diverse, not Short: A Length-Controlled Data Selection Strategy for Improving Response Diversity of Language Modelscited by 9
  17. 2026Can Good Writing Be Generative? Expert-Level AI Writing Emerges through Fine-Tuning on High-Quality Bookscited by 9
  18. 2024Creativity in AI: Progresses and Challengescited by 7
  19. 2025ScholarMate: A Mixed-Initiative Tool for Qualitative Knowledge Work and Information Sensemakingcited by 7
  20. 2025Understanding, Protecting, and Augmenting Human Cognition with Generative AI: A Synthesis of the CHI 2025 Tools for Thought Workshopcited by 7
  21. 2025Just-In-Time Objectives: A General Approach for Specialized AI Interactionscited by 7
  22. 2025Toyteller: AI-powered Visual Storytelling Through Toy-Playing with Character Symbolscited by 6
  23. 2025Has the Creativity of Large-Language Models peaked? An analysis of inter- and intra-LLM variabilitycited by 6
  24. 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaborationcited by 6
  25. 2025Don't Trust Generative Agents to Mimic Communication on Social Networks Unless You Benchmarked their Empirical Realismcited by 6
  26. 2026CREATE: Testing LLMs for Associative Creativitycited by 6
  27. 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 6
  28. 2024Shared Imagination: LLMs Hallucinate Alikecited by 5
  29. 2025The Basic B*** Effect: The Use of LLM-based Agents Reduces the Distinctiveness and Diversity of People's Choicescited by 5
  30. 2025AI-Enhanced Deliberative Democracy and the Future of the Collective Willcited by 4
  31. 2025Phraselette: A Poet's Procedural Palettecited by 4
  32. 2025Constella: Supporting Storywriters' Interconnected Character Creation through LLM-based Multi-Agentscited by 4
  33. 2026LLM Review: Enhancing Creative Writing via Blind Peer Review Feedbackcited by 4
  34. 2026LLMs Exhibit Significantly Lower Uncertainty in Creative Writing Than Professional Writerscited by 4
  35. 2025Societal Impacts Research Requires Benchmarks for Creative Composition Taskscited by 3
  36. 2025Exploring Language Patterns of Prompts in Text-to-Image Generation and Their Impact on Visual Diversitycited by 3
  37. 2025Cooking Up Creativity: Enhancing LLM Creativity through Structured Recombinationcited by 3
  38. 2025Overhearing LLM Agents: A Survey, Taxonomy, and Roadmapcited by 3

50 most cited of 127 All 127 (JSON)