mlsanityData to 7 Oct 2026

How AI Ideas Affect the Creativity, Diversity, and Evolution of Human Ideas: Evidence From a Large, Dynamic Experiment

arXiv 2401.13481 ↗First posted 24 Jan 2024cs.CY cs.AI cs.CLcited by 22

Not on the map. Why?

Abstract (arXiv)

Exposure to large language model output is rapidly increasing. How will seeing AI-generated ideas affect human ideas? We conducted an experiment (800+ participants, 40+ countries) where participants viewed creative ideas that were from ChatGPT or prior experimental participants and then brainstormed their own idea. We varied the number of AI-generated examples (none, low, or high exposure) and if the examples were labeled as 'AI' (disclosure). Our dynamic experiment design -- ideas from prior participants in an experimental condition are used as stimuli for future participants in the same experimental condition -- speaks to the interdependent process of cultural creation: creative ideas are built upon prior ideas. Hence, we capture the compounding effects of having LLMs 'in the culture loop'. We find that high AI exposure (but not low AI exposure) did not affect the creativity of individual ideas but did increase the average amount and rate of change of collective idea diversity. AI made ideas different, not better. There were no main effects of disclosure. We also found that self-reported creative people were less influenced by knowing an idea was from AI and that participants may knowingly adopt AI ideas when the task is difficult. Our findings suggest that introducing AI ideas may increase collective diversity but not individual creativity.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 15 of its 100 references that are in the map. First posted on arXiv 24 Jan 2024.

Builds on

15 of 100 references.

References · 15

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 343
  3. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
  4. 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
  5. 2023Does Writing with Language Models Reduce Content Diversity?cited by 190
  6. 2022Human heuristics for AI-generated language are flawedcited by 104
  7. 2021Sparks: Inspiration for Science Writing using Language Modelscited by 80
  8. 2022Putting GPT-3's Creativity to the (Alternative Uses) Testcited by 62
  9. 2023Machine Culturecited by 55
  10. 2023Accelerating science with human-aware artificial intelligencecited by 27
  11. 2022On the Influence of Explainable AI on Automation Biascited by 18
  12. 2021Inspiration through Observation: Demonstrating the Influence of Automatically Generated Text on Creative Writingcited by 14
3 more
  1. 2020Heteroglossia: In-Situ Story Ideation with the Crowdcited by 12
  2. 2021Collaborative Storytelling with Human Actors and AI Narratorscited by 10
  3. 2023Automatic Assessment of Divergent Thinking in Chinese Language with TransDis: A Transformer-Based Language Model Approachcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 9; 2026: 5.

22 papers.

Sort:

By area:

  1. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
  2. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 348
  3. 2024Building Machines that Learn and Think with Peoplecited by 73
  4. 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinkingcited by 43
  5. 2025LLM Probability Concentration: How Alignment Shrinks the Generative Horizoncited by 26
  6. 2024Plurals: A System for Guiding LLMs Via Simulated Social Ensemblescited by 17
  7. 2024A Systematic Assessment of OpenAI o1-Preview for Higher Order Thinking in Educationcited by 16
  8. 2024Position: Towards Bidirectional Human-AI Alignmentcited by 15
  9. 2025Optimizing Diversity and Quality through Base-Aligned Model Collaborationcited by 8
  10. 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaborationcited by 6
  11. 2025Deep Associations, High Creativity: A Simple yet Effective Metric for Evaluating Large Language Modelscited by 6
  12. 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 6
10 more
  1. 2025Generative AI and Creativity: A Systematic Literature Review and Meta-Analysiscited by 5
  2. 2024Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Designcited by 4
  3. 2025Conversational Agents as Catalysts for Critical Thinking: Challenging Social Influence in Group Decision-makingcited by 4
  4. 2025FutureGen: A RAG-based Approach to Generate the Future Work of Scientific Articlecited by 2
  5. 2026Ex Ante Evaluation of AI-Induced Idea Diversity Collapsecited by 1
  6. 2024Creativity in the Age of AI: Evaluating the Impact of Generative AI on Design Outputs and Designers' Creative Thinkingcited by 0
  7. 2025AI, Humans, and Data Science: Optimizing Roles Across Workflows and the Workforcecited by 0
  8. 2026"Looking for Something Weird to Happen": How Humans Sustain AI Agent Novelty Amid Semantic Collapsecited by 0
  9. 2026Small-world Networks of Agents Brainstorm AI Risks to Support Ideationcited by 0
  10. 2026How Strong Is the Evidence for the Artificial Hivemind? Reevaluating Evidence for the Open-Ended Homogeneity of Language Modelscited by 0