How AI Ideas Affect the Creativity, Diversity, and Evolution of Human Ideas: Evidence From a Large, Dynamic Experiment
Not on the map. Why?
Abstract (arXiv)
Exposure to large language model output is rapidly increasing. How will seeing AI-generated ideas affect human ideas? We conducted an experiment (800+ participants, 40+ countries) where participants viewed creative ideas that were from ChatGPT or prior experimental participants and then brainstormed their own idea. We varied the number of AI-generated examples (none, low, or high exposure) and if the examples were labeled as 'AI' (disclosure). Our dynamic experiment design -- ideas from prior participants in an experimental condition are used as stimuli for future participants in the same experimental condition -- speaks to the interdependent process of cultural creation: creative ideas are built upon prior ideas. Hence, we capture the compounding effects of having LLMs 'in the culture loop'. We find that high AI exposure (but not low AI exposure) did not affect the creativity of individual ideas but did increase the average amount and rate of change of collective idea diversity. AI made ideas different, not better. There were no main effects of disclosure. We also found that self-reported creative people were less influenced by knowing an idea was from AI and that participants may knowingly adopt AI ideas when the task is difficult. Our findings suggest that introducing AI ideas may increase collective diversity but not individual creativity.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 15 of its 100 references that are in the map. First posted on arXiv 24 Jan 2024.
Builds on
15 of 100 references.
References · 15
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 343
- 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
- 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
- 2023Does Writing with Language Models Reduce Content Diversity?cited by 190
- 2022Human heuristics for AI-generated language are flawedcited by 104
- 2021Sparks: Inspiration for Science Writing using Language Modelscited by 80
- 2022Putting GPT-3's Creativity to the (Alternative Uses) Testcited by 62
- 2023Machine Culturecited by 55
- 2023Accelerating science with human-aware artificial intelligencecited by 27
- 2022On the Influence of Explainable AI on Automation Biascited by 18
- 2021Inspiration through Observation: Demonstrating the Influence of Automatically Generated Text on Creative Writingcited by 14
Built on by
Citing papers per year: 2024: 8; 2025: 9; 2026: 5.
22 papers.
Sort:
By area:
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 348
- 2024Building Machines that Learn and Think with Peoplecited by 73
- 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinkingcited by 43
- 2025LLM Probability Concentration: How Alignment Shrinks the Generative Horizoncited by 26
- 2024Plurals: A System for Guiding LLMs Via Simulated Social Ensemblescited by 17
- 2024A Systematic Assessment of OpenAI o1-Preview for Higher Order Thinking in Educationcited by 16
- 2024Position: Towards Bidirectional Human-AI Alignmentcited by 15
- 2025Optimizing Diversity and Quality through Base-Aligned Model Collaborationcited by 8
- 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaborationcited by 6
- 2025Deep Associations, High Creativity: A Simple yet Effective Metric for Evaluating Large Language Modelscited by 6
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 6
10 more
- 2025Generative AI and Creativity: A Systematic Literature Review and Meta-Analysiscited by 5
- 2024Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Designcited by 4
- 2025Conversational Agents as Catalysts for Critical Thinking: Challenging Social Influence in Group Decision-makingcited by 4
- 2025FutureGen: A RAG-based Approach to Generate the Future Work of Scientific Articlecited by 2
- 2026Ex Ante Evaluation of AI-Induced Idea Diversity Collapsecited by 1
- 2024Creativity in the Age of AI: Evaluating the Impact of Generative AI on Design Outputs and Designers' Creative Thinkingcited by 0
- 2025AI, Humans, and Data Science: Optimizing Roles Across Workflows and the Workforcecited by 0
- 2026"Looking for Something Weird to Happen": How Humans Sustain AI Agent Novelty Amid Semantic Collapsecited by 0
- 2026Small-world Networks of Agents Brainstorm AI Risks to Support Ideationcited by 0
- 2026How Strong Is the Evidence for the Artificial Hivemind? Reevaluating Evidence for the Open-Ended Homogeneity of Language Modelscited by 0
- 2026How Strong Is the Evidence for the Artificial Hivemind? Reevaluating Evidence for the Open-Ended Homogeneity of Language Models27 Sep 2026
- 2026Small-world Networks of Agents Brainstorm AI Risks to Support Ideation21 Sep 2026
- 2026"Looking for Something Weird to Happen": How Humans Sustain AI Agent Novelty Amid Semantic Collapse13 Sep 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026Ex Ante Evaluation of AI-Induced Idea Diversity Collapse7 May 2026
- 2025Optimizing Diversity and Quality through Base-Aligned Model Collaboration7 Nov 2025
- 2025Deep Associations, High Creativity: A Simple yet Effective Metric for Evaluating Large Language Models14 Oct 2025
- 2025AI, Humans, and Data Science: Optimizing Roles Across Workflows and the Workforce15 Jul 2025
- 2025LLM Probability Concentration: How Alignment Shrinks the Generative Horizon22 Jun 2025
- 2025Generative AI and Creativity: A Systematic Literature Review and Meta-Analysis22 May 2025
- 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaboration16 May 2025
- 2025FutureGen: A RAG-based Approach to Generate the Future Work of Scientific Article20 Mar 2025
10 more
- 2025Conversational Agents as Catalysts for Critical Thinking: Challenging Social Influence in Group Decision-making18 Mar 2025
- 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan 2025
- 2024Creativity in the Age of AI: Evaluating the Impact of Generative AI on Design Outputs and Designers' Creative Thinking31 Oct 2024
- 2024A Systematic Assessment of OpenAI o1-Preview for Higher Order Thinking in Education11 Oct 2024
- 2024Plurals: A System for Guiding LLMs Via Simulated Social Ensembles25 Sep 2024
- 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking24 Sep 2024
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers6 Sep 2024
- 2024Building Machines that Learn and Think with People22 Jul 2024
- 2024Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Design17 Jun 2024
- 2024Position: Towards Bidirectional Human-AI Alignment13 Jun 2024
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 348
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 6
- 2026Small-world Networks of Agents Brainstorm AI Risks to Support Ideationcited by 0
- 2026Small-world Networks of Agents Brainstorm AI Risks to Support Ideation21 Sep 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan 2025
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers6 Sep 2024
- 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinkingcited by 43
- 2024A Systematic Assessment of OpenAI o1-Preview for Higher Order Thinking in Educationcited by 16
- 2024Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Designcited by 4
- 2025Conversational Agents as Catalysts for Critical Thinking: Challenging Social Influence in Group Decision-makingcited by 4
- 2025Conversational Agents as Catalysts for Critical Thinking: Challenging Social Influence in Group Decision-making18 Mar 2025
- 2024A Systematic Assessment of OpenAI o1-Preview for Higher Order Thinking in Education11 Oct 2024
- 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking24 Sep 2024
- 2024Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Design17 Jun 2024
- 2024Building Machines that Learn and Think with Peoplecited by 73
- 2024Plurals: A System for Guiding LLMs Via Simulated Social Ensemblescited by 17
- 2025Optimizing Diversity and Quality through Base-Aligned Model Collaborationcited by 8
- 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaborationcited by 6
- 2025Deep Associations, High Creativity: A Simple yet Effective Metric for Evaluating Large Language Modelscited by 6
- 2025Generative AI and Creativity: A Systematic Literature Review and Meta-Analysiscited by 5
- 2025FutureGen: A RAG-based Approach to Generate the Future Work of Scientific Articlecited by 2
- 2026Ex Ante Evaluation of AI-Induced Idea Diversity Collapsecited by 1
- 2024Creativity in the Age of AI: Evaluating the Impact of Generative AI on Design Outputs and Designers' Creative Thinkingcited by 0
- 2025AI, Humans, and Data Science: Optimizing Roles Across Workflows and the Workforcecited by 0
- 2026"Looking for Something Weird to Happen": How Humans Sustain AI Agent Novelty Amid Semantic Collapsecited by 0
- 2026How Strong Is the Evidence for the Artificial Hivemind? Reevaluating Evidence for the Open-Ended Homogeneity of Language Modelscited by 0
- 2026How Strong Is the Evidence for the Artificial Hivemind? Reevaluating Evidence for the Open-Ended Homogeneity of Language Models27 Sep 2026
- 2026"Looking for Something Weird to Happen": How Humans Sustain AI Agent Novelty Amid Semantic Collapse13 Sep 2026
- 2026Ex Ante Evaluation of AI-Induced Idea Diversity Collapse7 May 2026
- 2025Optimizing Diversity and Quality through Base-Aligned Model Collaboration7 Nov 2025
- 2025Deep Associations, High Creativity: A Simple yet Effective Metric for Evaluating Large Language Models14 Oct 2025
- 2025AI, Humans, and Data Science: Optimizing Roles Across Workflows and the Workforce15 Jul 2025
- 2025Generative AI and Creativity: A Systematic Literature Review and Meta-Analysis22 May 2025
- 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaboration16 May 2025
- 2025FutureGen: A RAG-based Approach to Generate the Future Work of Scientific Article20 Mar 2025
- 2024Creativity in the Age of AI: Evaluating the Impact of Generative AI on Design Outputs and Designers' Creative Thinking31 Oct 2024
- 2024Plurals: A System for Guiding LLMs Via Simulated Social Ensembles25 Sep 2024
- 2024Building Machines that Learn and Think with People22 Jul 2024