Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large language models are transforming the creative process by offering unprecedented capabilities to algorithmically generate ideas. While these tools can enhance human creativity when people co-create with them, it's unclear how this will impact unassisted human creativity. We conducted two large pre-registered parallel experiments involving 1,100 participants attempting tasks targeting the two core components of creativity, divergent and convergent thinking. We compare the effects of two forms of large language model (LLM) assistance -- a standard LLM providing direct answers and a coach-like LLM offering guidance -- with a control group receiving no AI assistance, and focus particularly on how all groups perform in a final, unassisted stage. Our findings reveal that while LLM assistance can provide short-term boosts in creativity during assisted tasks, it may inadvertently hinder independent creative performance when users work without assistance, raising concerns about the long-term impact on human creativity and cognition.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 10 of its 63 references that are in the map. First posted on arXiv 24 Sep 2024.
Builds on
10 of 63 references.
References · 10
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
- 2023Does Writing with Language Models Reduce Content Diversity?cited by 192
- 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
- 2024Building Machines that Learn and Think with Peoplecited by 73
- 2024LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Playcited by 66
- 2023Comparing Traditional and LLM-based Search for Consumer Choice: A Randomized Experimentcited by 36
- 2024How AI Ideas Affect the Creativity, Diversity, and Evolution of Human Ideas: Evidence From a Large, Dynamic Experimentcited by 22
- 2021Inspiration through Observation: Demonstrating the Influence of Automatically Generated Text on Creative Writingcited by 14
Built on by
Citing papers per year: 2024: 1; 2025: 17; 2026: 25.
43 papers.
Sort:
By area:
- 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedbackcited by 42
- 2025Creativity in LLM-based Multi-Agent Systems: A Surveycited by 23
- 2025Understanding, Protecting, and Augmenting Human Cognition with Generative AI: A Synthesis of the CHI 2025 Tools for Thought Workshopcited by 7
- 2025GODBench: A Benchmark for Multimodal Large Language Models in Video Comment Artcited by 5
- 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Designcited by 5
- 2025Recognising, Anticipating, and Mitigating LLM Pollution of Online Behavioural Researchcited by 4
- 2025ConlangCrafter: Constructing Languages with a Multi-Hop LLM Pipelinecited by 4
- 2025Vibe Coding in Product Teams: Reconfiguring AI-Assisted Workflows, Prototyping, and Collaborationcited by 4
- 2025Novice Developers' Perspectives on Adopting LLMs for Software Development: A Systematic Literature Reviewcited by 3
- 2025Diverse AI Personas Can Mitigate the Homogenization Effect in Human-AI Collaborative Ideationcited by 3
- 2025Large Language Models as Search Engines: Societal Challengescited by 3
- 2026Reflexis: Supporting Reflexivity and Rigor in Collaborative Qualitative Analysis through Design for Deliberationcited by 3
31 more
- 2025Scaffolding Recursive Divergence and Convergence in Story Ideationcited by 2
- 2025To Trade or Not to Trade: An Agentic Approach to Estimating Market Risk Improves Trading Decisionscited by 2
- 2025Exploration vs. Fixation: Scaffolding Divergent and Convergent Thinking for Human-AI Co-Creation with Generative Modelscited by 2
- 2026AI-Associated Lexical Shifts Across 34 Languages: Cross-Lingual Convergence and Diachronic Uptake in News Writingcited by 2
- 2026Automated Creativity Evaluation of Language Models Across Open-Ended Taskscited by 2
- 2025Beyond Text: Characterizing Domain Expert Needs in Document Researchcited by 1
- 2025AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaborationcited by 1
- 2026From Answer Givers to Design Mentors: Guiding LLMs with the Cognitive Apprenticeship Modelcited by 1
- 2026Are Semantic Networks Associated with Idea Originality in Artificial Creativity? A Comparison with Human Agentscited by 1
- 2026Interrogating Design Homogenization in Web Vibe Codingcited by 1
- 2026Incentives shape how humans co-create with generative AIcited by 1
- 2026TeamLLM: A Human-Like Team-Oriented Collaboration Framework for Multi-Step Contextualized Taskscited by 1
- 2026The Effect of Idea Elaboration on the Automatic Assessment of Idea Originalitycited by 1
- 2026Ex Ante Evaluation of AI-Induced Idea Diversity Collapsecited by 1
- 2026Is Convergence Inevitable? Tracing Output Homogeneity Back to Base Modelscited by 1
- 2026The Limits of Automatic Evaluation of Creativity in Large Language Modelscited by 1
- 2025Local Differences, Global Lessons: Insights from Organisation Policies for International Legislationcited by 0
- 2025Galton's Law of Mediocrity: Why Large Language Models Regress to the Mean and Fail at Creativity in Advertisingcited by 0
- 2026Human Thinking under Plural LLM Assistance: Mathematical Problem Solving and Open-Ended Writingcited by 0
- 2026Disrupting Cognitive Passivity: Rethinking AI-Assisted Data Literacy through Cognitive Alignmentcited by 0
- 2026Beyond Compliance: How AI Could Help Creative Writers by Refusing Themcited by 0
- 2026Developing and Validating the Spanish Version of the Large Language Models Dependency Scale (LLM-D12-SP)cited by 0
- 2026Where Models Converge and Humans Diverge: A Coverage Framework for Distributional Pluralism in Open-Ended Generationcited by 0
- 2026AI Evaluation Should Work With Humanscited by 0
- 2026From Style Replication to Style Exploration: Enabling Art Style Exploration with Analyze-Experiment-Resituate Frameworkcited by 0
- 2026Decoupled Analysis-Judging: An Automated Creativity Evaluator Using LLMs in Complex Multi-step Creativity Taskscited by 0
- 2026Designing Against Deskilling: Metacognitive Feedback Reduces Cognitive Offloading to LLM Assistantscited by 0
- 2026Ownership in AI-Assisted Everyday Taskscited by 0
- 2026Is Imagination Derived from Hallucination? A Cross-Taxonomy Evaluation of Imagination and Hallucination in Large Language Modelscited by 0
- 2026Does AI Save Time on Product Design? A Randomized Controlled Experiment of AI Prompt-to-Design Workflowscited by 0
- 2026How Strong Is the Evidence for the Artificial Hivemind? Reevaluating Evidence for the Open-Ended Homogeneity of Language Modelscited by 0
- 2026How Strong Is the Evidence for the Artificial Hivemind? Reevaluating Evidence for the Open-Ended Homogeneity of Language Models27 Sep 2026
- 2026Does AI Save Time on Product Design? A Randomized Controlled Experiment of AI Prompt-to-Design Workflows22 Sep 2026
- 2026Ownership in AI-Assisted Everyday Tasks17 Sep 2026
- 2026Designing Against Deskilling: Metacognitive Feedback Reduces Cognitive Offloading to LLM Assistants17 Sep 2026
- 2026Decoupled Analysis-Judging: An Automated Creativity Evaluator Using LLMs in Complex Multi-step Creativity Tasks3 Sep 2026
- 2026Is Imagination Derived from Hallucination? A Cross-Taxonomy Evaluation of Imagination and Hallucination in Large Language Models26 Aug 2026
- 2026The Limits of Automatic Evaluation of Creativity in Large Language Models24 Aug 2026
- 2026From Style Replication to Style Exploration: Enabling Art Style Exploration with Analyze-Experiment-Resituate Framework14 Aug 2026
- 2026Is Convergence Inevitable? Tracing Output Homogeneity Back to Base Models11 Aug 2026
- 2026Where Models Converge and Humans Diverge: A Coverage Framework for Distributional Pluralism in Open-Ended Generation6 Aug 2026
- 2026Developing and Validating the Spanish Version of the Large Language Models Dependency Scale (LLM-D12-SP)24 Jul 2026
- 2026AI Evaluation Should Work With Humans6 Jul 2026
31 more
- 2026Automated Creativity Evaluation of Language Models Across Open-Ended Tasks10 Jun 2026
- 2026AI-Associated Lexical Shifts Across 34 Languages: Cross-Lingual Convergence and Diachronic Uptake in News Writing25 May 2026
- 2026Ex Ante Evaluation of AI-Induced Idea Diversity Collapse7 May 2026
- 2026The Effect of Idea Elaboration on the Automatic Assessment of Idea Originality22 Apr 2026
- 2026TeamLLM: A Human-Like Team-Oriented Collaboration Framework for Multi-Step Contextualized Tasks8 Apr 2026
- 2026Incentives shape how humans co-create with generative AI4 Apr 2026
- 2026Beyond Compliance: How AI Could Help Creative Writers by Refusing Them3 Apr 2026
- 2026Disrupting Cognitive Passivity: Rethinking AI-Assisted Data Literacy through Cognitive Alignment3 Apr 2026
- 2026Human Thinking under Plural LLM Assistance: Mathematical Problem Solving and Open-Ended Writing3 Apr 2026
- 2026Interrogating Design Homogenization in Web Vibe Coding13 Mar 2026
- 2026Are Semantic Networks Associated with Idea Originality in Artificial Creativity? A Comparison with Human Agents2 Feb 2026
- 2026From Answer Givers to Design Mentors: Guiding LLMs with the Cognitive Apprenticeship Model27 Jan 2026
- 2026Reflexis: Supporting Reflexivity and Rigor in Collaborative Qualitative Analysis through Design for Deliberation21 Jan 2026
- 2025Exploration vs. Fixation: Scaffolding Divergent and Convergent Thinking for Human-AI Co-Creation with Generative Models20 Dec 2025
- 2025Large Language Models as Search Engines: Societal Challenges24 Nov 2025
- 2025AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaboration22 Nov 2025
- 2025Galton's Law of Mediocrity: Why Large Language Models Regress to the Mean and Fail at Creativity in Advertising30 Sep 2025
- 2025Vibe Coding in Product Teams: Reconfiguring AI-Assisted Workflows, Prototyping, and Collaboration12 Sep 2025
- 2025Understanding, Protecting, and Augmenting Human Cognition with Generative AI: A Synthesis of the CHI 2025 Tools for Thought Workshop28 Aug 2025
- 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Design21 Aug 2025
- 2025ConlangCrafter: Constructing Languages with a Multi-Hop LLM Pipeline8 Aug 2025
- 2025Recognising, Anticipating, and Mitigating LLM Pollution of Online Behavioural Research2 Aug 2025
- 2025To Trade or Not to Trade: An Agentic Approach to Estimating Market Risk Improves Trading Decisions11 Jul 2025
- 2025Scaffolding Recursive Divergence and Convergence in Story Ideation4 Jul 2025
- 2025Creativity in LLM-based Multi-Agent Systems: A Survey27 May 2025
- 2025GODBench: A Benchmark for Multimodal Large Language Models in Video Comment Art16 May 2025
- 2025Beyond Text: Characterizing Domain Expert Needs in Document Research16 Apr 2025
- 2025Diverse AI Personas Can Mitigate the Homogenization Effect in Human-AI Collaborative Ideation29 Mar 2025
- 2025Novice Developers' Perspectives on Adopting LLMs for Software Development: A Systematic Literature Review10 Mar 2025
- 2025Local Differences, Global Lessons: Insights from Organisation Policies for International Legislation19 Feb 2025
- 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedback5 Oct 2024
- 2025Creativity in LLM-based Multi-Agent Systems: A Surveycited by 23
- 2025To Trade or Not to Trade: An Agentic Approach to Estimating Market Risk Improves Trading Decisionscited by 2
- 2026Are Semantic Networks Associated with Idea Originality in Artificial Creativity? A Comparison with Human Agentscited by 1
- 2026Are Semantic Networks Associated with Idea Originality in Artificial Creativity? A Comparison with Human Agents2 Feb 2026
- 2025To Trade or Not to Trade: An Agentic Approach to Estimating Market Risk Improves Trading Decisions11 Jul 2025
- 2025Creativity in LLM-based Multi-Agent Systems: A Survey27 May 2025
- 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedbackcited by 42
- 2025Understanding, Protecting, and Augmenting Human Cognition with Generative AI: A Synthesis of the CHI 2025 Tools for Thought Workshopcited by 7
- 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Designcited by 5
- 2025Recognising, Anticipating, and Mitigating LLM Pollution of Online Behavioural Researchcited by 4
- 2025ConlangCrafter: Constructing Languages with a Multi-Hop LLM Pipelinecited by 4
- 2025Vibe Coding in Product Teams: Reconfiguring AI-Assisted Workflows, Prototyping, and Collaborationcited by 4
- 2025Novice Developers' Perspectives on Adopting LLMs for Software Development: A Systematic Literature Reviewcited by 3
- 2025Diverse AI Personas Can Mitigate the Homogenization Effect in Human-AI Collaborative Ideationcited by 3
- 2025Large Language Models as Search Engines: Societal Challengescited by 3
- 2026Reflexis: Supporting Reflexivity and Rigor in Collaborative Qualitative Analysis through Design for Deliberationcited by 3
- 2025Scaffolding Recursive Divergence and Convergence in Story Ideationcited by 2
- 2025Exploration vs. Fixation: Scaffolding Divergent and Convergent Thinking for Human-AI Co-Creation with Generative Modelscited by 2
12 most cited of 38 All 38 (JSON)
- 2026How Strong Is the Evidence for the Artificial Hivemind? Reevaluating Evidence for the Open-Ended Homogeneity of Language Models27 Sep 2026
- 2026Does AI Save Time on Product Design? A Randomized Controlled Experiment of AI Prompt-to-Design Workflows22 Sep 2026
- 2026Ownership in AI-Assisted Everyday Tasks17 Sep 2026
- 2026Designing Against Deskilling: Metacognitive Feedback Reduces Cognitive Offloading to LLM Assistants17 Sep 2026
- 2026Decoupled Analysis-Judging: An Automated Creativity Evaluator Using LLMs in Complex Multi-step Creativity Tasks3 Sep 2026
- 2026Is Imagination Derived from Hallucination? A Cross-Taxonomy Evaluation of Imagination and Hallucination in Large Language Models26 Aug 2026
- 2026The Limits of Automatic Evaluation of Creativity in Large Language Models24 Aug 2026
- 2026From Style Replication to Style Exploration: Enabling Art Style Exploration with Analyze-Experiment-Resituate Framework14 Aug 2026
- 2026Is Convergence Inevitable? Tracing Output Homogeneity Back to Base Models11 Aug 2026
- 2026Where Models Converge and Humans Diverge: A Coverage Framework for Distributional Pluralism in Open-Ended Generation6 Aug 2026
- 2026Developing and Validating the Spanish Version of the Large Language Models Dependency Scale (LLM-D12-SP)24 Jul 2026
- 2026AI Evaluation Should Work With Humans6 Jul 2026
12 newest of 38 All 38 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025CreativityPrism: A Cross-Domain Evaluation Framework for Large Language Model Creativity
- 2024Humanlike Cognitive Patterns as Emergent Phenomena in Large Language Models
- 2026CreativityNeuro: Steering Language Model Weights to Improve Divergent Thinking and Reduce Mode Collapse
- 2026Multi-agent AI systems outperform human teams in creativity
- 2024Enhancing Creativity in Large Language Models through Associative Thinking Strategies
- 2024Creativity Has Left the Chat: The Price of Debiasing Language Models
- 2026Large Language Models Align with the Human Brain during Creative Thinking
- 2026AI and Its Impact on Creativity and Diversity: An Empirical Study of LLM-Generated Product Ideas