mlsanityData to 14 Oct 2026

Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking

arXiv 2410.03703 ↗First posted 24 Sep 2024cs.HCcited by 43

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language models are transforming the creative process by offering unprecedented capabilities to algorithmically generate ideas. While these tools can enhance human creativity when people co-create with them, it's unclear how this will impact unassisted human creativity. We conducted two large pre-registered parallel experiments involving 1,100 participants attempting tasks targeting the two core components of creativity, divergent and convergent thinking. We compare the effects of two forms of large language model (LLM) assistance -- a standard LLM providing direct answers and a coach-like LLM offering guidance -- with a control group receiving no AI assistance, and focus particularly on how all groups perform in a final, unassisted stage. Our findings reveal that while LLM assistance can provide short-term boosts in creativity during assisted tasks, it may inadvertently hinder independent creative performance when users work without assistance, raising concerns about the long-term impact on human creativity and cognition.

Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 10 of its 63 references that are in the map. First posted on arXiv 24 Sep 2024.

Builds on

10 of 63 references.

References · 10

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  3. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
  4. 2023Does Writing with Language Models Reduce Content Diversity?cited by 192
  5. 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
  6. 2024Building Machines that Learn and Think with Peoplecited by 73
  7. 2024LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Playcited by 66
  8. 2023Comparing Traditional and LLM-based Search for Consumer Choice: A Randomized Experimentcited by 36
  9. 2024How AI Ideas Affect the Creativity, Diversity, and Evolution of Human Ideas: Evidence From a Large, Dynamic Experimentcited by 22
  10. 2021Inspiration through Observation: Demonstrating the Influence of Automatically Generated Text on Creative Writingcited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 17; 2026: 25.

43 papers.

Sort:

By area:

  1. 2024IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded Feedbackcited by 42
  2. 2025Creativity in LLM-based Multi-Agent Systems: A Surveycited by 23
  3. 2025Understanding, Protecting, and Augmenting Human Cognition with Generative AI: A Synthesis of the CHI 2025 Tools for Thought Workshopcited by 7
  4. 2025GODBench: A Benchmark for Multimodal Large Language Models in Video Comment Artcited by 5
  5. 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Designcited by 5
  6. 2025Recognising, Anticipating, and Mitigating LLM Pollution of Online Behavioural Researchcited by 4
  7. 2025ConlangCrafter: Constructing Languages with a Multi-Hop LLM Pipelinecited by 4
  8. 2025Vibe Coding in Product Teams: Reconfiguring AI-Assisted Workflows, Prototyping, and Collaborationcited by 4
  9. 2025Novice Developers' Perspectives on Adopting LLMs for Software Development: A Systematic Literature Reviewcited by 3
  10. 2025Diverse AI Personas Can Mitigate the Homogenization Effect in Human-AI Collaborative Ideationcited by 3
  11. 2025Large Language Models as Search Engines: Societal Challengescited by 3
  12. 2026Reflexis: Supporting Reflexivity and Rigor in Collaborative Qualitative Analysis through Design for Deliberationcited by 3
31 more
  1. 2025Scaffolding Recursive Divergence and Convergence in Story Ideationcited by 2
  2. 2025To Trade or Not to Trade: An Agentic Approach to Estimating Market Risk Improves Trading Decisionscited by 2
  3. 2025Exploration vs. Fixation: Scaffolding Divergent and Convergent Thinking for Human-AI Co-Creation with Generative Modelscited by 2
  4. 2026AI-Associated Lexical Shifts Across 34 Languages: Cross-Lingual Convergence and Diachronic Uptake in News Writingcited by 2
  5. 2026Automated Creativity Evaluation of Language Models Across Open-Ended Taskscited by 2
  6. 2025Beyond Text: Characterizing Domain Expert Needs in Document Researchcited by 1
  7. 2025AnimAgents: Coordinating Multi-Stage Animation Pre-Production with Human-Multi-Agent Collaborationcited by 1
  8. 2026From Answer Givers to Design Mentors: Guiding LLMs with the Cognitive Apprenticeship Modelcited by 1
  9. 2026Are Semantic Networks Associated with Idea Originality in Artificial Creativity? A Comparison with Human Agentscited by 1
  10. 2026Interrogating Design Homogenization in Web Vibe Codingcited by 1
  11. 2026Incentives shape how humans co-create with generative AIcited by 1
  12. 2026TeamLLM: A Human-Like Team-Oriented Collaboration Framework for Multi-Step Contextualized Taskscited by 1
  13. 2026The Effect of Idea Elaboration on the Automatic Assessment of Idea Originalitycited by 1
  14. 2026Ex Ante Evaluation of AI-Induced Idea Diversity Collapsecited by 1
  15. 2026Is Convergence Inevitable? Tracing Output Homogeneity Back to Base Modelscited by 1
  16. 2026The Limits of Automatic Evaluation of Creativity in Large Language Modelscited by 1
  17. 2025Local Differences, Global Lessons: Insights from Organisation Policies for International Legislationcited by 0
  18. 2025Galton's Law of Mediocrity: Why Large Language Models Regress to the Mean and Fail at Creativity in Advertisingcited by 0
  19. 2026Human Thinking under Plural LLM Assistance: Mathematical Problem Solving and Open-Ended Writingcited by 0
  20. 2026Disrupting Cognitive Passivity: Rethinking AI-Assisted Data Literacy through Cognitive Alignmentcited by 0
  21. 2026Beyond Compliance: How AI Could Help Creative Writers by Refusing Themcited by 0
  22. 2026Developing and Validating the Spanish Version of the Large Language Models Dependency Scale (LLM-D12-SP)cited by 0
  23. 2026Where Models Converge and Humans Diverge: A Coverage Framework for Distributional Pluralism in Open-Ended Generationcited by 0
  24. 2026AI Evaluation Should Work With Humanscited by 0
  25. 2026From Style Replication to Style Exploration: Enabling Art Style Exploration with Analyze-Experiment-Resituate Frameworkcited by 0
  26. 2026Decoupled Analysis-Judging: An Automated Creativity Evaluator Using LLMs in Complex Multi-step Creativity Taskscited by 0
  27. 2026Designing Against Deskilling: Metacognitive Feedback Reduces Cognitive Offloading to LLM Assistantscited by 0
  28. 2026Ownership in AI-Assisted Everyday Taskscited by 0
  29. 2026Is Imagination Derived from Hallucination? A Cross-Taxonomy Evaluation of Imagination and Hallucination in Large Language Modelscited by 0
  30. 2026Does AI Save Time on Product Design? A Randomized Controlled Experiment of AI Prompt-to-Design Workflowscited by 0
  31. 2026How Strong Is the Evidence for the Artificial Hivemind? Reevaluating Evidence for the Open-Ended Homogeneity of Language Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025CreativityPrism: A Cross-Domain Evaluation Framework for Large Language Model Creativity
  2. 2024Humanlike Cognitive Patterns as Emergent Phenomena in Large Language Models
  3. 2026CreativityNeuro: Steering Language Model Weights to Improve Divergent Thinking and Reduce Mode Collapse
  4. 2026Multi-agent AI systems outperform human teams in creativity
  5. 2024Enhancing Creativity in Large Language Models through Associative Thinking Strategies
  6. 2024Creativity Has Left the Chat: The Price of Debiasing Language Models
  7. 2026Large Language Models Align with the Human Brain during Creative Thinking
  8. 2026AI and Its Impact on Creativity and Diversity: An Empirical Study of LLM-Generated Product Ideas