Large Language Models show both individual and collective creativity comparable to humans
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence has, so far, largely automated routine tasks, but what does it mean for the future of work if Large Language Models (LLMs) show creativity comparable to humans? To measure the creativity of LLMs holistically, the current study uses 13 creative tasks spanning three domains. We benchmark the LLMs against individual humans, and also take a novel approach by comparing them to the collective creativity of groups of humans. We find that the best LLMs (Claude and GPT-4) rank in the 52nd percentile against humans, and overall LLMs excel in divergent thinking and problem solving but lag in creative writing. When questioned 10 times, an LLM's collective creativity is equivalent to 8-10 humans. When more responses are requested, two additional responses of LLMs equal one extra human. Ultimately, LLMs, when optimally applied, may compete with a small group of humans in the future of work.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 7 of its 48 references that are in the map. First posted on arXiv 4 Dec 2024.
Builds on
7 of 48 references.
References · 7
- 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 168
- 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 165
- 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
- 2023Is ChatGPT the Ultimate Programming Assistant -- How far is it?cited by 72
- 2023Probing the Creativity of Large Language Models: Can models produce divergent semantic association?cited by 31
- 2023Artificial muses: Generative Artificial Intelligence Chatbots Have Risen to Human-Level Creativitycited by 24
- 2023Prompting a Large Language Model to Generate Diverse Motivational Messages: A Comparison with Human-Written Messagescited by 10
Built on by
Citing papers per year: 2025: 5; 2026: 4.
9 papers.
- 2025What and Whose Knowledge? Measuring Epistemic Diversity in Large Language Modelscited by 14
- 2025Evaluating Text Creativity across Diverse Domains: A Dataset and Large Language Model Evaluatorcited by 9
- 2025Has the Creativity of Large-Language Models peaked? An analysis of inter- and intra-LLM variabilitycited by 6
- 2025Generative AI and Creativity: A Systematic Literature Review and Meta-Analysiscited by 5
- 2026Post-training makes large language models less human-likecited by 4
- 2026MOSAIC: Unveiling the Moral, Social and Individual Dimensions of Large Language Modelscited by 2
- 2026Automated Creativity Evaluation of Language Models Across Open-Ended Taskscited by 2
- 2025Why can't Epidemiology be automated (yet)?cited by 1
- 2026Assessing mentalization in humans and large language modelscited by 0
- 2026Assessing mentalization in humans and large language models26 Aug 2026
- 2026Automated Creativity Evaluation of Language Models Across Open-Ended Tasks10 Jun 2026
- 2026Post-training makes large language models less human-like8 May 2026
- 2026MOSAIC: Unveiling the Moral, Social and Individual Dimensions of Large Language Models9 Feb 2026
- 2025What and Whose Knowledge? Measuring Epistemic Diversity in Large Language Models5 Oct 2025
- 2025Why can't Epidemiology be automated (yet)?21 Jul 2025
- 2025Evaluating Text Creativity across Diverse Domains: A Dataset and Large Language Model Evaluator25 May 2025
- 2025Generative AI and Creativity: A Systematic Literature Review and Meta-Analysis22 May 2025
- 2025Has the Creativity of Large-Language Models peaked? An analysis of inter- and intra-LLM variability10 Apr 2025