mlsanityData to 14 Oct 2026

Galton's Law of Mediocrity: Why Large Language Models Regress to the Mean and Fail at Creativity in Advertising

arXiv 2509.25767 ↗First posted 30 Sep 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) generate fluent text yet often default to safe, generic phrasing, raising doubts about their ability to handle creativity. We formalize this tendency as a Galton-style regression to the mean in language and evaluate it using a creativity stress test in advertising concepts. When ad ideas were simplified step by step, creative features such as metaphors, emotions, and visual cues disappeared early, while factual content remained, showing that models favor high-probability information. When asked to regenerate from simplified inputs, models produced longer outputs with lexical variety but failed to recover the depth and distinctiveness of the originals. We combined quantitative comparisons with qualitative analysis, which revealed that the regenerated texts often appeared novel but lacked true originality. Providing ad-specific cues such as metaphors, emotional hooks and visual markers improved alignment and stylistic balance, though outputs still relied on familiar tropes. Taken together, the findings show that without targeted guidance, LLMs drift towards mediocrity in creative tasks; structured signals can partially counter this tendency and point towards pathways for developing creativity-sensitive models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

18 of 29 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  5. 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
  6. 2023Scaling Data-Constrained Language Modelscited by 403
  7. 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
  8. 2024Are Large Language Models Capable of Generating Human-Level Narratives?cited by 79
  9. 2023On the Creativity of Large Language Modelscited by 57
  10. 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinkingcited by 43
  11. 2025We're Different, We're the Same: Creative Homogeneity Across LLMscited by 42
  12. 2024Benchmarking Language Model Creativity: A Case Study on Code Generationcited by 40
6 more
  1. 2025Visual Large Language Models for Generalized and Specialized Applicationscited by 36
  2. 2024Creativity Has Left the Chat: The Price of Debiasing Language Modelscited by 29
  3. 2024Generating Interesting Scientific Ideas using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaderscited by 22
  4. 2024Evaluating Creative Short Story Generation in Humans and Large Language Modelscited by 21
  5. 2025Not-Just-Scaling Laws: Towards a Better Understanding of the Downstream Impact of Language Model Design Decisionscited by 12
  6. 2025Has the Creativity of Large-Language Models peaked? An analysis of inter- and intra-LLM variabilitycited by 6

Built on by

Not cited yet.