Ex Ante Evaluation of AI-Induced Idea Diversity Collapse
Not on the map. Why?
Abstract (arXiv)
Creative AI systems are typically evaluated at the level of individual utility, yet creative outputs are consumed in populations: an idea loses value when many others produce similar ones. This creates an evaluation blind spot, as AI can improve individual outputs while increasing population-level crowding. We introduce a human-relative framework for benchmarking AI-induced human diversity collapse without requiring human-AI interaction data, providing an ex ante protocol to estimate crowding risk from model-only generations and matched unaided human baselines. By modeling ideas as congestible resources, we show that source-level crowding is identifiable from within-distribution comparisons, yielding an excess-crowding coefficient Delta and a human-relative diversity ratio ρ. We show that ρ≥1 is the no-excess-crowding parity condition and connect Delta to an adoption game with exposure-dependent redundancy costs. Across short stories, marketing slogans, and alternative-uses tasks, three frontier LLMs fall below parity across crowding kernels. Estimates stabilize with feasible model-only sample sizes. Importantly, generation-protocol variants show that crowding can be reduced through targeted design, making diversity collapse an actionable, development-time evaluation target for population-aware creative AI.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 54 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
28 of 54 references.
References · 28
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 396
- 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 172
- 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 167
- 2024Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputscited by 150
- 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
- 2023LLM-Eval: Unified Multi-Dimensional Automatic Evaluation for Open-Domain Conversations with Large Language Modelscited by 101
- 2025Jointly Reinforcing Diversity and Quality in Language Model Generationscited by 80
- 2025NoveltyBench: Evaluating Language Models for Humanlike Diversitycited by 66
- 2025Evaluating the Diversity and Quality of LLM Generated Contentcited by 51
16 more
- 2024Echoes in AI: Quantifying lack of plot diversity in LLM outputscited by 48
- 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinkingcited by 43
- 2025The Price of Format: Diversity Collapse in LLMscited by 43
- 2024AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Textcited by 42
- 2025We're Different, We're the Same: Creative Homogeneity Across LLMscited by 42
- 2025The Homogenizing Effect of Large Language Models on Human Expression and Thoughtcited by 35
- 2025Creativity in LLM-based Multi-Agent Systems: A Surveycited by 23
- 2024How AI Ideas Affect the Creativity, Diversity, and Evolution of Human Ideas: Evidence From a Large, Dynamic Experimentcited by 22
- 2024Evaluating Creative Short Story Generation in Humans and Large Language Modelscited by 21
- 2025A Comprehensive Analysis of Large Language Model Outputs: Similarity, Diversity, and Biascited by 10
- 2026Can Good Writing Be Generative? Expert-Level AI Writing Emerges through Fine-Tuning on High-Quality Bookscited by 9
- 2025Deep Associations, High Creativity: A Simple yet Effective Metric for Evaluating Large Language Modelscited by 7
- 2025Diverse AI Personas Can Mitigate the Homogenization Effect in Human-AI Collaborative Ideationcited by 3
- 2024AI Can Enhance Creativity in Social Networkscited by 2
- 2025MuseScorer: Idea Originality Scoring At Scalecited by 2
- 2026From semantic memory to collective creativity: A generative cognitive foundation for social creativity modelscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Anchorless Diversification for Parallel LLM Ideationcited by 1
- 2026Anchorless Diversification for Parallel LLM Ideation28 May 2026