Where Models Converge and Humans Diverge: A Coverage Framework for Distributional Pluralism in Open-Ended Generation
Not on the map. Why?
Abstract (arXiv)
When a large language model (LLM) writes Harry Potter fanfiction, it reliably produces fundamental elements of the Hogwarts universe, such as recognizable places and characters. Human-written Harry Potter fanfictions, however, typically include these fundamentals and much more, incorporating stylistically irregular content and relationship-diverse plotlines. This gap between LLM and human writing has been noted across a variety of domains. LLMs tend to produce "average" writing, while human writing contains more diverse content that covers a broader distribution. Existing work has shown the existence of this distributional "gap", but no work has proposed a systematic way to measure it. Our paper proposes a human-grounded framework that uses the empirical distribution of human writing on a topic to measure the distributional breadth of LLM-generated content on that same topic. We propose two metrics, LLM Coverage (LLM-Cov) and In-Boundary Rate (IBR), that separate the plausibility of LLM content from its distributional breadth. Across ideation and narrative tasks, we find that current LLMs produce plausible but narrow content that concentrates near the center of the human response space. Our framework can enable researchers to better assess the distributional breadth of LLM-authored content, which we term its "cultural reach".
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 57 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
35 of 57 references.
References · 35
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
- 2023Whose Opinions Do Language Models Reflect?cited by 773
- 2021Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotationscited by 314
- 2023Does Writing with Language Models Reduce Content Diversity?cited by 192
- 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 172
- 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 167
- 2024The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Modelscited by 144
- 2024Investigating Cultural Alignment of Large Language Modelscited by 143
- 2022The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluationcited by 139
- 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
- 2024Collective Constitutional AI: Aligning a Language Model with Public Inputcited by 123
23 more
- 2024Modular Pluralism: Pluralistic Alignment via Multi-LLM Collaborationcited by 113
- 2025NoveltyBench: Evaluating Language Models for Humanlike Diversitycited by 66
- 2024Benchmarking Distributional Alignment of Large Language Modelscited by 61
- 2023Machine Culturecited by 55
- 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinkingcited by 43
- 2025We're Different, We're the Same: Creative Homogeneity Across LLMscited by 42
- 2024Assessing and Understanding Creativity in Large Language Modelscited by 35
- 2025Cultivating Pluralism In Algorithmic Monoculture: The Community Alignment Datasetcited by 35
- 2023MacGyver: Are Large Language Models Creative Problem Solvers?cited by 34
- 2023Probing the Creativity of Large Language Models: Can models produce divergent semantic association?cited by 33
- 2024Divergent Creativity in Humans and Large Language Modelscited by 31
- 2024Self-Pluralising Culture Alignment for Large Language Modelscited by 31
- 2025A Survey on Personalized and Pluralistic Preference Alignment in Large Language Modelscited by 27
- 2024CS4: Measuring the Creativity of Large Language Models Automatically by Controlling the Number of Story-Writing Constraintscited by 24
- 2024Evaluating Creative Short Story Generation in Humans and Large Language Modelscited by 21
- 2025Can Language Models Represent the Past without Anachronism?cited by 14
- 2025Provocations from the Humanities for Generative AI Researchcited by 10
- 2026Computational Hermeneutics: Evaluating generative AI as a cultural technologycited by 8
- 2025Benchmarking Overton Pluralism in LLMscited by 7
- 2026PERSPECTRA: A Scalable and Configurable Pluralist Benchmark of Perspectives from Argumentscited by 3
- 2025Fanfiction in the Age of AI: Community Perspectives on Creativity, Authenticity and Adoptioncited by 2
- 2025What Shapes a Creative Machine Mind? Comprehensively Benchmarking Creativity in Foundation Modelscited by 2
- 2025A Comparative Approach to Assessing Linguistic Creativity of Large Language Models and Humanscited by 1
Built on by
Not cited yet.