mlsanityData to 14 Oct 2026

How Strong Is the Evidence for the Artificial Hivemind? Reevaluating Evidence for the Open-Ended Homogeneity of Language Models

arXiv 2609.33936 ↗First posted 27 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent research argues that language models exhibit pronounced homogeneity in open-ended generation, framing such behavior as an Artificial Hivemind that poses a long-term threat to human creativity. We examine three of its central results. First, the flagship example is that model responses to "Write a metaphor involving time" collapse into two clusters. Visualization, spectral analysis, clustering, and language model labels all contradict this description. The labels record each response's vehicle, what it compares time to. Our responses and the original authors' own show one dominant vehicle plus a heavy tail of distinct minority vehicles. "Time" is one of our least diverse topics, so the example is a favorable case, not a representative one. Second, the paper measures homogeneity against an undemanding null: responses to unrelated prompts. Under a more demanding null (same-prompt responses expressing genuinely different ideas), 20%-32% of such pairs already exceed the paper's 0.8 convergence threshold. A residual effect survives this null. The paper's same-prompt pairs exceed 0.8 roughly two to three times as often as our different-idea pairs. Much of what the paper calls homogeneity is the shared geometry of answering the same prompt. The remaining measurements lack any null: no human baseline is collected, and the model-indistinguishability statistic has no null. Third, the paper concludes that inference-time interventions are inadequate for combating the Artificial Hivemind, writing that "more generalizable solutions are needed at the model training level." We show that this conclusion is unsupported in three ways, and that an inference-time intervention (prompting) reliably raises measured response diversity. We do not resolve whether the Artificial Hivemind is real. We show that the published evidence does not establish it.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

28 of 40 references.

References · 28

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
  3. 2023Whose Opinions Do Language Models Reflect?cited by 773
  4. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
  5. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
  6. 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 396
  7. 2022Text and Code Embeddings by Contrastive Pre-Trainingcited by 361
  8. 2019Measurement and Fairnesscited by 308
  9. 2023Does Writing with Language Models Reduce Content Diversity?cited by 192
  10. 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 167
  11. 2021All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Qualitycited by 156
  12. 2024Large Language Models are Inconsistent and Biased Evaluatorscited by 153
16 more
  1. 2024Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputscited by 150
  2. 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 141
  3. 2020Evaluating the Evaluation of Diversity in Natural Language Generationcited by 129
  4. 2024Homogenization Effects of Large Language Models on Human Creative Ideationcited by 127
  5. 2025Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Taskcited by 106
  6. 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 105
  7. 2022Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?cited by 91
  8. 2024Is Cosine-Similarity of Embeddings Really About Similarity?cited by 89
  9. 2025NoveltyBench: Evaluating Language Models for Humanlike Diversitycited by 66
  10. 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinkingcited by 43
  11. 2024How AI Ideas Affect the Creativity, Diversity, and Evolution of Human Ideas: Evidence From a Large, Dynamic Experimentcited by 22
  12. 2024Effects of diversity incentives on sample diversity and downstream model performance in LLM-based text augmentationcited by 17
  13. 2024Prompting Diverse Ideas: Increasing AI Idea Variancecited by 14
  14. 2025Min-p, Max Exaggeration: A Critical Analysis of Min-p Sampling in Language Modelscited by 10
  15. 2025Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Trackcited by 7
  16. 2025Measuring Lexical Diversity of Synthetic Data Generated through Fine-Grained Persona Promptingcited by 4

Built on by

Not cited yet.