mlsanityData to 7 Oct 2026

Beyond the Hivemind: Escaping LLM Homogeneity via Meta-Persona Anchoring and Sequential Temperature Scaling

arXiv 2608.02618 ↗First posted 31 May 2026cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent studies have identified an ``Artificial Hivemind'' effect in Large Language Models (LLMs) causing models to converge on a narrow, homogenized consensus even for open questions. This semantic collapse limits the diversity of AI, resulting in high inter-response similarity (≈ 0.80-0.90) even under high-temperature sampling. In this paper, we propose a novel mitigation framework to increase diversity: Meta-Persona Anchoring combined with Filtered Temperature Scaling (FTS). Our approach utilizes a two-stage generation process: first, the model is prompted to self-select a unique, idiosyncratic persona to anchor its starting point; second, we apply a dual-stage sampling sieve, utilizing Top-p filtering to preserve grammatical validity followed by extreme temperature scaling (T ≥ 4.0) on the surviving candidates to explore the broadened probability distribution. We evaluate our method using the INFINITY-CHAT dataset on state-of-the-art open weight models under ~20B parameters. Our results demonstrate a significant reduction in semantic convergence, with average pairwise cosine similarity dropping from (≈ 0.85) to (≈ 0.65). Our scheme achieves a majority of questions below the 0.7 threshold, effectively reducing the gap between artificial mode collapse and human-level typological diversity. We provide our implementation as an open-source framework to enable more diverse and creative AI deployments.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 16 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

12 of 16 references.

References · 12

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  5. 2023Instruction Tuning for Large Language Models: A Surveycited by 617
  6. 2024Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputscited by 148
  7. 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 137
  8. 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 100
  9. 2023Towards Understanding the Interplay of Generative Artificial Intelligence and the Internetcited by 54
  10. 2026Min-k Sampling: Decoupling Truncation from Temperature Scaling via Relative Logit Dynamicscited by 8
  11. 2026Latent Semantic Manifolds in Large Language Modelscited by 5
  12. 2026Not All Layers Need Tuning: Selective Layer Restoration Recovers Diversitycited by 1

Built on by

Not cited yet.