mlsanityData to 14 Oct 2026

Multi-LLM Systems Exhibit Robust Semantic Collapse

arXiv 2605.17193 ↗First posted 16 May 2026cs.MAcited by 2

Not on the map. Why?

Abstract (arXiv)

Whether machines can originate novel content has been debated for nearly two centuries, from Lovelace's assertion that no engine can "originate anything" to Turing's question of whether a machine can amplify ideas brought in from outside. Systems of multiple interacting LLMs, increasingly deployed for autonomous generation, reopen this question empirically. Here we show that such systems, operating in inference-only setups, exhibit semantic collapse: systematic convergence in semantic representations despite apparent lexical variation. Across model families, extended simulations of 200 to 1,000 rounds, the pattern remains consistent. Thirteen intervention strategies, spanning decoding parameters, prompt design, agent composition, activation engineering, and reinforcement learning, fail to restore semantic diversity. Mechanistic analyses suggest that semantic collapse is not explained by alignment or conformity biases, but is consistent with intrinsic properties of autoregressive generation. Our results point to persistent constraints on the ability of multi-LLM systems to sustain open-ended exploration in closed-loop settings.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 May 2026.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.