Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generation
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Multi-agent systems (MAS) are increasingly used for open-ended idea generation, driven by the expectation that collective interaction will broaden the exploration diversity. However, when and why such collaboration truly expands the solution space remains unclear. We present a systematic empirical study of diversity in MAS-based ideation across three bottom-up levels: model intelligence, agent cognition, and system dynamics. At the model level, we identify a compute efficiency paradox, where stronger, highly aligned models yield diminishing marginal diversity despite higher per-sample quality. At the cognition level, authority-driven dynamics suppress semantic diversity compared to junior-dominated groups. At the system level, group-size scaling yields diminishing returns and dense communication topologies accelerate premature convergence. We characterize these outcomes as collective failures emerging from structural coupling, a process where interaction inadvertently contracts agent exploration and triggers diversity collapse. Our analysis shows that this collapse arises primarily from the interaction structure rather than inherent model insufficiency, highlighting the importance of preserving independence and disagreement when designing MAS for creative tasks. Our code is available at https://github.com/Xtra-Computing/MAS_Diversity.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 21 of its 56 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
21 of 56 references.
Closest ancestors · 2
Same direction, newest first
- 2025Unleashing Diverse Thinking Modes in LLMs through Multi-Agent Collaboration18 Oct
- 2025X-MAS: Towards Building Multi-Agent Systems with Heterogeneous LLMs22 May
Other references · 19
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2025Accelerating scientific discovery with Co-Scientistcited by 353
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 348
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2025LLM Social Simulations Are a Promising Research Methodcited by 97
- 2025NoveltyBench: Evaluating Language Models for Humanlike Diversitycited by 64
- 2024Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent Systemcited by 63
- 2025Deep Research: A Survey of Autonomous Research Agentscited by 63
- 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debatecited by 63
- 2025From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agentscited by 49
- 2025We're Different, We're the Same: Creative Homogeneity Across LLMscited by 41
- 2025Large Language Models for Planning: A Comprehensive and Systematic Surveycited by 38
7 more
- 2025LLM-based Human Simulations Have Not Yet Been Reliablecited by 30
- 2025Deep Research: A Systematic Surveycited by 23
- 2025A Survey on Hypothesis Generation for Scientific Discovery in the Era of Large Language Modelscited by 17
- 2025What and Whose Knowledge? Measuring Epistemic Diversity in Large Language Modelscited by 14
- 2025The wall confronting large language modelscited by 8
- 2025Position: The Current AI Conference Model is Unsustainable! Diagnosing the Crisis of Centralized AI Conferencecited by 7
- 2025Beyond Brainstorming: What Drives High-Quality Scientific Ideas? Lessons from Multi-Agent Collaborationcited by 6
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Social Theory Should Be a Structural Prior for Agentic AI: A Formal Framework for Multi-Agent Social Systemscited by 4
- 2026Diversifying Personalized Research Ideation against AI-Induced Homogenizationcited by 0
- 2026Sixteen models, fewer than two voices: measuring ensemble dispersion where no answer is uniquely correctcited by 0
- 2026AlphaDiverse: Post-Training Local Quantitative Research Agents for Diverse Exploration in Alpha Factor Miningcited by 0
- 2026Towards Better Exploration in Sequential Test-Time Scalingcited by 0
- 2026Federated Agent Optimizationcited by 0
- 2026No Model Required: Text Entropy Rate Filtering Mitigates Iterative Fine-Tuning Collapsecited by 0
- 2026No Model Required: Text Entropy Rate Filtering Mitigates Iterative Fine-Tuning Collapse1 Oct 2026
- 2026Federated Agent Optimization1 Oct 2026
- 2026Towards Better Exploration in Sequential Test-Time Scaling30 Sep 2026
- 2026AlphaDiverse: Post-Training Local Quantitative Research Agents for Diverse Exploration in Alpha Factor Mining24 Sep 2026
- 2026Sixteen models, fewer than two voices: measuring ensemble dispersion where no answer is uniquely correct31 Jul 2026
- 2026Diversifying Personalized Research Ideation against AI-Induced Homogenization30 Jul 2026
- 2026Social Theory Should Be a Structural Prior for Agentic AI: A Formal Framework for Multi-Agent Social Systems8 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
- 2025On the Dynamics of Multi-Agent LLM Communities Driven by Value Diversity
- 2025Can Lessons From Human Teams Be Applied to Multi-Agent Systems? The Role of Structure, Diversity, and Interaction Dynamics
- 2026Towards a Science of Collective AI: LLM-based Multi-Agent Systems Need a Transition from Blind Trial-and-Error to Rigorous Science
- 2025Creativity in LLM-based Multi-Agent Systems: A Survey
- 2026Understanding Agent Scaling in LLM-Based Multi-Agent Systems via Diversity
- 2026Do Agent Societies Develop Intellectual Elites? The Hidden Power Laws of Collective Cognition in LLM Multi-Agent Systems
- 2026The Interaction Tax: When Communication Erases Diversity in Multi-Agent Teams