Creative Generation via Multi-Agent Debate: Does Debate Suppress Diversity?
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Creative generation tasks, such as narrative writing and scientific ideation, demand both high-quality outputs and distinct responses across independent runs to maximize exploration. Multi-Agent Debate (MAD) has shown strong quality gains on factual and reasoning tasks, making it a natural candidate for creative generation. However, we find its convergence-driven design actively suppresses output diversity across independent runs, creating an inherent trade-off with creative tasks. We theoretically show that preserving diversity among agents within each debate session is a necessary condition for achieving diverse outputs across independent runs. Building on this finding, we propose Creative-MAD, which introduces two synergistic interventions to sustain agent divergence. Specifically, Cognitive Lens Assignment counters identity drift by anchoring each agent to a distinct and persistent cognitive mode, while Embedding-based Peer Selection counters majority pull by limiting each agent's context to its most semantically distant peers. Experiments across four creative benchmarks demonstrate that Creative-MAD significantly enhances both lexical and semantic diversity while maintaining MAD's output quality.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 21 of its 31 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
21 of 31 references.
Closest ancestors · 3
Same direction, newest first
- 2025MALLM: Multi-Agent Large Language Models Framework15 Sep
- 2024Debate-to-Write: A Persona-Driven Multi-Agent Framework for Diverse Argument Generation28 Jun
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May
Other references · 18
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 500
- 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 311
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 251
- 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 141
- 2025EmbeddingGemma: Powerful and Lightweight Text Representationscited by 139
- 2024Improving Multi-Agent Debate with Sparse Communication Topologycited by 107
6 more
- 2025NoveltyBench: Evaluating Language Models for Humanlike Diversitycited by 66
- 2025Evaluating the Diversity and Quality of LLM Generated Contentcited by 51
- 2025Modifying Large Language Model Post-Training for Diverse Creative Writingcited by 40
- 2024Evaluating LLMs' Divergent Thinking Capabilities for Scientific Idea Generation with Minimal Contextcited by 28
- 2025Creative Preference Optimizationcited by 25
- 2025G2: Guided Generation for Enhanced Output Diversity in LLMscited by 14
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Symmetric Agents: Cognitive Diversity and Multi-Agent Debate in Small Language Models
- 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversity
- 2025Revisiting Multi-Agent Debate as Test-Time Scaling: A Systematic Study of Conditional Effectiveness
- 2026Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generation
- 2024Diversity of Thought Elicits Stronger Reasoning Capabilities in Multi-Agent Debate Frameworks
- 2025When and Why Does Multi-Agent Debate Fail and Does It Really Underperform?
- 2026Multi-Agent Debate Strategies: Survey, Taxonomy, and Challenges
- 2026Mixture of Debaters: Learn to Debate at Architectural Level in Multi-Agent Reasoning