mlsanityData to 14 Oct 2026

Creative Generation via Multi-Agent Debate: Does Debate Suppress Diversity?

arXiv 2609.00683 ↗First posted 1 Sep 2026cs.CLcited by 1

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Creative generation tasks, such as narrative writing and scientific ideation, demand both high-quality outputs and distinct responses across independent runs to maximize exploration. Multi-Agent Debate (MAD) has shown strong quality gains on factual and reasoning tasks, making it a natural candidate for creative generation. However, we find its convergence-driven design actively suppresses output diversity across independent runs, creating an inherent trade-off with creative tasks. We theoretically show that preserving diversity among agents within each debate session is a necessary condition for achieving diverse outputs across independent runs. Building on this finding, we propose Creative-MAD, which introduces two synergistic interventions to sustain agent divergence. Specifically, Cognitive Lens Assignment counters identity drift by anchoring each agent to a distinct and persistent cognitive mode, while Embedding-based Peer Selection counters majority pull by limiting each agent's context to its most semantically distant peers. Experiments across four creative benchmarks demonstrate that Creative-MAD significantly enhances both lexical and semantic diversity while maintaining MAD's output quality.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 21 of its 31 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

21 of 31 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025MALLM: Multi-Agent Large Language Models Framework15 Sep
  2. 2024Debate-to-Write: A Persona-Driven Multi-Agent Framework for Diverse Argument Generation28 Jun
  3. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May

Other references · 18

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  2. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  3. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  4. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  5. 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 500
  6. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
  7. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 311
  8. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
  9. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 251
  10. 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 141
  11. 2025EmbeddingGemma: Powerful and Lightweight Text Representationscited by 139
  12. 2024Improving Multi-Agent Debate with Sparse Communication Topologycited by 107
6 more
  1. 2025NoveltyBench: Evaluating Language Models for Humanlike Diversitycited by 66
  2. 2025Evaluating the Diversity and Quality of LLM Generated Contentcited by 51
  3. 2025Modifying Large Language Model Post-Training for Diverse Creative Writingcited by 40
  4. 2024Evaluating LLMs' Divergent Thinking Capabilities for Scientific Idea Generation with Minimal Contextcited by 28
  5. 2025Creative Preference Optimizationcited by 25
  6. 2025G2: Guided Generation for Enhanced Output Diversity in LLMscited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Symmetric Agents: Cognitive Diversity and Multi-Agent Debate in Small Language Models
  2. 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversity
  3. 2025Revisiting Multi-Agent Debate as Test-Time Scaling: A Systematic Study of Conditional Effectiveness
  4. 2026Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generation
  5. 2024Diversity of Thought Elicits Stronger Reasoning Capabilities in Multi-Agent Debate Frameworks
  6. 2025When and Why Does Multi-Agent Debate Fail and Does It Really Underperform?
  7. 2026Multi-Agent Debate Strategies: Survey, Taxonomy, and Challenges
  8. 2026Mixture of Debaters: Learn to Debate at Architectural Level in Multi-Agent Reasoning