mlsanityData to 7 Oct 2026

Multi-agent discussion gains less when dissent is withheld

arXiv 2609.38324 ↗First posted 29 Sep 2026physics.soc-ph cs.CL cs.MAcited by 0

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Multi-agent systems of LLMs add discussion to majority voting and are therefore expected to be more capable. However, empirical reports conflict on whether discussion improves accuracy or leads to an incorrect consensus. Here, we introduce a parsimonious model that explains when discussion improves accuracy and when it ends in an incorrect consensus, built from four behaviors repeatedly observed in LLM agents: (1) withholding dissent, (2) internalizing a stated answer, (3) reconsidering after seeing dissent, and (4) correcting toward the correct answer. The model shows that discussion can overturn an incorrect initial majority only when the withholding rate c is below a critical rate c^* = γ/(γ + a), set by the net correction rate γ and the internalization rate a. We estimate these rates from conversation logs with a Bayesian method and place LLM teams relative to c^*. As the model predicts, the gain from discussion shrinks as withholding rises, across LLMs and on a hidden profile benchmark, HiddenBench, and MedEInst. Instructing agents not to withhold dissent increases this gain. Turning reasoning off also increases the gain, because reasoning raises the internalization rate a and keeps agents from reconsidering a minority answer. These findings reconcile the conflicting reports and identify when discussion outperforms majority voting.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 42 of its 76 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

42 of 76 references.

Closest ancestors · 15

Same direction, newest first

  1. 2026Emergence of Biased Consensus in Multi-Agent LLM Debates3 Aug
  2. 2026Everyone Conforms, No One Believes: Pluralistic Ignorance in LLM Agent Populations3 Aug
  3. 2026What LLM Agents Say When No One Is Watching: Social Structure and Latent Objective Emergence in Multi-Agent Debates2 Jul
  4. 2026Not All Flips Are Conformity: Decomposing Stance Convergence in Multi-Agent LLM Debate30 May
  5. 2026Conformity Generates Collective Misalignment in AI Agents Societies11 May
  6. 2026Collective Alignment in LLM Multi-Agent Systems: Disentangling Bias from Cooperation via Statistical Physics11 May
  7. 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoning11 Nov
  8. 2025When Your AI Agent Succumbs to Peer-Pressure: Studying Opinion-Change Dynamics of LLMs21 Oct
  9. 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?24 Aug
  10. 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systems5 Mar
  11. 2025Voting or Consensus? Decision-Making in Multi-Agent Debate26 Feb
  12. 2025Stop Overvaluing Multi-Agent Debate -- We Must Rethink Evaluation and Embrace Model Heterogeneity12 Feb
3 more
  1. 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMs29 Nov
  2. 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View3 Oct
  3. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May

Other references · 27

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  2. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  3. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  4. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  5. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
  6. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
  7. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  8. 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 386
  9. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 297
  10. 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
  11. 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?cited by 153
  12. 2024On the Self-Verification Limitations of Large Language Models on Reasoning and Planning Taskscited by 137
15 more
  1. 2024Emergent social conventions and collective bias in LLM populationscited by 115
  2. 2025Do as We Do, Not as You Think: the Conformity of Large Language Modelscited by 48
  3. 2024Reasoning in Token Economies: Budget-Aware Evaluation of LLM Reasoning Strategiescited by 44
  4. 2024Conformity in Large Language Modelscited by 30
  5. 2025Language Models Fail to Introspect About Their Knowledge of Languagecited by 28
  6. 2024SELF-[IN]CORRECT: LLMs Struggle with Discriminating Self-Generated Responsescited by 24
  7. 2026Silo-Bench: A Scalable Environment for Evaluating Distributed Coordination in Multi-Agent LLM Systemscited by 16
  8. 2025Systematic Failures in Collective Reasoning under Distributed Information in Multi-Agent LLMscited by 15
  9. 2025Prompt Perturbations Reveal Human-Like Biases in Large Language Model Survey Responsescited by 13
  10. 2026More Capable, Less Cooperative? When LLMs Fail At Zero-Cost Collaborationcited by 7
  11. 2026LLMs Know They're Wrong and Agree Anyway: The Shared Sycophancy-Lying Circuitcited by 7
  12. 2025When Do LLMs Admit Their Mistakes? Understanding The Role Of Model Belief In Retractioncited by 6
  13. 2026MedEinst: Benchmarking the Einstellung Effect in Medical LLMs through Counterfactual Differential Diagnosiscited by 4
  14. 2026Flag Game: A Toy Model for Mechanistic Swarm Interpretabilitycited by 2
  15. 2026Message capacity and claim wording set the transition points of collective truth-finding in language-model networkscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Cost of Consensus: Isolated Self-Correction Prevails Over Unguided Homogeneous Multi-Agent Debate
  2. 2026What Does Multi-Agent LLM Debate Actually Change? A Layered Analysis of Disagreement and Answer Quality
  3. 2026The Deliberative Illusion: Diagnosing Factual Attrition and Stance Homogenization in Multi-Agent LLM Deliberation
  4. 2026Hidden Anchors in Multi-Agent LLM Deliberation
  5. 2025Peacemaker or Troublemaker: How Sycophancy Shapes Multi-Agent Debate
  6. 2026Easier to Mislead Than to Correct: Harmful and Beneficial Revision in LLM Conformity
  7. 2026Too Polite to Disagree: Understanding Sycophancy Propagation in Multi-Agent Systems
  8. 2026Collective Opinion Dynamics in Structured LLM Populations