mlsanityData to 7 Oct 2026

Not All Flips Are Conformity: Decomposing Stance Convergence in Multi-Agent LLM Debate

arXiv 2606.00820 ↗First posted 30 May 2026cs.CLcited by 6

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Multi-agent debate (MAD) is a promising strategy for improving LLM reasoning, but when agents converge on a shared answer, it is unclear whether that convergence reflects genuine deliberation or social compliance. We show that the conventional answer flip rate conflates three distinct mechanisms: spontaneous instability, stance-induced conformity, and reasoning-induced persuasion. Our three-source decomposition framework isolates each through controlled counterfactual conditions. In the primary MMLU-Pro setting, 37% of agent-question observations change under self-reflection alone, while robustness tests show substantial model-dependent instability across GPQA-Diamond and three model families; strict conformity is 29% in the primary setting and remains predominantly harmful across model replications (57-77% correct-to-wrong). A controlled information-gradient experiment reveals that even vacuous reasoning is associated with 20-39% error adoption among resistant agents, with reasoning-like presentation carrying substantial persuasive weight. Harmful conformity can be predicted from Round 0 features (AUC = 0.79), and risk-targeted intervention reduces it by 13.6 percentage points (p < 0.001). However, without correctness labels or self-reflection controls, reducing peer adoption does not improve accuracy, because harmful and beneficial influence cannot be distinguished.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 25 of its 35 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

25 of 35 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025When Identity Skews Debate: Anonymization for Bias-Reduced Multi-Agent Reasoning8 Oct
  2. 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate5 Sep
  3. 2025Revisiting Multi-Agent Debate as Test-Time Scaling: A Systematic Study of Conditional Effectiveness29 May
  4. 2025Stop Overvaluing Multi-Agent Debate -- We Must Rethink Evaluation and Embrace Model Heterogeneity12 Feb
  5. 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?28 Feb
  6. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMs22 Sep
  7. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May

Other references · 18

  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  2. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  3. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  4. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  5. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  6. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  7. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  8. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 724
  9. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 701
  10. 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 221
  11. 2025BIG-Bench Extra Hardcited by 123
  12. 2023GeomVerse: A Systematic Evaluation of Large Models for Geometric Reasoningcited by 107
6 more
  1. 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMscited by 103
  2. 2022Do Androids Laugh at Electric Sheep? Humor "Understanding" Benchmarks from The New Yorker Caption Contestcited by 98
  3. 2025Peacemaker or Troublemaker: How Sycophancy Shapes Multi-Agent Debatecited by 29
  4. 2025Herd Behavior: Investigating Peer Influence in LLM-based Multi-Agent Systemscited by 15
  5. 2025Human-like Social Compliance in Large Language Models: Unifying Sycophancy and Conformity through Signal Competition Dynamicscited by 4
  6. 2025Towards Simulating Social Influence Dynamics with LLM-based Multi-agentscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoning
  2. 2026From Debate to Decision: Conformal Social Choice for Safe Multi-Agent Deliberation
  3. 2025When Persuasion Overrides Truth in Multi-Agent LLM Debates: Introducing a Confidence-Weighted Persuasion Override Rate (CW-POR)
  4. 2026Group Perspective Matters: Regulating Debate Relationships Can Mitigate Blind Conformity in Multi-Agent Debate
  5. 2025An Empirical Study of Group Conformity in Multi-Agent Systems
  6. 2026When Order Matters: First-Speaker Bias and Mitigation through Personality in Sequential Multi-Agent Debate
  7. 2026The Confident Liar: Diagnosing Multi-Agent Debate with Log-Probabilities and LLM-as-Judge
  8. 2026LLMs Trust Their Own: Identity-Dependent Conformity in Multi-Agent Systems