When Order Matters: First-Speaker Bias and Mitigation through Personality in Sequential Multi-Agent Debate
On the map: LLM reasoning → Reasoning benchmarks and evaluation also fits: Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Multi-agent debate (MAD) is often used to improve large language model (LLM) reasoning, but sequential debate is rarely a neutral aggregator of agents' opinions. We show that sequential MAD suffers from a pronounced first-speaker bias: agents disproportionately shape the final answer when they speak first. As a result, placing a stronger model after weaker ones can substantially offset its reasoning advantage. We then focus on the disadvantaged strong-agent-last setting and ask whether personality prompting can mitigate this imbalance. Drawing on the Big Five model, we study agreeableness and extraversion as behavioral interventions applied to either the strong or weak side. We find that their effects are trait-specific. Influence consistently shifts in the direction of lower agreeableness, and assigning low agreeableness to the stronger agent helps restore its lost influence and improves final accuracy. Extraversion, by contrast, produces less systematic changes in influence and accuracy, with its clearest effect appearing in agents' verbosity. These findings show that effective MAD design depends not only on model capability, but also on how speaking order and induced interaction behavior shape the debate process.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 29 of its 42 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
29 of 42 references.
Closest ancestors · 1
Same direction, newest first
Other references · 28
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
- 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 598
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 290
- 2024Debating with More Persuasive LLMs Leads to More Truthful Answerscited by 266
- 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 234
- 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 222
16 more
- 2023Personality Traits in Large Language Modelscited by 169
- 2022Evaluating and Inducing Personality in Pre-trained Language Modelscited by 123
- 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMscited by 114
- 2024Cognitive Bias in Decision-Making with LLMscited by 106
- 2024Systematic Biases in LLM Simulations of Debatescited by 99
- 2025Voting or Consensus? Decision-Making in Multi-Agent Debatecited by 59
- 2025Do as We Do, Not as You Think: the Conformity of Large Language Modelscited by 53
- 2024Conformity in Large Language Modelscited by 34
- 2024LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Modelscited by 33
- 2024Debate on Graph: a Flexible and Reliable Reasoning Framework for Large Language Modelscited by 19
- 2025Enhancing Multi-Agent Debate System Performance via Confidence Expressioncited by 19
- 2024Counterfactual Debating with Preset Stances for Hallucination Elimination of LLMscited by 17
- 2025Herd Behavior: Investigating Peer Influence in LLM-based Multi-Agent Systemscited by 15
- 2024How Personality Traits Influence Negotiation Outcomes? A Simulation based on Large Language Modelscited by 9
- 2025An Empirical Study of Group Conformity in Multi-Agent Systemscited by 7
- 2025Key Decision-Makers in Multi-Agent Debates: Who Holds the Power?cited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Not All Flips Are Conformity: Decomposing Stance Convergence in Multi-Agent LLM Debate
- 2026Beyond Symmetric Agents: Cognitive Diversity and Multi-Agent Debate in Small Language Models
- 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoning
- 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversity
- 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?
- 2025Revealing Political Bias in LLMs through Structured Multi-Agent Debate
- 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate
- 2025When and Why Does Multi-Agent Debate Fail and Does It Really Underperform?