mlsanityData to 7 Oct 2026

Multi-Agent Debate Strategies: Survey, Taxonomy, and Challenges

arXiv 2607.26212 ↗First posted 28 Jul 2026cs.SE cs.AIcited by 3

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Multi-Agent Debate (MAD) is a promising paradigm for improving the accuracy and robustness of Large Language Model (LLM)-based agentic systems. It enables multiple agents to exchange arguments, critique each other's outputs, and iteratively converge towards a solution. However, research remains fragmented, with inconsistent terminology and no rigorous synthesis of MAD design dimensions. We present a systematic literature review characterizing 141 primary studies on MAD. We derive a three-dimensional taxonomy covering debate participants, the interaction mechanisms structuring the exchange, and the agreement protocols governing debate resolution, supported by formal notations to render MAD configurations. Our analysis reveals that the field has implicitly converged on a narrow design pattern - static, fully connected topologies, verbatim exchange, short-term memory and voting resolution strategies - adopted by convention rather than systematic comparison, while promising alternatives remain marginal. Because any MAD setting reflects roughly a dozen interacting design decisions, cross-study comparison is unreliable when these are left implicit. We position the taxonomy as a descriptive map of the research landscape, a framework for controlled benchmarking, and potentially as a schema for machine-readable MAD specifications. As future work, we propose formalizing it into an executable specification, enabling cost-aware benchmarking and automated tuning of debate configurations.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 90 of its 147 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

90 of 147 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025CortexDebate: Debating Sparsely and Equally for Multi-Agent Debate5 Jul
  2. 2025Debate, Reflect, and Distill: Multi-Agent Feedback with Tree-Structured Preference Optimization for Efficient Language Model Enhancement4 Jun
  3. 2025Mitigating Manipulation and Enhancing Persuasion: A Reflective Multi-Agent Approach for Legal Argument Generation3 Jun
  4. 2025Multiple LLM Agents Debate for Equitable Cultural Alignment30 May
  5. 2025Efficient Leave-one-out Approximation in LLM Multi-agent Debate Based on Introspection28 May
  6. 2025Enhancing LLM Performance Through Debate: An Empirical Study on Multi-Agent Debate for Coding Tasks15 Mar
  7. 2025Faithful, Unfaithful or Ambiguous? Multi-Agent Debate with Initial Stance for Summary Evaluation12 Feb
  8. 2025S2-MAD: Breaking the Token Barrier to Enhance Multi-Agent Debate Efficiency7 Feb
  9. 2024Gradual Vigilance and Interval Communication: Enhancing Value Alignment in Multi-Agent Debates18 Dec
  10. 2024GroupDebate: Enhancing the Efficiency of Multi-Agent Debate Using Group Discussion21 Sep
  11. 2024Debate-to-Write: A Persona-Driven Multi-Agent Framework for Diverse Argument Generation28 Jun
  12. 2024Debate as Optimization: Adaptive Conformal Prediction and Diverse Retrieval for Event Extraction18 Jun
5 more
  1. 2024Modelling Political Coalition Negotiations Using LLM-based Agents18 Feb
  2. 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMs29 Nov
  3. 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View3 Oct
  4. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May
  5. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 73

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  5. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  6. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  7. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  8. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  9. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
  10. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  11. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  12. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
38 more
  1. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  2. 2017Crowdsourcing Multiple Choice Science Questionscited by 742
  3. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 451
  4. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
  5. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  6. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 297
  7. 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 281
  8. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 246
  9. 2023Large Language Model Alignment: A Surveycited by 241
  10. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
  11. 2019CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from Textcited by 155
  12. 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?cited by 153
  13. 2023PRD: Peer Rank and Discussion Improve Large Language Model based Evaluationscited by 114
  14. 2024Improving Multi-Agent Debate with Sparse Communication Topologycited by 103
  15. 2023Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debatecited by 94
  16. 2025MAPoRL: Multi-Agent Post-Co-Training for Collaborative Large Language Models with Reinforcement Learningcited by 80
  17. 2023Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communicationcited by 78
  18. 2022Solving Math Word Problems via Cooperative Reasoning induced Language Modelscited by 76
  19. 2023Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaborationcited by 70
  20. 2024LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Playcited by 65
  21. 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 56
  22. 2023Let Models Speak Ciphers: Multiagent Debate through Embeddingscited by 49
  23. 2023Adapting Large Language Models to Domains via Reading Comprehensioncited by 48
  24. 2023Towards Reasoning in Large Language Models via Multi-Agent Peer Review Collaborationcited by 48
  25. 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversationscited by 43
  26. 2024MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Modelscited by 41
  27. 2024Auto-Arena: Automating LLM Evaluations with Agent Peer Battles and Committee Discussionscited by 40
  28. 2024SMoA: Improving Multi-agent Large Language Models with Sparse Mixture-of-Agentscited by 30
  29. 2025Removal of Hallucination on Hallucination: Debate-Augmented RAGcited by 29
  30. 2024Confidence Calibration and Rationalization for LLMs via Multi-Agent Deliberationcited by 26
  31. 2023ChoiceMates: Supporting Unfamiliar Online Decision-Making with Multi-Agent Conversational Interactionscited by 22
  32. 2024Enhancing Diagnostic Accuracy through Multi-Agent Conversations: Using Large Language Models to Mitigate Cognitive Biascited by 20
  33. 2024Towards Detecting LLMs Hallucination via Markov Chain-based Multi-agent Debate Frameworkcited by 19
  34. 2024Evaluating the Performance of Large Language Models via Debatescited by 19
  35. 2024MATEval: A Multi-Agent Discussion Framework for Advancing Open-Ended Text Evaluationcited by 18
  36. 2024Counterfactual Debating with Preset Stances for Hallucination Elimination of LLMscited by 17
  37. 2024Plurals: A System for Guiding LLMs Via Simulated Social Ensemblescited by 17
  38. 2025Leveraging LLMs as Meta-Judges: A Multi-Agent Framework for Evaluating LLM Judgmentscited by 16

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Free-MAD: Consensus-Free Multi-Agent Debate
  2. 2025When and Why Does Multi-Agent Debate Fail and Does It Really Underperform?
  3. 2025Stop Overvaluing Multi-Agent Debate -- We Must Rethink Evaluation and Embrace Model Heterogeneity
  4. 2026M3MAD-Bench: Multi-Dimensional Evaluation of Multi-Agent Debate Across Domains and Modalities
  5. 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversity
  6. 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?
  7. 2025Revisiting Multi-Agent Debate as Test-Time Scaling: A Systematic Study of Conditional Effectiveness
  8. 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoning