When Debate Helps: Proposal Supply and Verification-Aware Readout in Multi-Agent Reasoning
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Multi-agent debate can improve reasoning, yet often fails to beat simple majority voting. We argue that successful debate requires two distinct mechanisms: proposal supply must surface a correct answer, and readout must identify that answer when voting misses it. We formalize the first requirement through recoverable headroom, which measures cases where a correct proposal is available but the majority answer is wrong. For the second, we develop Latent Verification Debate (LVD), an accounting model in which candidate proposals receive answer-specific verification evidence before final generation. Controlled fixed-proposal interventions estimate this latent effect in equivalent peer-support units and show that correct evidence changes answer probabilities and generated decisions while proposal supply remains fixed. To improve proposal supply, we construct societies from neural-thicket agents using labeled and label-free coverage objectives. Across two backbones and matched-budget reasoning benchmarks, coverage-selected societies increase complementary proposal supply and improve aggregate accuracy in repeated stochastic evaluations. Round-level controls further show that interaction provides gains beyond applying the same finalizer directly to the initial proposals. These results identify proposal coverage and truth-sensitive evidence use as complementary conditions for debate to outperform voting. Code is available at https://github.com/Wang-ML-Lab/when-debate-helps.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 23 of its 33 references that are in the map. First posted on arXiv 3 Oct 2026.
Builds on
23 of 33 references.
Closest ancestors · 4
Same direction, newest first
- 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?24 Aug
- 2025Voting or Consensus? Decision-Making in Multi-Agent Debate26 Feb
- 2025Stop Overvaluing Multi-Agent Debate -- We Must Rethink Evaluation and Embrace Model Heterogeneity12 Feb
- 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMs29 Nov
Other references · 19
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
- 2024JudgeBench: A Benchmark for Evaluating LLM-based Judgescited by 318
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 233
- 2024Are We Done with MMLU?cited by 194
7 more
- 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?cited by 159
- 2023Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debatecited by 97
- 2016Towards Bayesian Deep Learning: A Framework and Some Existing Methodscited by 58
- 2016Natural-Parameter Networks: A Class of Probabilistic Neural Networkscited by 34
- 2026Neural Thickets: Diverse Task Experts Are Dense Around Pretrained Weightscited by 28
- 2023Domain-Indexing Variational Bayes: Interpretable Domain Index for Domain Adaptationcited by 20
- 2024Training-Free Bayesianization for Low-Rank Adapters of Large Language Modelscited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoning
- 2026The Confident Liar: Diagnosing Multi-Agent Debate with Log-Probabilities and LLM-as-Judge
- 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversity
- 2026Efficient Multi-Agent Reasoning via Confidence-Guided Adaptive Debate
- 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate
- 2026Meta-Moderator: Empowering Multi-Agent Debate with Meta-Cognition
- 2026The Cost of Consensus: Isolated Self-Correction Prevails Over Unguided Homogeneous Multi-Agent Debate
- 2026Hear Both Sides: Efficient Multi-Agent Debate via Diversity-Aware Message Retention