Breaking the Martingale Curse: Multi-Agent Debate via Asymmetric Cognitive Potential Energy
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Multi-Agent Debate (MAD) has emerged as a promising paradigm for enhancing large language model reasoning. However, recent work reveals a limitation:standard MAD cannot improve belief correctness beyond majority voting; we refer to this as the Martingale Curse. This curse arises because correlated errors cause agents to converge toward erroneous consensus, where debate merely reinforces collective mistakes rather than filtering noise. We propose AceMAD, a framework that breaks the Martingale Curse by harnessing asymmetric cognitive potential energy to transform MAD from a random walk into a directed convergence process with positive drift. Through a peer-prediction mechanism, agents predict their peers' belief distributions, revealing asymmetric cognitive potential: truth-holders not only know the correct answer but also anticipate the crowd's misconceptions, while the hallucinating majority remains blind to their collective error. This asymmetry creates a potential energy gap that we quantify via strictly proper scoring rules. We prove this cognitive potential manifests as information-theoretic superiority and, under nonlinear aggregation, converts into submartingale drift toward truth, directly breaking the Martingale Curse. Experiments on challenging subsets across six benchmarks show AceMAD recovers sparse truth signals even when initial majorities are incorrect, substantially outperforming baseline methods.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 34 of its 48 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
34 of 48 references.
Closest ancestors · 7
Same direction, newest first
- 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?24 Aug
- 2024Thinking Before Running! Efficient Code Generation with Thorough Exploration and Optimal Refinement30 Dec
- 2024Improving Multi-Agent Debate with Sparse Communication Topology17 Jun
- 2024CoMM: Collaborative Multi-Agent, Multi-Reasoning-Path Prompting for Complex Problem Solving26 Apr
- 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?28 Feb
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMs22 Sep
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May
Other references · 27
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 724
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
15 more
- 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 246
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systemscited by 129
- 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMscited by 103
- 2023Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debatecited by 94
- 2025Beyond Self-Talk: A Communication-Centric Survey of LLM-Based Multi-Agent Systemscited by 58
- 2025Voting or Consensus? Decision-Making in Multi-Agent Debatecited by 55
- 2024From Skepticism to Acceptance: Simulating the Attitude Dynamics Toward Fake Newscited by 51
- 2024MACM: Utilizing a Multi-Agent System for Condition Mining in Solving Complex Mathematical Problemscited by 41
- 2025The Truth Becomes Clearer Through Debate! Multi-Agent Systems with Large Language Models Unmask Fake Newscited by 29
- 2024The Stepwise Deception: Simulating the Evolution from True News to Fake News with LLM Agentscited by 24
- 2026Forest Before Trees: Latent Superposition for Efficient Visual Reasoningcited by 16
- 2024Exploring and Controlling Diversity in LLM-Agent Conversationcited by 12
- 2025Weaving Context Across Images: Improving Vision-Language Models through Focus-Centric Visual Chainscited by 11
- 2025ViPER: Empowering the Self-Evolution of Visual Perception Abilities in Vision-Language Modelcited by 11
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026The Cost of Consensus: Isolated Self-Correction Prevails Over Unguided Homogeneous Multi-Agent Debate
- 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversity
- 2026Remember and Reweight: Enhancing Multi-Agent Debate with Experience Memory and Confidence Estimation
- 2025When and Why Does Multi-Agent Debate Fail and Does It Really Underperform?
- 2025From Belief Entrenchment to Robust Reasoning in LLM Agents
- 2026Beyond Symmetric Agents: Cognitive Diversity and Multi-Agent Debate in Small Language Models
- 2025S2-MAD: Breaking the Token Barrier to Enhance Multi-Agent Debate Efficiency
- 2026SVR-MAD: A Bayesian-Inspired Framework for Posterior-Guided Multi-Agent Debate