Minority Sentinel: When to Overturn Majority Voting in Multi-Agent LLM Debates
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Multi-Agent Debate (MAD) with Majority Voting is a dominant paradigm for improving LLM reasoning, yet its effectiveness rests on the Condorcet Jury Theorem's assumption of independent errors. Because contemporary LLMs share similar pretraining corpora, their errors are strongly correlated, causing the majority to systematically suppress correct minority opinions, a phenomenon we term Minority Truth. Through debates among three heterogeneous LLM agents on six benchmarks, we find that roughly one in four divergent cases has the minority holding the correct answer, yielding a 10-percentage-point theoretical recovery margin. We propose Minority Sentinel, a lightweight meta-classifier that extracts a multi-dimensional debate fingerprint from debate logs and trains a LightGBM model to decide when to overturn majority voting. Minority Sentinel achieves a stable Flip Precision of 81.2% with positive Net Gain across all six datasets and all 20 random seed trials, demonstrating that debate logs contain sufficient behavioral signals for a non-LLM classifier to reliably recover suppressed minorities without degrading system accuracy. The LLM-as-Judge baseline yields negative Net Gain despite higher recall, confirming that flip safety, not recovery volume, determines intervention value.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 8 of its 23 references that are in the map. First posted on arXiv 28 Jun 2026.
Builds on
8 of 23 references.
Closest ancestors · 3
Same direction, newest first
- 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoning11 Nov
- 2025Beyond Majority Voting: LLM Aggregation by Leveraging Higher-Order Information1 Oct
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May
Other references · 5
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2024MAIN-RAG: Multi-Agent Filtering Retrieval-Augmented Generationcited by 44
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Candidate supply and answer selection shape the value of LLM judging in multi-agent systemscited by 1
- 2026Self-Cleaning and Captured Anyway: One Measured Primitive for Error in a Store an Agent Writes to Itself, and What a Falling Score Actually Measurescited by 0
- 2026Unanimity Without Persuasion: A Single Round of Debate Erases the Disagreement That Verification Needscited by 0
- 2026Social Circuits behind Multi-agent Echo Chamberscited by 0
- 2026Beyond Final Accuracy: Auditing Communication in LLM Multi-Agent Systemscited by 0
- 2026Beyond Final Accuracy: Auditing Communication in LLM Multi-Agent Systems1 Oct 2026
- 2026Social Circuits behind Multi-agent Echo Chambers28 Sep 2026
- 2026Self-Cleaning and Captured Anyway: One Measured Primitive for Error in a Store an Agent Writes to Itself, and What a Falling Score Actually Measures6 Sep 2026
- 2026Candidate supply and answer selection shape the value of LLM judging in multi-agent systems26 Aug 2026
- 2026Unanimity Without Persuasion: A Single Round of Debate Erases the Disagreement That Verification Needs10 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversity
- 2025Multi-Agent Debate for LLM Judges with Adaptive Stability Detection
- 2026Hear Both Sides: Efficient Multi-Agent Debate via Diversity-Aware Message Retention
- 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?
- 2025iMAD: Intelligent Multi-Agent Debate for Efficient and Accurate LLM Inference
- 2026Statistical Scouting Finds Debate-Safe but Not Debate-Useful Cases: A Matched-Ceiling Study of Open-Weight LLM Reasoning Protocols
- 2025Self-Improvement of Language Models by Post-Training on Multi-Agent Debate
- 2026Measuring Collapse and Correction in Homogeneous-Panel LLM Debate