mlsanityData to 14 Oct 2026

Minority Sentinel: When to Overturn Majority Voting in Multi-Agent LLM Debates

arXiv 2606.29270 ↗First posted 28 Jun 2026cs.MAcited by 5

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Multi-Agent Debate (MAD) with Majority Voting is a dominant paradigm for improving LLM reasoning, yet its effectiveness rests on the Condorcet Jury Theorem's assumption of independent errors. Because contemporary LLMs share similar pretraining corpora, their errors are strongly correlated, causing the majority to systematically suppress correct minority opinions, a phenomenon we term Minority Truth. Through debates among three heterogeneous LLM agents on six benchmarks, we find that roughly one in four divergent cases has the minority holding the correct answer, yielding a 10-percentage-point theoretical recovery margin. We propose Minority Sentinel, a lightweight meta-classifier that extracts a multi-dimensional debate fingerprint from debate logs and trains a LightGBM model to decide when to overturn majority voting. Minority Sentinel achieves a stable Flip Precision of 81.2% with positive Net Gain across all six datasets and all 20 random seed trials, demonstrating that debate logs contain sufficient behavioral signals for a non-LLM classifier to reliably recover suppressed minorities without degrading system accuracy. The LLM-as-Judge baseline yields negative Net Gain despite higher recall, confirming that flip safety, not recovery volume, determines intervention value.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 8 of its 23 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

8 of 23 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoning11 Nov
  2. 2025Beyond Majority Voting: LLM Aggregation by Leveraging Higher-Order Information1 Oct
  3. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May

Other references · 5

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  4. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  5. 2024MAIN-RAG: Multi-Agent Filtering Retrieval-Augmented Generationcited by 44

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversity
  2. 2025Multi-Agent Debate for LLM Judges with Adaptive Stability Detection
  3. 2026Hear Both Sides: Efficient Multi-Agent Debate via Diversity-Aware Message Retention
  4. 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?
  5. 2025iMAD: Intelligent Multi-Agent Debate for Efficient and Accurate LLM Inference
  6. 2026Statistical Scouting Finds Debate-Safe but Not Debate-Useful Cases: A Matched-Ceiling Study of Open-Weight LLM Reasoning Protocols
  7. 2025Self-Improvement of Language Models by Post-Training on Multi-Agent Debate
  8. 2026Measuring Collapse and Correction in Homogeneous-Panel LLM Debate