mlsanityData to 14 Oct 2026

Meta-Moderator: Empowering Multi-Agent Debate with Meta-Cognition

arXiv 2608.23029 ↗First posted 24 Aug 2026cs.CLcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Multi-agent debate can improve large language model reasoning by eliciting diverse hypotheses and critiques, yet its performance is often constrained by weak moderation. Common pipelines rely on fixed budgets, agreement-based stopping, or untrained judges, leading to redundant deliberation and unreliable evidence aggregation. We cast moderation as a meta-cognitive process, monitoring debate utility, controlling deliberation, and adjudicating a final answer, and introduce Meta-Moderator, a learnable framework that dynamically regulates debate and decides when to finalize an answer. Meta-Moderator is trained independently of the debaters via outcome-driven policy optimization, making debate regulation an explicit capability rather than an incidental effect of prompting. Across five benchmarks, Meta-Moderator outperforms widely used decision layers and transfers across tasks and system configurations. Further analyses show that it allocates debate more selectively and reduces mis-aggregation after informative hypotheses appear.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 23 of its 37 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

23 of 37 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Multi-Agent Debate for LLM Judges with Adaptive Stability Detection14 Oct
  2. 2025Multi-Agent Collaborative Intelligence: Dual-Dial Control for Reliable LLM Reasoning6 Oct
  3. 2025Free-MAD: Consensus-Free Multi-Agent Debate14 Sep
  4. 2024Meta-Reasoning Improves Tool Use in Large Language Models7 Nov
  5. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May

Other references · 18

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  6. 2023Qwen Technical Reportcited by 3,344
  7. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  8. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  9. 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 743
  10. 2025ToolRL: Reward is All Tool Learning Needscited by 362
  11. 2023Metacognitive Prompting Improves Understanding in Large Language Modelscited by 58
  12. 2025Language Models Are Capable of Metacognitive Monitoring and Control of Their Internal Activationscited by 41
6 more
  1. 2025Adaptive Tool Use in Large Language Models with Meta-Cognition Triggercited by 30
  2. 2025Removal of Hallucination on Hallucination: Debate-Augmented RAGcited by 29
  3. 2024Multi-Agent Large Language Models for Conversational Task-Solvingcited by 24
  4. 2024A Picture Is Worth a Graph: A Blueprint Debate Paradigm for Multimodal Reasoningcited by 11
  5. 2025SyncLoop: A Multimodal Dual-Loop Framework for Self-Improving Mathematical Reasoningcited by 8
  6. 2025QualBench: Benchmarking Chinese LLMs with Localized Professional Qualifications for Vertical Domain Evaluationcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Mixture of Debaters: Learn to Debate at Architectural Level in Multi-Agent Reasoning
  2. 2026Efficient Multi-Agent Reasoning via Confidence-Guided Adaptive Debate
  3. 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversity
  4. 2026When Debate Helps: Proposal Supply and Verification-Aware Readout in Multi-Agent Reasoning
  5. 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoning
  6. 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?
  7. 2026Remember and Reweight: Enhancing Multi-Agent Debate with Experience Memory and Confidence Estimation
  8. 2026Latent Agents: A Post-Training Procedure for Internalized Multi-Agent Debate