Towards Mitigating Fabricated Consensus: The Active Provenance Gate for Multi-Agent Debate Synthesis
On the map: LLM agents and tool use → Social simulation and multi-agent debate also fits: Web, search, and research agents
Abstract (arXiv)
Large language model-based multi-agent debate (MAD) systems are being increasingly used as complex decision pipelines in distributed processes. However, their final synthesis phase still remains inadequately controlled. Even with detailed debate logs, summarizing models are prone to fabricating smoothly written debate consensus that is not grounded in the debate's history. To address this safety gap, this paper presents empirical research and studies if the introduction of active post-debate verification can mitigate the production of such factually unsupported summaries, while still providing valuable information. Furthermore, it is examined whether explicitly signalling divergence is preferable in the absence of a reliable compromise. The Active Provenance Gate (APG) is introduced as a post-debate verification layer that treats the source as a hard constraint, analysing the debate logs, auditing each claim, and applying self-correction. In crisis simulations, the self-healing mechanism more than doubles the average data Provenance Fidelity in difficult condition scenarios, before the strict gate blocks unsupported claims and generates divergence reports. In the human study, a vast majority of the users (over 75%) preferred a report explicitly stating failure in critical scenarios, despite most of them perceiving fabricated consensus from the baseline system as more fluent. Our main contribution is the transition of data origin tracing from passive logging to active conditional blocking before publication.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 17 of its 21 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
17 of 21 references.
Closest ancestors · 3
Same direction, newest first
- 2026Decoupling Thought from Speech: Knowledge-Grounded Counterfactual Reasoning for Resilient Multi-Agent Argumentation9 Jun
- 2025Games Agents Play: Towards Transactional Analysis in LLM-based Multi-Agent Systems28 Jul
- 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMs29 Nov
Other references · 14
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 724
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 251
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 221
- 2024Factuality of Large Language Models: A Surveycited by 64
- 2025PROV-AGENT: Unified Provenance for Tracking AI Agent Interactions in Agentic Workflowscited by 29
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversity
- 2025Debating Truth: Debate-driven Claim Verification with Multiple Large Language Model Agents
- 2026The Cost of Consensus: Isolated Self-Correction Prevails Over Unguided Homogeneous Multi-Agent Debate
- 2026Tool-MAD: A Multi-Agent Debate Framework for Fact Verification with Diverse Tool Augmentation and Adaptive Retrieval
- 2026Courtroom-Style Multi-Agent Debate with Progressive RAG and Role-Switching for Controversial Claim Verification
- 2025Free-MAD: Consensus-Free Multi-Agent Debate
- 2026Sequential Consensus for Multi-Agent LLM Debates: A Wald-SPRT compute governor with calibration-based failure detection
- 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?