Misinformation Propagation in Benign Multi-Agent Systems
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Multi-agent systems (MAS) are credited with solving complex problems, yet their agents routinely act on context that may be false. Prior work shows single LLMs are swayed by false context, and MAS can be compromised by adversarial agents persuading peers. We study the benign case: agents follow one protocol, none intends to deceive, but some read a misleading passage. We study it with MINT, 10,278 LLM-written misinformation passages in eight styles, testing three open-weight models on commonsense reasoning, knowledge QA, and moral judgment. A relevant false passage costs a single agent 0.12-0.43 accuracy; irrelevant or content-free passages typically cost at most 0.06. Debate looks robust because uninformed agents outnumber misinformed ones. With one of three misinformed, it is no better than choosing the majority over equally exposed independent samples. Interaction helps only with a misinformed majority, recovering up to 0.24 accuracy over voting (0.29 under consensus). A one-sentence unreliability warning recovers up to 0.18 accuracy under voting (0.28 under consensus), at no significant cost under voting when context is true. Robustness should be judged against exposure-matched baselines, with prompt-level skepticism as cheap first defense.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 31 of its 58 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
31 of 58 references.
Closest ancestors · 4
Same direction, newest first
- 2025MALLM: Multi-Agent Large Language Models Framework15 Sep
- 2025Stay Focused: Problem Drift in Multi-Agent Debate26 Feb
- 2025Voting or Consensus? Decision-Making in Multi-Agent Debate26 Feb
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May
Other references · 27
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2020Aligning AI With Shared Human Valuescited by 723
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
- 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
- 2023Think before you speak: Training Language Models With Pause Tokenscited by 264
- 2024Let's Think Dot by Dot: Hidden Computation in Transformer Language Modelscited by 191
- 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?cited by 159
15 more
- 2023On the Risk of Misinformation Pollution with Large Language Modelscited by 128
- 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 109
- 2024Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communitiescited by 86
- 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?cited by 85
- 2023Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communicationcited by 82
- 2024MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debatecited by 56
- 2022Synthetic Disinformation Attacks on Automated Fact Verification Systemscited by 44
- 2024LLM Harmony: Multi-Agent Communication for Problem Solvingcited by 35
- 2024Large Language Models are as persuasive as humans, but how? About the cognitive effort and moral-emotional language of LLM argumentscited by 30
- 2026The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systemscited by 30
- 2025The Truth Becomes Clearer Through Debate! Multi-Agent Systems with Large Language Models Unmask Fake Newscited by 29
- 2024CrAM: Credibility-Aware Attention Modification in LLMs for Combating Misinformation in RAGcited by 22
- 2024Teaching Models to Balance Resisting and Accepting Persuasioncited by 19
- 2024CiteAssist: A System for Automated Preprint Citation and BibTeX Generationcited by 11
- 2025Beyond Ethical Alignment: Evaluating LLMs as Artificial Moral Assistantscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate
- 2026When Truth Is Distributed: Misinformation Derails Collective Fact Recovery in LLM-Based Multi-Agent Systems
- 2025Goal-Aware Identification and Rectification of Misinformation in Multi-Agent Systems
- 2026The Deliberative Illusion: Diagnosing Factual Attrition and Stance Homogenization in Multi-Agent LLM Deliberation
- 2025Multi-agent Systems for Misinformation Lifecycle : Detection, Correction And Source Identification
- 2026The Confident Liar: Diagnosing Multi-Agent Debate with Log-Probabilities and LLM-as-Judge
- 2025When and Why Does Multi-Agent Debate Fail and Does It Really Underperform?
- 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoning