mlsanityData to 7 Oct 2026

The Trust Paradox in LLM-Based Multi-Agent Systems: When Collaboration Becomes a Security Vulnerability

arXiv 2510.18563 ↗First posted 21 Oct 2025cs.CRcited by 11

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Multi-agent systems powered by large language models are advancing rapidly, yet the tension between mutual trust and security remains underexplored. We introduce and empirically validate the Trust-Vulnerability Paradox (TVP): increasing inter-agent trust to enhance coordination simultaneously expands risks of over-exposure and over-authorization. To investigate this paradox, we construct a scenario-game dataset spanning 3 macro scenes and 19 sub-scenes, and run extensive closed-loop interactions with trust explicitly parameterized. Using Minimum Necessary Information (MNI) as the safety baseline, we propose two unified metrics: Over-Exposure Rate (OER) to detect boundary violations, and Authorization Drift (AD) to capture sensitivity to trust levels. Results across multiple model backends and orchestration frameworks reveal consistent trends: higher trust improves task success but also heightens exposure risks, with heterogeneous trust-to-risk mappings across systems. We further examine defenses such as Sensitive Information Repartitioning and Guardian-Agent enablement, both of which reduce OER and attenuate AD. Overall, this study formalizes TVP, establishes reproducible baselines with unified metrics, and demonstrates that trust must be modeled and scheduled as a first-class security variable in multi-agent system design.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 25 of its 47 references that are in the map. First posted on arXiv 21 Oct 2025.

Builds on

25 of 47 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Towards Transparent and Incentive-Compatible Collaboration in Decentralized LLM Multi-Agent Systems: A Blockchain-Driven Approach20 Sep
  2. 2025Security of Internet of Agents: Attacks and Countermeasures12 May
  3. 2025A Survey on Trustworthy LLM Agents: Threats and Countermeasures12 Mar
  4. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul

Other references · 21

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Qwen Technical Reportcited by 3,273
  3. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  4. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  5. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  6. 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
  7. 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 237
  8. 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 179
  9. 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
  10. 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 145
  11. 2024AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathwayscited by 122
  12. 2024AgentScope: A Flexible yet Robust Multi-Agent Platformcited by 120
9 more
  1. 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 104
  2. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 80
  3. 2024Agents in Software Engineering: Survey, Landscape, and Visioncited by 60
  4. 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistantcited by 54
  5. 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Surveycited by 28
  6. 2025Multi-Agent Security Tax: Trading Off Security and Collaboration Capabilities in Multi-Agent Systemscited by 27
  7. 2024Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trendscited by 26
  8. 2024Unique Security and Privacy Threats of Large Language Models: A Comprehensive Surveycited by 20
  9. 2025Shapley-Coop: Credit Assignment for Emergent Cooperation in Self-Interested LLM Agentscited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 10.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Comprehensive Vulnerability Analysis is Necessary for Trustworthy LLM-MAS
  2. 2025To trust or not to trust: Attention-based Trust Management for LLM Multi-Agent Systems
  3. 2026Can Agents Trust Their Skills? Uncovering Unsafe Chains of Trust in Skill-Based LLM Agents
  4. 2025TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systems
  5. 2026Trust No Tool: Evaluating and Defending LLM Agents under Untrusted Tool Feedback
  6. 2026"Are You Sure?": An Empirical Study of Human Perception Vulnerability in LLM-Driven Agentic Systems
  7. 2025Seven Security Challenges in Cross-domain Multi-agent LLM Systems
  8. 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactions