mlsanityData to 7 Oct 2026

Many-to-One Adversarial Consensus: Exposing Multi-Agent Collusion Risks in AI-Based Healthcare

arXiv 2512.03097 ↗First posted 1 Dec 2025cs.CR cs.LG cs.MAcited by 3

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

The integration of large language models (LLMs) into healthcare IoT systems promises faster decisions and improved medical support. LLMs are also deployed as multi-agent teams to assist AI doctors by debating, voting, or advising on decisions. However, when multiple assistant agents interact, coordinated adversaries can collude to create false consensus, pushing an AI doctor toward harmful prescriptions. We develop an experimental framework with scripted and unscripted doctor agents, adversarial assistants, and a verifier agent that checks decisions against clinical guidelines. Using 50 representative clinical questions, we find that collusion drives the Attack Success Rate (ASR) and Harmful Recommendation Rates (HRR) up to 100% in unprotected systems. In contrast, the verifier agent restores 100% accuracy by blocking adversarial consensus. This work provides the first systematic evidence of collusion risk in AI healthcare and demonstrates a practical, lightweight defence that ensures guideline fidelity.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 26 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

17 of 26 references.

References · 17

  1. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  2. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  3. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  4. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
  5. 2018AI safety via debatecited by 384
  6. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 328
  7. 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 249
  8. 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 179
  9. 2025Multi-Agent Risks from Advanced AIcited by 150
  10. 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganographycited by 107
  11. 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?cited by 74
  12. 2024GroupDebate: Enhancing the Efficiency of Multi-Agent Debate Using Group Discussioncited by 64
5 more
  1. 2024LLM Voting: Human Choices and AI Collective Decision Makingcited by 47
  2. 2025The Traitors: Deception and Trust in Multi-Agent Language Model Simulationscited by 30
  3. 2025Do LLMs trust AI regulation? Emerging behaviour of game-theoretic LLM agentscited by 11
  4. 2025Evaluating LLM Agent Collusion in Double Auctionscited by 11
  5. 2022Reliable and Resilient AI and IoT-based Personalised Healthcare Services: A Surveycited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Safe AI Clinicians: A Comprehensive Study on Large Language Model Jailbreaking in Healthcare
  2. 2026Agentic Governance and Adversarial Verification for Policy-Constrained LLM Healthcare Appeal Generation
  3. 2024Ensuring Safety and Trust: Analyzing the Risks of Large Language Models in Medicine
  4. 2026Improving the Safety and Trustworthiness of Medical AI via Multi-Agent Evaluation Loops
  5. 2025MedSentry: Understanding and Mitigating Safety Risks in Medical LLM Multi-Agent Systems
  6. 2025Balancing Safety and Helpfulness in Healthcare AI Assistants through Iterative Preference Alignment
  7. 2025The Illusion of Readiness in Health AI
  8. 2026Detection of adversarial intent in Human-AI teams using LLMs