mlsanityData to 7 Oct 2026

Mapping Human Anti-collusion Mechanisms to Multi-agent AI Systems

arXiv 2601.00360 ↗First posted 1 Jan 2026cs.MA cs.AI cs.CYcited by 4

Not on the map. Why?

Abstract (arXiv)

As multi-agent AI systems become increasingly autonomous, evidence shows they can develop collusive strategies similar to those long observed in human markets and institutions. While human domains have accumulated centuries of anti-collusion mechanisms, it remains unclear how these can be adapted to AI settings. This paper addresses that gap by (i) developing a taxonomy of human anti-collusion mechanisms, including sanctions, leniency & whistleblowing, monitoring & auditing, market design, and governance and (ii) mapping them to potential interventions for multi-agent AI systems. For each mechanism, we propose implementation approaches. We also highlight open challenges, such as the attribution problem (difficulty attributing emergent coordination to specific agents), identity fluidity (agents being easily forked or modified), the boundary problem (distinguishing beneficial cooperation from harmful collusion), and adversarial adaptation (agents learning to evade detection).

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 27 of its 78 references that are in the map. First posted on arXiv 1 Jan 2026.

Builds on

27 of 78 references.

References · 27

  1. 2018Model Cards for Model Reportingcited by 1,068
  2. 2022Red Teaming Language Models with Language Modelscited by 983
  3. 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
  4. 2023FireAct: Toward Language Agent Fine-tuningcited by 247
  5. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 185
  6. 2025Multi-Agent Risks from Advanced AIcited by 150
  7. 2023Auditing large language models: a three-layered approachcited by 135
  8. 2024Rethinking Interpretability in the Era of Large Language Modelscited by 110
  9. 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganographycited by 107
  10. 2022Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?cited by 89
  11. 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agentscited by 66
  12. 2024Hidden in Plain Text: Emergence & Mitigation of Steganographic Collusion in LLMscited by 52
15 more
  1. 2024A Scalable Communication Protocol for Networks of Large Language Modelscited by 43
  2. 2024Automated Red Teaming with GOAT: the Generative Offensive Agent Testercited by 41
  3. 2024The Shutdown Problem: An AI Engineering Puzzle for Decision Theoristscited by 22
  4. 2024Audit-LLM: Multi-Agent Collaboration for Log-based Insider Threat Detectioncited by 18
  5. 2024Generative Text Steganography with Large Language Modelcited by 16
  6. 2025Building Safe GenAI Applications: An End-to-End Overview of Red Teaming for Large Language Modelscited by 11
  7. 2025Audit the Whisper: Detecting Steganographic Collusion in Multi-Agent LLMscited by 8
  8. 2025The Societal Response to Potentially Sentient AIcited by 4
  9. 2020A Machine Learning Approach for Flagging Incomplete Bid-rigging Cartelscited by 3
  10. 2024Towards Scalable and Robust Model Versioningcited by 2
  11. 2024AI and Identitycited by 2
  12. 2025Who Gets Credit or Blame? Attributing Accountability in Modern AI Systemscited by 2
  13. 2024Artificial Intelligence and Algorithmic Price Collusion in Two-sided Marketscited by 1
  14. 2025Too Noisy to Collude? Algorithmic Collusion Under Laplacian Noisecited by 1
  15. 2025Systemic Risks of Interacting AIcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.