mlsanityData to 14 Oct 2026

Prompt Optimization Enables Stable Algorithmic Collusion in LLM Agents

arXiv 2604.17774 ↗First posted 20 Apr 2026cs.AIcited by 4

On the map: LLM agents and tool use → Financial trading and forecasting agents

Abstract (arXiv)

LLM agents in markets present algorithmic collusion risks. While prior work shows LLM agents reach supracompetitive prices through tacit coordination, existing research focuses on hand-crafted prompts. The emerging paradigm of prompt optimization necessitates new methodologies for understanding autonomous agent behavior. We investigate whether prompt optimization leads to emergent collusive behaviors in market simulations. We propose a meta-learning loop where LLM agents participate in duopoly markets and an LLM meta-optimizer iteratively refines shared strategic guidance. Our experiments reveal that meta-prompt optimization enables agents to discover stable tacit collusion strategies with substantially improved coordination quality compared to baseline agents. These behaviors generalize to held-out test markets, indicating discovery of general coordination principles. Analysis of evolved prompts reveals systematic coordination mechanisms through stable shared strategies. Our findings call for further investigation into AI safety implications in autonomous multi-agent systems.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 22 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

11 of 22 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026On the Fragility of AI Agent Collusion18 Mar
  2. 2024Strategic Collusion of LLM Agents: Market Division in Multi-Commodity Competitions19 Sep

Other references · 9

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  2. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  3. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
  4. 2024Secret Collusion among AI Agents: Multi-Agent Deception via Steganographycited by 113
  5. 2024Algorithmic Collusion by Large Language Modelscited by 62
  6. 2025Distributional AGI Safetycited by 12
  7. 2025EconEvals: Benchmarks and Litmus Tests for Economic Decision-Making by LLM Agentscited by 10
  8. 2025ZERA: Zero-init Instruction Evolving Refinement Agent -- From Zero Instructions to Structured Prompts via Principle-based Optimizationcited by 6
  9. 2025Aligning Large Language Model Agents with Rational and Moral Preferences: A Supervised Fine-Tuning Approachcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Multi-Agent Reinforcement Learning for Market Making: Competition without Collusion
  2. 2026AI agents in Algorithmic Electricity Markets: On the Emergence of Tacit Collusion
  3. 2026Colosseum: Auditing Collusion in Cooperative Multi-Agent Systems
  4. 2025Evaluating LLM Agent Collusion in Double Auctions
  5. 2024Algorithmic Collusion And The Minimum Price Markov Game ↗
  6. 2024Artificial Intelligence and Algorithmic Price Collusion in Two-sided Markets
  7. 2025Algorithmic Pricing and Algorithmic Collusion
  8. 2024By Fair Means or Foul: Quantifying Collusion in a Market Simulation with Deep Reinforcement Learning