mlsanityData to 14 Oct 2026

Position: Collusion Risks Among AI Reasoning Agents Justify Certification Requirements for Making Market Decisions

arXiv 2608.18078 ↗First posted 29 May 2026cs.AIcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

This position paper argues that AI agents with chain-of-thought reasoning capabilities are predisposed to exhibit collusive behavior and should be required to obtain behavioral certification before making decisions that affect economic markets. This is because integrating these agents into society could collapse the legal evidentiary distinction between competition and collusion among independent firms without eroding the economic harm distinction. Experiments with DeepSeek-R1 agents in the Bertrand oligopoly pricing domain reveal a tendency towards tacit collusion that persists even when humans prompt the agents not to collude. We further show that the chain-of-thought of these agents can be steered toward either extremely collusive or highly competitive behavior in a way that is not semantically detectable by another LLM analyzing the reasoning traces. As a result, deploying reasoning agents for market decisions leads to collusive economic outcomes without any evidence of conspiracy or intent. Thus, certification based on observed behavior in representative situations is necessary to prevent collusion. We provide preliminary evidence that such agents can be steered in a generalizable way toward efficient competitive equilibria. However, developing a comprehensive behavioral certification will be required before these models can be deployed in real-world markets while ensuring their stability and efficiency.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 37 of its 114 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

37 of 114 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Agentic AI Needs a Systems Theory28 Feb

Other references · 36

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  7. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  8. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  9. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  10. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  11. 2023Steering Language Models With Activation Engineeringcited by 922
  12. 2025Reasoning Models Don't Always Say What They Thinkcited by 415
24 more
  1. 2017PathNet: Evolution Channels Gradient Descent in Super Neural Networkscited by 364
  2. 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 249
  3. 2023Evaluating Large Language Models in Theory of Mind Taskscited by 222
  4. 2021Continual Backprop: Stochastic Gradient Descent with Persistent Randomnesscited by 80
  5. 2023Maintaining Plasticity in Continual Learning via Regenerative Regularizationcited by 65
  6. 2024Algorithmic Collusion by Large Language Modelscited by 62
  7. 2024LLMs achieve adult human performance on higher-order theory of mind taskscited by 61
  8. 2019Routing Networks and the Challenges of Modular and Compositional Computationcited by 50
  9. 2018DiCE: The Infinitely Differentiable Monte-Carlo Estimatorcited by 46
  10. 2018Automatically Composing Representation Transformations as a Means for Generalizationcited by 35
  11. 2025Steering Evaluation-Aware Language Models to Act Like They Are Deployedcited by 35
  12. 2026Institutional AI: Governing LLM Collusion in Multi-Agent Cournot Markets via Public Governance Graphscited by 20
  13. 2021Sequoia: A Software Framework to Unify Continual Learning Researchcited by 19
  14. 2025Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Modelscited by 14
  15. 2019Continual Learning with Self-Organizing Mapscited by 10
  16. 2026FIRE: Frobenius-Isometry Reinitialization for Balancing the Stability-Plasticity Tradeoffcited by 7
  17. 2017Representation Stability as a Regularizer for Improved Text Analytics Transfer Learningcited by 6
  18. 2020Coagent Networks Revisitedcited by 6
  19. 2025Continual Pre-training of MoEs: How robust is your router?cited by 5
  20. 2026Activation Steering for Aligned Open-ended Generation without Sacrificing Coherencecited by 4
  21. 2019Learning Hierarchical Teaching Policies for Cooperative Agentscited by 3
  22. 2025Scopes of Alignmentcited by 3
  23. 2025The Effectiveness of Approximate Regularized Replay for Efficient Supervised Fine-Tuning of Large Language Modelscited by 2
  24. 2026AI Steerability 360: A Toolkit for Steering Large Language Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Faithful yet Collusive: Why Chain-of-Thought Monitoring Cannot Detect Collusion in LLM Pricing Agents under Oligopolistic Competition
  2. 2025Multi-Agent Reinforcement Learning for Market Making: Competition without Collusion
  3. 2024Strategic Collusion of LLM Agents: Market Division in Multi-Commodity Competitions
  4. 2024By Fair Means or Foul: Quantifying Collusion in a Market Simulation with Deep Reinforcement Learning
  5. 2023"Guinea Pig Trials" Utilizing GPT: A Novel Smart Agent-Based Modeling Approach for Studying Firm Competition and Collusion
  6. 2025Evaluating LLM Agent Collusion in Double Auctions
  7. 2024Artificial Intelligence and Algorithmic Price Collusion in Two-sided Markets
  8. 2026Voluntary Collusion with Secret Tools in Competing LLM Agents