Counterparty Modeling is Not Strategy: The Limits of LLM Negotiators
Not on the map. Why?
Abstract (arXiv)
Negotiation requires more than inferring what the other side wants: it requires using that information to make advantageous offers and counteroffers over multiple turns. We study whether large language model (LLM) agents do this in a controlled multi-attribute bargaining environment. We find that current LLM agents can model a counterparty's preferences, but do not reliably turn that knowledge into strategic bargaining. When given negotiating partner preference information, agents model it accurately and early in their reasoning traces, yet this does not reliably improve outcomes for the informed side. Turn-level analyses show why: agents often respond to what they believe the counterparty values, but do not consistently pair those moves with gains on their own high-value attributes. Sellers are more accommodating overall, and in asymmetric-information conditions, the informed side often makes the more weakly compensated concessions. Because agents fail to leverage this underlying utility structure for strategic advantage, their final agreements are heavily dictated by surface-level opening anchors rather than actual utility weights. Finally, requiring agents to explicitly state concession-for-reciprocity trades before making an offer makes individual turns look more strategic, but ultimately fails to improve the efficiency of the final agreements.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 27 references that are in the map. First posted on arXiv 15 May 2026.
Builds on
18 of 27 references.
References · 18
- 2025Qwen3 Technical Reportcited by 8,820
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 367
- 2023Evaluating Large Language Models in Theory of Mind Taskscited by 222
- 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 209
- 2023Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedbackcited by 207
- 2018Decoupling Strategy and Generation in Negotiation Dialoguescited by 162
- 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysiscited by 100
- 2023AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?cited by 81
- 2023Strategic Reasoning with Language Modelscited by 64
- 2024Game-theoretic LLM: Agent Workflow for Negotiation Gamescited by 56
- 2023Strategic Behavior of Large Language Models: Game Structure vs. Contextual Framingcited by 51
- 2024Evaluating Language Model Agency through Negotiationscited by 48
6 more
- 2024Efficacy of Language Model Self-Play in Non-Zero-Sum Gamescited by 15
- 2025The Automated but Risky Game: Modeling and Benchmarking Agent-to-Agent Negotiations and Transactions in Consumer Marketscited by 15
- 2026AgenticPay: A Multi-Agent LLM Negotiation System for Buyer-Seller Transactionscited by 12
- 2025SI-Bench: Benchmarking Social Intelligence of Large Language Models in Human-to-Human Conversationscited by 7
- 2026Discovering Differences in Strategic Behavior Between Humans and LLMscited by 3
- 2025The Fragility of Strategic Thinking in Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025The Illusion of Rationality: Tacit Bias and Strategic Dominance in Frontier LLM Negotiation Games
- 2025Strategic Tradeoffs Between Humans and AI in Multi-Agent Bargaining
- 2026TERMS-Bench: Diagnosing LLM Negotiation Agents Beyond Deal Rate
- 2026MERIT Feedback Elicits Better Bargaining in LLM Negotiators
- 2025LLM Agents for Bargaining with Utility-based Feedback
- 2026Training Language Models for Bilateral Trade with Private Information
- 2024Measuring Bargaining Abilities of LLMs: A Benchmark and A Buyer-Enhancement Method
- 2026Competitive Market Behavior of LLMs