The Automated but Risky Game: Modeling and Benchmarking Agent-to-Agent Negotiations and Transactions in Consumer Markets
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
AI agents are increasingly used in consumer-facing applications to assist with tasks such as product search, negotiation, and transaction execution. In this paper, we explore a future scenario where both consumers and merchants authorize AI agents to fully automate negotiations and transactions. We aim to answer two key questions: (1) Do different LLM agents vary in their ability to secure favorable deals for users? (2) What risks arise from fully automating deal-making with AI agents in consumer markets? To address these questions, we develop an experimental framework that evaluates the performance of various LLM agents in real-world negotiation and transaction settings. Our findings reveal that AI-mediated deal-making is an inherently imbalanced game -- different agents achieve significantly different outcomes for their users. Moreover, behavioral anomalies in LLMs can result in financial losses for both consumers and merchants, such as overspending or accepting unreasonable deals. These results underscore that while automation can improve efficiency, it also introduces substantial risks. Users should exercise caution when delegating business decisions to AI agents.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 17 of its 42 references that are in the map. First posted on arXiv 29 May 2025.
Builds on
17 of 42 references.
Closest ancestors · 1
Same direction, newest first
Other references · 16
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
- 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 209
- 2024When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Methodcited by 204
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 168
- 2018Decoupling Strategy and Generation in Negotiation Dialoguescited by 162
- 2023Cooperation, Competition, and Maliciousness: LLM-Stakeholders Interactive Negotiationcited by 96
- 2025Fraud-R1 : A Multi-Round Benchmark for Assessing the Robustness of LLM Against Augmented Fraud and Phishing Inducementscited by 32
- 2024ChatShop: Interactive Information Seeking with Language Agentscited by 24
4 more
- 2023Negotiating with LLMS: Prompt Hacks, Skill Gaps, and Reasoning Deficitscited by 16
- 2025Is Your LLM-Based Multi-Agent a Reliable Real-World Planner? Exploring Fraud Detection in Travel Planningcited by 15
- 2024ACE: A LLM-based Negotiation Coaching Systemcited by 13
- 2015Multi-agent Reinforcement Learning with Sparse Interactions by Negotiation and Knowledge Transfercited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 12.
15 papers.
Sort:
By area:
- 2026Instructing LLMs to Negotiate using Reinforcement Learning with Verifiable Rewardscited by 7
- 2025Aligning Large Language Model Agents with Rational and Moral Preferences: A Supervised Fine-Tuning Approachcited by 5
- 2025The Price of Thought: A Multilingual Analysis of Reasoning, Performance, and Cost of Negotiation in Large Language Modelscited by 5
- 2026Emergent Risks in Generative Multi-Agent Systemscited by 5
- 2026Don't Trust Stubborn Neighbors: A Security Framework for Agentic Networkscited by 4
- 2026Auditing Preferences for Brands and Cultures in LLMscited by 4
- 2025Agentic Inequalitycited by 3
- 2026Counterparty Modeling is Not Strategy: The Limits of LLM Negotiatorscited by 2
- 2026Simulating Human Memory with Language Modelscited by 2
- 2026Reasonably reasoning AI agents can avoid game-theoretic failures in zero-shot, provablycited by 1
- 2026SovereignNegotiation-Bench: Evaluating User-Owned Personal Agents In Delegated Bargaining Under Privacy, Consent, Evidence, And Institutional Pressurecited by 1
- 2026The Agentic Web Requires New Normative Infrastructurecited by 0
3 more
- 2026From Passive Delegates to Strategic Negotiators: Reinforcing Social Reasoning in Small Language Models with SocialRLcited by 0
- 2026Parallelism or Concession? Concurrency-Aware Procurement Negotiation for Agentic Commercecited by 0
- 2026BazaarBench: Delegation Safety in Decentralized C2C Marketplaces Run by LLM Agentscited by 0
- 2026BazaarBench: Delegation Safety in Decentralized C2C Marketplaces Run by LLM Agents5 Oct 2026
- 2026Parallelism or Concession? Concurrency-Aware Procurement Negotiation for Agentic Commerce5 Oct 2026
- 2026From Passive Delegates to Strategic Negotiators: Reinforcing Social Reasoning in Small Language Models with SocialRL13 Aug 2026
- 2026SovereignNegotiation-Bench: Evaluating User-Owned Personal Agents In Delegated Bargaining Under Privacy, Consent, Evidence, And Institutional Pressure2 Jul 2026
- 2026The Agentic Web Requires New Normative Infrastructure9 Jun 2026
- 2026Simulating Human Memory with Language Models25 May 2026
- 2026Counterparty Modeling is Not Strategy: The Limits of LLM Negotiators15 May 2026
- 2026Instructing LLMs to Negotiate using Reinforcement Learning with Verifiable Rewards10 Apr 2026
- 2026Emergent Risks in Generative Multi-Agent Systems29 Mar 2026
- 2026Reasonably reasoning AI agents can avoid game-theoretic failures in zero-shot, provably19 Mar 2026
- 2026Auditing Preferences for Brands and Cultures in LLMs18 Mar 2026
- 2026Don't Trust Stubborn Neighbors: A Security Framework for Agentic Networks16 Mar 2026
- 2025Aligning Large Language Model Agents with Rational and Moral Preferences: A Supervised Fine-Tuning Approachcited by 5
- 2026Don't Trust Stubborn Neighbors: A Security Framework for Agentic Networkscited by 4
- 2025Agentic Inequalitycited by 3
- 2026The Agentic Web Requires New Normative Infrastructurecited by 0
- 2026Parallelism or Concession? Concurrency-Aware Procurement Negotiation for Agentic Commercecited by 0
- 2026BazaarBench: Delegation Safety in Decentralized C2C Marketplaces Run by LLM Agentscited by 0
- 2026BazaarBench: Delegation Safety in Decentralized C2C Marketplaces Run by LLM Agents5 Oct 2026
- 2026Parallelism or Concession? Concurrency-Aware Procurement Negotiation for Agentic Commerce5 Oct 2026
- 2026The Agentic Web Requires New Normative Infrastructure9 Jun 2026
- 2026Don't Trust Stubborn Neighbors: A Security Framework for Agentic Networks16 Mar 2026
- 2025Agentic Inequality19 Oct 2025
- 2025Aligning Large Language Model Agents with Rational and Moral Preferences: A Supervised Fine-Tuning Approach28 Jul 2025
- 2025The Price of Thought: A Multilingual Analysis of Reasoning, Performance, and Cost of Negotiation in Large Language Modelscited by 5
- 2026Reasonably reasoning AI agents can avoid game-theoretic failures in zero-shot, provablycited by 1
- 2026From Passive Delegates to Strategic Negotiators: Reinforcing Social Reasoning in Small Language Models with SocialRLcited by 0
- 2026From Passive Delegates to Strategic Negotiators: Reinforcing Social Reasoning in Small Language Models with SocialRL13 Aug 2026
- 2026Reasonably reasoning AI agents can avoid game-theoretic failures in zero-shot, provably19 Mar 2026
- 2025The Price of Thought: A Multilingual Analysis of Reasoning, Performance, and Cost of Negotiation in Large Language Models9 Oct 2025
- 2026Instructing LLMs to Negotiate using Reinforcement Learning with Verifiable Rewardscited by 7
- 2026Emergent Risks in Generative Multi-Agent Systemscited by 5
- 2026Auditing Preferences for Brands and Cultures in LLMscited by 4
- 2026Counterparty Modeling is Not Strategy: The Limits of LLM Negotiatorscited by 2
- 2026Simulating Human Memory with Language Modelscited by 2
- 2026SovereignNegotiation-Bench: Evaluating User-Owned Personal Agents In Delegated Bargaining Under Privacy, Consent, Evidence, And Institutional Pressurecited by 1
- 2026SovereignNegotiation-Bench: Evaluating User-Owned Personal Agents In Delegated Bargaining Under Privacy, Consent, Evidence, And Institutional Pressure2 Jul 2026
- 2026Simulating Human Memory with Language Models25 May 2026
- 2026Counterparty Modeling is Not Strategy: The Limits of LLM Negotiators15 May 2026
- 2026Instructing LLMs to Negotiate using Reinforcement Learning with Verifiable Rewards10 Apr 2026
- 2026Emergent Risks in Generative Multi-Agent Systems29 Mar 2026
- 2026Auditing Preferences for Brands and Cultures in LLMs18 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026AgenticPay: A Multi-Agent LLM Negotiation System for Buyer-Seller Transactions
- 2026Strategic Exploitation in LLM Agent Markets: A Simulation Framework for E-Commerce Trust
- 2026LLM Consumer Behavior Theory: Foundations of a Novel Research Field
- 2026Business Arena: Benchmarking LLM Agents in a Realistic Marketplace
- 2026Competitive Market Behavior of LLMs
- 2024Measuring Bargaining Abilities of LLMs: A Benchmark and A Buyer-Enhancement Method
- 2026Quantifying Trust: Financial Risk Management for Trustworthy AI Agents
- 2025Magentic Marketplace: An Open-Source Environment for Studying Agentic Markets