mlsanityData to 14 Oct 2026

The Automated but Risky Game: Modeling and Benchmarking Agent-to-Agent Negotiations and Transactions in Consumer Markets

arXiv 2506.00073 ↗First posted 29 May 2025cs.AI cs.CL cs.CYcited by 15

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

AI agents are increasingly used in consumer-facing applications to assist with tasks such as product search, negotiation, and transaction execution. In this paper, we explore a future scenario where both consumers and merchants authorize AI agents to fully automate negotiations and transactions. We aim to answer two key questions: (1) Do different LLM agents vary in their ability to secure favorable deals for users? (2) What risks arise from fully automating deal-making with AI agents in consumer markets? To address these questions, we develop an experimental framework that evaluates the performance of various LLM agents in real-world negotiation and transaction settings. Our findings reveal that AI-mediated deal-making is an inherently imbalanced game -- different agents achieve significantly different outcomes for their users. Moreover, behavioral anomalies in LLMs can result in financial losses for both consumers and merchants, such as overspending or accepting unreasonable deals. These results underscore that while automation can improve efficiency, it also introduces substantial risks. Users should exercise caution when delegating business decisions to AI agents.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 17 of its 42 references that are in the map. First posted on arXiv 29 May 2025.

Builds on

17 of 42 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysis8 Feb

Other references · 16

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  2. 2020Scaling Laws for Neural Language Modelscited by 6,586
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  4. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  5. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
  6. 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 209
  7. 2024When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Methodcited by 204
  8. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 168
  9. 2018Decoupling Strategy and Generation in Negotiation Dialoguescited by 162
  10. 2023Cooperation, Competition, and Maliciousness: LLM-Stakeholders Interactive Negotiationcited by 96
  11. 2025Fraud-R1 : A Multi-Round Benchmark for Assessing the Robustness of LLM Against Augmented Fraud and Phishing Inducementscited by 32
  12. 2024ChatShop: Interactive Information Seeking with Language Agentscited by 24
4 more
  1. 2023Negotiating with LLMS: Prompt Hacks, Skill Gaps, and Reasoning Deficitscited by 16
  2. 2025Is Your LLM-Based Multi-Agent a Reliable Real-World Planner? Exploring Fraud Detection in Travel Planningcited by 15
  3. 2024ACE: A LLM-based Negotiation Coaching Systemcited by 13
  4. 2015Multi-agent Reinforcement Learning with Sparse Interactions by Negotiation and Knowledge Transfercited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 12.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026AgenticPay: A Multi-Agent LLM Negotiation System for Buyer-Seller Transactions
  2. 2026Strategic Exploitation in LLM Agent Markets: A Simulation Framework for E-Commerce Trust
  3. 2026LLM Consumer Behavior Theory: Foundations of a Novel Research Field
  4. 2026Business Arena: Benchmarking LLM Agents in a Realistic Marketplace
  5. 2026Competitive Market Behavior of LLMs
  6. 2024Measuring Bargaining Abilities of LLMs: A Benchmark and A Buyer-Enhancement Method
  7. 2026Quantifying Trust: Financial Risk Management for Trustworthy AI Agents
  8. 2025Magentic Marketplace: An Open-Source Environment for Studying Agentic Markets