Choose Your Agent: Tradeoffs in Adopting AI Advisors, Coaches, and Delegates in Multi-Party Negotiation
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
As AI usage becomes more prevalent in social contexts, understanding agent-user interaction is critical to designing systems that imp rove both individual and group outcomes. We present an online behavioral experiment (N=243) in which participants play three multi-tu rn bargaining games in groups of three. Each game, presented in randomized order, grants access to a single LLM assistance modality: proactive recommendations from an Advisor, reactive feedback from a Coach, or autonomous execution by a Delegate. All three modalitie s are powered by an LLM with super-human performance within this negotiation setting. On each turn, participants privately decide whe ther to act manually or use the AI modality available in that game. We document a preference-performance misalignment: participants s trongly prefer the higher-control Advisor (44%) over the Delegate (19%), yet groups only significantly increase collective surplus un der Delegate access. Adjusting for voluntary non-compliance, delegating to the AI yields suggestive individual welfare gains, roughly 1.5x the intent-to-treat estimate. A mechanism analysis traces this gap to a human filter: AI-generated proposals create more joint surplus than manual proposals across all conditions, but in the Advisor and Coach modes users modify, override, or ignore the AI's su ggestions, reverting toward human-baseline trade patterns. The Delegate advantage arises not from a different AI capability but from bypassing this filtering step altogether. Realizing these welfare gains depends not only on model capability, but on the interaction structure through which that capability is delivered. We argue that assistance modalities should be designed as mechanisms with endog enous participation; adoption-compatible interaction rules are a prerequisite to improving welfare with automated assistance.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 18 of its 102 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
18 of 102 references.
Closest ancestors · 2
Same direction, newest first
- 2025Strategic Tradeoffs Between Humans and AI in Multi-Agent Bargaining11 Sep
- 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysis8 Feb
Other references · 16
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 169
- 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 138
- 2019The Algorithmic Automation Problem: Prediction, Triage, and Human Effortcited by 101
- 2020"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humanscited by 86
- 2019Ask Not What AI Can Do, But What AI Should Do: Towards a Framework of Task Delegabilitycited by 36
- 2023Human-AI Collaboration: The Effect of AI Delegation on Human Task Performance and Task Satisfactioncited by 32
- 2025Virtual Agent Economiescited by 17
- 2024Take It, Leave It, or Fix It: Measuring Productivity and Trust in Human-AI Collaborationcited by 12
- 2025LLM Bidders Preserve the Mechanism-Level Orderings of Human Bidderscited by 10
- 2025LLM-Powered Preference Elicitation in Combinatorial Assignmentcited by 7
4 more
- 2025More AI Assistance Reduces Cognitive Engagement: Examining the AI Assistance Dilemma in AI-Supported Note-Takingcited by 7
- 2021Delegation to autonomous agents promotes cooperation in collective-risk dilemmascited by 3
- 2022An Exploration of Post-Editing Effectiveness in Text Summarizationcited by 3
- 2025Integrative Experiments Identify How Punishment Impacts Welfare in Public Goods Gamescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Advancing AI Negotiations: A Large-Scale Autonomous Negotiation Competition
- 2025When Trust Collides: Decoding Human-LLM Cooperation Dynamics through the Prisoner's Dilemma
- 2025The AI in the Mirror: LLM Self-Recognition in an Iterated Public Goods Game
- 2025The Automated but Risky Game: Modeling and Benchmarking Agent-to-Agent Negotiations and Transactions in Consumer Markets
- 2025Collaborate, Deliberate, Evaluate: How LLM Alignment Affects Coordinated Multi-Agent Outcomes
- 2026Language Models Exhibit Inconsistent Biases Towards Algorithmic Agents and Human Experts
- 2026Cooperate to Compete: Strategic Coordination in Multi-Agent Conquest
- 2026From Passive Delegates to Strategic Negotiators: Reinforcing Social Reasoning in Small Language Models with SocialRL