mlsanityData to 14 Oct 2026

Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent

arXiv 2607.18257 ↗First posted 14 May 2026cs.HC cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

When AI agents shift from answering questions to taking actions, users face a new problem: deciding what to delegate, to a system whose action space they cannot fully anticipate. We call the resulting dissatisfaction delegation regret, a pattern in which users regret not that the agent erred, but that it acted beyond what they would have authorized. In a controlled study, 20 university students completed five common daily tasks using OpenClaw, a general-purpose AI agent, across tasks chosen to vary in privacy, stakes, and reversibility. For each task we measured trust, perceived control, transparency, supervision burden, and approval preference on 5-point Likert scales, and collected free-text reflections analyzed through thematic coding. Three findings emerged. First, participants calibrated trust per task rather than per agent: they granted wide autonomy for advisory and low-stakes tasks but demanded confirmation for irreversible, externally visible actions. Second, irreversibility combined with external visibility, rather than stakes alone, appeared to drive trust withdrawal: the moderate-stakes email task triggered the sharpest drop in trust (M = 3.10) and the highest demand for approval (M = 4.65), whereas a high-stakes but verifiable task did not produce the same response. Third, delegation regret appeared consistently when the agent executed actions without preview, even when the output was rated as successful. We discuss implications for agent designs that expose action boundaries, support per-task autonomy policies, and separate advisory output from agentic execution.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 39 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

14 of 39 references.

References · 14

  1. 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
  2. 2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthycited by 183
  3. 2022Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programmingcited by 91
  4. 2023Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programmingcited by 89
  5. 2023The Robots are Here: Navigating the Generative AI Revolution in Computing Educationcited by 86
  6. 2023A Large-Scale Survey on the Usability of AI Programming Assistants: Successes and Challengescited by 75
  7. 2025Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistantcited by 54
  8. 2023Computing Education in the Era of Generative AIcited by 52
  9. 2020The Role of Domain Expertise in User Trust and the Impact of First Impressions with Intelligent Systemscited by 34
  10. 2023Investigating and Designing for Trust in AI-powered Code Generation Toolscited by 34
  11. 2025Towards Automating Data Access Permissions in AI Agentscited by 21
  12. 2023Exploring the Role of AI Assistants in Computer Science Education: Methods, Implications, and Instructor Perspectivescited by 12
2 more
  1. 2025Non-programmers Assessing AI-Generated Code: A Case Study of Business Users Analyzing Datacited by 2
  2. 2026Belief Updating and Delegation in Multi-Task Human-AI Interaction: Evidence from Controlled Simulationscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026TrustMI: Causally controlling how assistants trust their users
  2. 2026Trust and Task Completion in the World of Consumer AI Agents
  3. 2026From Role to Person: Trust Calibration Challenges in Twin Agents
  4. 2022Measuring an artificial intelligence agent's trust in humans using machine incentives
  5. 2026Choose Your Agent: Tradeoffs in Adopting AI Advisors, Coaches, and Delegates in Multi-Party Negotiation
  6. 2025Autonomy Reshapes How Personalization Affects Privacy Concerns and Trust in LLM Agents
  7. 2026Language model agents show in-group trust bias invisible to standard behavioural audits
  8. 2026Trust Between AI Agents: Measuring Formation, Breakage, and Recovery, with Implications for Governing Multi-Agent Systems