mlsanityData to 14 Oct 2026

"What Did It Actually Do?": Understanding Risk Awareness and Traceability for Computer-Use Agents

arXiv 2603.28551 ↗First posted 30 Mar 2026cs.CR cs.ET cs.HCcited by 2

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Personalized computer-use agents are rapidly moving from expert communities into mainstream use. Unlike conventional chatbots, these systems can install skills, invoke tools, access private resources, and modify local environments on users' behalf. Yet users often do not know what authority they have delegated, what the agent actually did during task execution, or whether the system has been safely removed afterward. We investigate this gap as a combined problem of risk understanding and post-hoc auditability, using OpenClaw as a motivating case. We first build a multi-source corpus of the OpenClaw ecosystem, including incidents, advisories, malicious-skill reports, news coverage, tutorials, and social-media narratives. We then conduct an interview study to examine how users and practitioners understand skills, autonomy, privilege, persistence, and uninstallation. Our findings suggest that participants often recognized these systems as risky in the abstract, but lacked concrete mental models of what skills can do, what resources agents can access, and what changes may remain after execution or removal. Motivated by these findings, we propose AgentTrace, a traceability framework and prototype interface for visualizing agent actions, touched resources, permission history, provenance, and persistent side effects. A scenario-based evaluation suggests that traceability-oriented interfaces can improve understanding of agent behavior, support anomaly detection, and foster more calibrated trust.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 13 of its 24 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

13 of 24 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026From Assistant to Double Agent: Formalizing and Benchmarking Attacks on OpenClaw for Personalized Local AI Agent9 Feb

Other references · 12

  1. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  2. 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 230
  3. 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agentscited by 65
  4. 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 39
  5. 2026Don't Let the Claw Grip Your Hand: A Security Analysis and Defense Framework for OpenClawcited by 29
  6. 2023How Do Analysts Understand and Verify AI-Assisted Data Analyses?cited by 26
  7. 2024AgentLens: Visual Analysis for Agent Behaviors in LLM-based Autonomous Systemscited by 23
  8. 2025Unsafe LLM-Based Search: Quantitative Analysis and Mitigation of Safety Risks in AI Web Searchcited by 16
  9. 2025JALMBench: Benchmarking Jailbreak Vulnerabilities in Audio Language Modelscited by 16
  10. 2025Users' Mental Models of Generative AI Chatbot Ecosystemscited by 7
  11. 2026DiLLS: Interactive Diagnosis of LLM-based Multi-agent Systems via Layered Summary of Agent Behaviorscited by 7
  12. 2024Cross-Chain Options: A Bridgeless, Universal, and Efficient Approachcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Toward User Comprehension Supports for LLM Agent Skill Specifications
  2. 2026The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agents
  3. 2026When Safe Skills Collide: Measuring Compositional Risk in Agent Skill Ecosystems
  4. 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale
  5. 2026SkillAtlas: An Attack Trace Library for Agent Skills
  6. 2026ADeptS-Bench: Measuring the Trustworthiness of Computer Use Agents Across Devices
  7. 2026Benchmarking Security Risk Detection and Verification in Open Agentic Skill Ecosystems
  8. 2026SCOUT: Synergizing Reasoning and Tool-Use for Computer-Use Safety