Unaccountable Delegation, Fading Skills: Mapping the Risks of Workplace AI Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
To anticipate socio-technical risks from AI agents, organizations need taxonomies to classify them. However, existing AI risk taxonomies focus on broad risks and do not capture job-specific risks introduced by agents. To address this gap, we make three main contributions. First, we developed a multi-layer framework from a literature review of AI agents. The framework models three core components and their interactions: agents, goals, and environment. Second, we embedded this framework in a structured prompt and applied it to descriptions of 2,078 job tasks from the O*NET database, producing 8,356 risk scenarios labeled by severity and deployment mode (automation or augmentation). We validated these scenarios with 45 workers across 10 job roles and an independent LLM judge, confirming their plausibility and alignment with job tasks. Finally, we extended an existing taxonomy to create a 15-category taxonomy of workplace AI agent risks that covers all our risk scenarios. Our analysis highlights four findings. First, augmentation is not inherently safe because overreliance on agents can gradually erode workers' skills and oversight. Second, Erroneous Agent Actions accounts for the largest share of risk scenarios and has the highest concentration of severe risks. Many arise at the human-agent boundary. Third, automation is associated mainly with organizational risks, while augmentation is associated mainly with risks to workers. Fourth, workers found our taxonomy easier to use for a risk classification task than two other taxonomies and preferred it in 64% of non-tied comparisons with a recent generative AI risk taxonomy. These findings show that workplace AI agent risks do not arise from agents alone; they also depend on how people work with agents and how agents are deployed. Safer workplaces require not only safer agents but also carefully designed human-AI agent collaboration.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 29 of its 58 references that are in the map. First posted on arXiv 9 Aug 2026.
Builds on
29 of 58 references.
Closest ancestors · 2
Same direction, newest first
- 2025With Great Capabilities Come Great Responsibilities: Introducing the Agentic Risk & Capability Framework for Governing Agentic AI Systems22 Dec
- 2025A Safety and Security Framework for Real-World Agentic Systems27 Nov
Other references · 27
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2018Datasheets for Datasetscited by 1,371
- 2018Model Cards for Model Reportingcited by 1,068
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 348
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 154
- 2025Multi-Agent Risks from Advanced AIcited by 150
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
15 more
- 2020Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Databasecited by 95
- 2024The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationshipscited by 61
- 2023Investigating and Designing for Trust in AI-powered Code Generation Toolscited by 34
- 2024AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policiescited by 34
- 2025Future of Work with AI Agents: Auditing Automation and Augmentation Potential across the U.S. Workforcecited by 33
- 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototypingcited by 28
- 2023AHA!: Facilitating AI Impact Assessment by Generating Examples of Harmscited by 26
- 2025BingoGuard: LLM Content Moderation Tools with Risk Levelscited by 20
- 2024Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generatorscited by 18
- 2025RiskRAG: A Data-Driven Solution for Improved AI Model Risk Reportingcited by 9
- 2025Atlas of AI Risks: Enhancing Public Understanding of AI Riskscited by 7
- 2024Lessons for Editors of AI Incidents from the AI Incident Databasecited by 5
- 2025From Incidents to Insights: Patterns of Responsibility following AI Harmscited by 5
- 2025A Risk Ontology for Evaluating AI-Powered Psychotherapy Virtual Agentscited by 5
- 2026Agent-Supported Foresight for AI Systemic Risks: AI Agents for Breadth, Experts for Judgmentcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Who Delegates to AI? Evidence from Agent Configurations in Github
- 2026Agentic AI and Occupational Displacement: A Multi-Regional Task Exposure Analysis of Emerging Labor Market Disruption
- 2026When Safe Skills Collide: Measuring Compositional Risk in Agent Skill Ecosystems
- 2024The AI risk repository: A meta-review, database, and taxonomy of risks from artificial intelligence
- 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale
- 2026SafePro: Evaluating the Safety of Professional-Level AI Agents
- 2026Bounded by Risk, Not Capability: Quantifying AI Occupational Substitution Rates via a Tech-Risk Dual-Factor Model ↗
- 2026"What Did It Actually Do?": Understanding Risk Awareness and Traceability for Computer-Use Agents