mlsanityData to 7 Oct 2026

The Ethics of Autonomous AI Agents for Offensive Security

arXiv 2607.20255 ↗First posted 22 Jul 2026cs.CR cs.AIcited by 1

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

LLM-driven autonomous agents are reshaping offensive security. Unlike traditional penetration-testing tooling - deterministic, narrowly scoped, and operated by trained practitioners - agentic security tools exhibit indeterminacy along three independent dimensions. First, their actions are drawn from a non-deterministic policy whose outputs resist both ex-ante and ex-post explanation. This complicates incident attribution and pre-deployment safety reviews. Second, their impact is open-ended due to their non-deterministic actions, agency of utilized models, and opaque LLM supply-chains. Third, their user population is indeterminate in both size and required skill: the operating skill floor for using or developing offensive capabilities has dropped sharply. These three properties are linked thematically, but are not derivable from one another. Combined with the structural cost asymmetry between offense and defense, they enable the industrialization of offensive capability. The net short-term effect favors attackers, even if the same technology may, in the long run, democratize access to defensive practice. Existing dual-use cybersecurity and AI-ethics frameworks struggle to address this combination. Our work analyzes how moral attribution becomes diffuse between users, tool-makers, and third parties when employing autonomous AI agents for offensive security. We also examine the stakeholder impact of this technology and provide stratified recommendations.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 17 of its 67 references that are in the map. First posted on arXiv 22 Jul 2026.

Builds on

17 of 67 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Enhancing Linux Privilege Escalation Attack Capabilities of Local LLM Agents29 Apr
  2. 2025VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative Framework23 Jan

Other references · 15

  1. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  2. 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 159
  3. 2023Getting pwn'd by AI: Penetration Testing with Large Language Modelscited by 82
  4. 2024Large Language Models Reflect the Ideology of their Creatorscited by 56
  5. 2022Structured access: an emerging paradigm for safe AI deploymentcited by 40
  6. 2023LLMs as Hackers: Autonomous Linux Privilege Escalation Attackscited by 25
  7. 2025Incalmo: An Autonomous LLM-assisted System for Red Teaming Multi-Host Networkscited by 17
  8. 2025Can LLMs Hack Enterprise Networks? Autonomous Assumed Breach Penetration-Testing Active Directory Networkscited by 12
  9. 2023Understanding Hackers' Work: An Empirical Study of Offensive Security Practitionerscited by 8
  10. 2024AutoPT: How Far Are We from the End2End Automated Web Penetration Testing?cited by 7
  11. 2025Adversarial Bug Reports as a Security Risk in Language Model-Based Automated Program Repaircited by 4
  12. 2025CAI Fluency: A Framework for Cybersecurity AI Fluencycited by 3
3 more
  1. 2026Cochise: A Reference Harness for Autonomous Penetration Testingcited by 3
  2. 2019Updating the Wassenaar Debate Once Again: Surveillance, Intrusion Software, and Ambiguitycited by 1
  3. 2026Criminal Liability of Generative Artificial Intelligence Providers for User-Generated Child Sexual Abuse Materialcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Recognition Without Mitigation: Ethical Frameworks in Autonomous Offensive-LLM Agent Research
  2. 2026Toward Secure AI-Powered Penetration Testing Agents: Security Threats, Guardrails, and Architectural Perspectives
  3. 2026LLM agents security duality: a comprehensive survey of self-security and empowered cybersecurity
  4. 2025Game Theory Meets LLM and Agentic AI: Reimagining Cybersecurity for the Age of Intelligent Threats
  5. 2024Artificial Intelligence as the New Hacker: Developing Agents for Offensive Security
  6. 2026To Defend Against Cyber Attacks, We Must Teach AI Agents to Hack
  7. 2026A New Framework for Cybersecurity Refusals in AI Agents
  8. 2026SoK: The Attack Surface of Agentic AI - Tools and Autonomy