Recognition Without Mitigation: Ethical Frameworks in Autonomous Offensive-LLM Agent Research
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Large language models have moved from advising on offensive security to autonomously conducting it. A growing literature presents agents that execute reconnaissance, exploitation, and privilege escalation against real or simulated targets. Such an agent is a deployable, re-pointable capability that could be used by a malicious actor against a non-consenting third party. Papers that introduce these prototypes therefore carry an ethical burden, which top security venues have begun to encode as hard policy in their 2026 ethics mandates. We present a systematic audit of ethics reporting based on 54 papers describing autonomous offensive-LLM penetration-testing prototypes (2023-2026), assembled from peer-reviewed venues as well as from pre-prints. We score each against an eleven-dimension instrument derived both top-down from the Menlo Report, and bottom-up from 2026 security venue ethics mandates. Our central result is a recognition-without-mitigation gap: dual-use risk is reported as recognized in 57% of papers, but a concrete mitigation is reported in only 15%, roughly a 4:1 gap. Safeguards commonly protect the experiment, not the public. Guardrail bypasses are deployed by 17% of papers but not disclosed to LLM providers. Measured against the new mandates, the corpus defines a pre-regulation baseline in which current practice does not meet the substantive requirements. We argue this audit is itself defensive intelligence on the offensive-agent ecosystem, and provide an ethics statement checklist for authors working on autonomous offensive agents.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 15 of its 71 references that are in the map. First posted on arXiv 10 Jun 2025.
Builds on
15 of 71 references.
Closest ancestors · 6
Same direction, newest first
- 2025RedTeamLLM: an Agentic AI framework for offensive security11 May
- 2025RapidPen: Fully Automated IP-to-Shell Penetration Testing with LLM-based Agents23 Feb
- 2025VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative Framework23 Jan
- 2024BreachSeek: A Multi-Agent Automated Penetration Tester31 Aug
- 2024Teams of LLM Agents can Exploit Zero-Day Vulnerabilities2 Jun
- 2024LLM Agents can Autonomously Exploit One-day Vulnerabilities11 Apr
Other references · 9
- 2024AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attackscited by 96
- 2023Getting pwn'd by AI: Penetration Testing with Large Language Modelscited by 83
- 2022Structured access: an emerging paradigm for safe AI deploymentcited by 41
- 2023LLMs as Hackers: Autonomous Linux Privilege Escalation Attackscited by 27
- 2021Unpacking the Expressed Consequences of AI Research in Broader Impact Statementscited by 22
- 2021AI Ethics Statements -- Analysis and lessons learnt from NeurIPS Broader Impact Statementscited by 16
- 2025Can LLMs Hack Enterprise Networks? Autonomous Assumed Breach Penetration-Testing Active Directory Networkscited by 12
- 2024Hacking, The Lazy Way: LLM Augmented Pentestingcited by 5
- 2025RefPentester: A Knowledge-Informed Self-Reflective Penetration Testing Framework Based on Large Language Modelscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026The Ethics of Autonomous AI Agents for Offensive Security
- 2026Toward Secure AI-Powered Penetration Testing Agents: Security Threats, Guardrails, and Architectural Perspectives
- 2026From Capability to Assurance in Autonomous Penetration-Testing Harnesses: A Framework and Reference Implementation
- 2026ClawSentry: A Progressive Multi-Tier Security Monitor for Safeguarding Autonomous LLM Agents
- 2026Autonomous LLM Agents & CTFs: A Second Look
- 2026LLM agents security duality: a comprehensive survey of self-security and empowered cybersecurity
- 2026The Model Proposes, the Code Disposes: A Pre-Registered Ablation of a Verifier-and-Acceptance Stage in an LLM-Orchestrated Offensive-Security Agent
- 2025AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection