Cybersecurity AI: The Dangerous Gap Between Automation and Autonomy
Not on the map. Why?
Abstract (arXiv)
The cybersecurity industry combines "automated" and "autonomous" AI, creating dangerous misconceptions about system capabilities. Recent milestones like XBOW topping HackerOne's leaderboard showcase impressive progress, yet these systems remain fundamentally semi-autonomous--requiring human oversight. Drawing from robotics principles, where the distinction between automation and autonomy is well-established, I take inspiration from prior work and establish a 6-level taxonomy (Level 0-5) distinguishing automation from autonomy in Cybersecurity AI. Current "autonomous" pentesters operate at Level 3-4: they execute complex attack sequences but need human review for edge cases and strategic decisions. True Level 5 autonomy remains aspirational. Organizations deploying mischaracterized "autonomous" tools risk reducing oversight precisely when it's most needed, potentially creating new vulnerabilities. The path forward requires precise terminology, transparent capabilities disclosure, and human-AI partnership-not replacement.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Jun 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2026The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systemscited by 30
- 2026Calibrated Decision Models for Autonomous Penetration-Testing Harnesses: JEV and Laya as System One Decision Layers for LLM-Driven Pentest Agentscited by 4
- 2025Cybersecurity AI: Hacking the AI Hackers via Prompt Injectioncited by 2
- 2025Cybersecurity AI: Evaluating Agentic Cybersecurity in Attack/Defense CTFscited by 1
- 2026Calibrated Decision Models for Autonomous Penetration-Testing Harnesses: JEV and Laya as System One Decision Layers for LLM-Driven Pentest Agents24 Sep 2026
- 2026The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systems19 Feb 2026
- 2025Cybersecurity AI: Evaluating Agentic Cybersecurity in Attack/Defense CTFs20 Oct 2025
- 2025Cybersecurity AI: Hacking the AI Hackers via Prompt Injection29 Aug 2025