A Queueing-Theoretic Framework for Dynamic Attack Surfaces: Data-Integrated Risk Analysis and Adaptive Defense
On the map: Deep reinforcement learning methods → Adversarial robustness and RL in finance
Abstract (arXiv)
We develop a queueing-theoretic framework to model the temporal evolution of cyber-attack surfaces, where the number of active vulnerabilities is represented as the backlog of a queue. Vulnerabilities arrive as they are discovered or created, and leave the system when they are patched or successfully exploited. Building on this model, we study how automation affects attack and defense dynamics by introducing an AI amplification factor that scales arrival, exploit, and patching rates. Our analysis shows that even symmetric automation can increase the rate of successful exploits. We validate the model using vulnerability data collected from an open source software supply chain and show that it closely matches real-world attack surface dynamics. Empirical results reveal heavy-tailed patching times, which we prove induce long-range dependence in vulnerability backlog and help explain persistent cyber risk. Utilizing our queueing abstraction for the attack surface, we develop a systematic approach for cyber risk mitigation. We formulate the dynamic defense problem as a constrained Markov decision process with resource-budget and switching-cost constraints, and develop a reinforcement learning (RL) algorithm that achieves provably near-optimal regret. Numerical experiments validate the approach and demonstrate that our adaptive RL-based defense policies significantly reduce successful exploits and mitigate heavy-tail queue events. Using trace-driven experiments on the ARVO dataset, we show that the proposed RL-based defense policy reduces the average number of active vulnerabilities in a software supply chain by over 90% compared to existing defense practices, without increasing the overall maintenance budget. Our results allow defenders to quantify cumulative exposure risk under long-range dependent attack dynamics and to design adaptive defense strategies with provable efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Adversarial robustness and RL in finance, one of 15 directions in Deep reinforcement learning methods. Builds on 10 of its 35 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
10 of 35 references.
References · 10
- 2024LLM Agents can Autonomously Hack Websitescited by 109
- 2024Coercing LLMs to do and reveal (almost) anythingcited by 89
- 2019Provably Efficient Q-Learning with Low Switching Costcited by 78
- 2021Safe Reinforcement Learning with Linear Function Approximationcited by 35
- 2021A Simple Reward-free Approach to Constrained Reinforcement Learningcited by 30
- 2022Towards Deployment-Efficient Reinforcement Learning: Lower Bound and Optimalitycited by 24
- 2024Large Language Models are Advanced Anonymizerscited by 22
- 2023A Near-Optimal Algorithm for Safe Reinforcement Learning Under Instantaneous Hard Constraintscited by 17
- 2024DeepCode AI Fix: Fixing Security Vulnerabilities with Large Language Modelscited by 7
- 2023Near-Optimal Adversarial Reinforcement Learning with Switching Costscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Dynamic Risk Assessments for Offensive Cybersecurity Agents
- 2026Game-Theoretic Modeling of Stealthy Intrusion Defense against MDP-Based Attackers ↗
- 2025Learning-Based Cost-Aware Defense of Parallel Server Systems against Malicious Attacks ↗
- 2025Quantitative Resilience Modeling for Autonomous Cyber Defense
- 2026To Defend Against Cyber Attacks, We Must Teach AI Agents to Hack
- 2025CyGATE: Game-Theoretic Cyber Attack-Defense Engine for Patch Strategy Optimization
- 2024Optimizing Cyber Defense in Dynamic Active Directories through Reinforcement Learning
- 2024Automated Security Response through Online Learning with Adaptive Conjectures