Discovering Exfiltration Paths Using Reinforcement Learning with Attack Graphs
Not on the map. Why?
Abstract (arXiv)
Reinforcement learning (RL), in conjunction with attack graphs and cyber terrain, are used to develop reward and state associated with determination of optimal paths for exfiltration of data in enterprise networks. This work builds on previous crown jewels (CJ) identification that focused on the target goal of computing optimal paths that adversaries may traverse toward compromising CJs or hosts within their proximity. This work inverts the previous CJ approach based on the assumption that data has been stolen and now must be quietly exfiltrated from the network. RL is utilized to support the development of a reward function based on the identification of those paths where adversaries desire reduced detection. Results demonstrate promising performance for a sizable network environment.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 7 of its 39 references that are in the map. First posted on arXiv 28 Jan 2022.
Builds on
7 of 39 references.
References · 7
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2019Deep Reinforcement Learning for Cyber Securitycited by 92
- 2018On Improving Deep Reinforcement Learning for POMDPscited by 49
- 2019Autonomous Penetration Testing using Reinforcement Learningcited by 33
- 2021Using Cyber Terrain in Reinforcement Learning for Penetration Testingcited by 16
- 2021Crown Jewels Analysis using Reinforcement Learning with Attack Graphscited by 8
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 4; 2025: 1.
8 papers.
- 2024SoK: On the Offensive Potential of AIcited by 5
- 2022Exposing Surveillance Detection Routes via Reinforcement Learning, Attack Graphs, and Cyber Terraincited by 3
- 2024Discovering Command and Control Channels Using Reinforcement Learningcited by 3
- 2023Tackling Cyberattacks through AI-based Reactive Systems: A Holistic Review and Future Visioncited by 1
- 2024Leveraging Reinforcement Learning in Red Teaming for Advanced Ransomware Attack Simulationscited by 1
- 2022Tutorial on Course-of-Action (COA) Attack Search Methods in Computer Networkscited by 0
- 2024Discovering Command and Control (C2) Channels on Tor and Public Networks Using Reinforcement Learningcited by 0
- 2025From Capabilities to Performance: Evaluating Key Functional Properties of LLM Architectures in Penetration Testingcited by 0
- 2025From Capabilities to Performance: Evaluating Key Functional Properties of LLM Architectures in Penetration Testing16 Sep 2025
- 2024SoK: On the Offensive Potential of AI24 Dec 2024
- 2024Leveraging Reinforcement Learning in Red Teaming for Advanced Ransomware Attack Simulations25 Jun 2024
- 2024Discovering Command and Control (C2) Channels on Tor and Public Networks Using Reinforcement Learning14 Feb 2024
- 2024Discovering Command and Control Channels Using Reinforcement Learning13 Jan 2024
- 2023Tackling Cyberattacks through AI-based Reactive Systems: A Holistic Review and Future Vision11 Dec 2023
- 2022Exposing Surveillance Detection Routes via Reinforcement Learning, Attack Graphs, and Cyber Terrain6 Nov 2022
- 2022Tutorial on Course-of-Action (COA) Attack Search Methods in Computer Networks27 May 2022