Automated Post-Incident Policy Gap Analysis via Threat-Informed Evidence Mapping using Large Language Models
Not on the map. Why?
Abstract (arXiv)
Cybersecurity post-incident reviews are essential for identifying control failures and improving organisational resilience, yet they remain labour-intensive, time-consuming, and heavily reliant on expert judgment. This paper investigates whether Large Language Models (LLMs) can augment post-incident review workflows by autonomously analysing system evidence and identifying security policy gaps. We present a threat-informed, agentic framework that ingests log data, maps observed behaviours to the MITRE ATT&CK framework, and evaluates organisational security policies for adequacy and compliance. Using a simulated brute-force attack scenario against a Windows OpenSSH service (MITRE ATT&CK T1110), the system leverages GPT-4o for reasoning, LangGraph for multi-agent workflow orchestration, and LlamaIndex for traceable policy retrieval. Experimental results indicate that the LLM-based pipeline can interpret log-derived evidence, identify insufficient or missing policy controls, and generate actionable remediation recommendations with explicit evidence-to-policy traceability. Unlike prior work that treats log analysis and policy validation as isolated tasks, this study integrates both into a unified end-to-end proof-of-concept post-incident review framework. The findings suggest that LLM-assisted analysis has the potential to improve the efficiency, consistency, and auditability of post-incident evaluations, while highlighting the continued need for human oversight in high-stakes cybersecurity decision-making.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 8 of its 24 references that are in the map. First posted on arXiv 4 Jan 2026.
Builds on
8 of 24 references.
References · 8
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
- 2022Towards Reasoning in Large Language Models: A Surveycited by 595
- 2024LLM Agents can Autonomously Hack Websitescited by 108
- 2024When LLMs Meet Cybersecurity: A Systematic Literature Reviewcited by 71
- 2023TPTU: Large Language Model-based AI Agents for Task Planning and Tool Usagecited by 55
- 2024Crimson: Empowering Strategic Reasoning in Cybersecurity through Large Language Modelscited by 8
- 2024GenDFIR: Advancing Cyber Incident Timeline Analysis Through Retrieval Augmented Generation and Large Language Modelscited by 7
- 2025Automating Security Audit Using Large Language Model based Agent: An Exploration Experimentcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026DiagChain: A Diagnostic Benchmark for Evaluating LLM Agents on Evidence-Grounded Attack Chain Reconstruction
- 2026STAIR: Effective Incident Response Using an End-to-End Agentic Planning Framework
- 2026In-Context Autonomous Network Incident Response: An End-to-End Large Language Model Agent Approach
- 2026CyberClear: A Benchmark for LLM Agent Systems on APT Attack Chain Provenance
- 2026Policy-Invisible Violations in LLM-Based Agents
- 2026SecRespond: Benchmarking AI Agents for Real-World Post-Compromise Incident Response
- 2026A Graph-Based Approach for Mapping Kernel-Level Telemetry to MITRE ATT&CK
- 2025On Automating Security Policies with Contemporary LLMs