DeepFaith: Evidence-Grounded LLMs for Faithful Incident Reporting in Multi-Stage APT Defense
Not on the map. Why?
Abstract (arXiv)
Advanced Persistent Threats (APTs) are difficult to detect and interpret due to their multi-stage and stealthy nature. While recent autonomous defense systems leverage provenance graphs and learning-based models for detection and mitigation, their outputs remain largely machine-oriented and difficult for analysts to interpret. Large language models (LLMs) offer a promising interface for report generation, but often produce hallucinated or weakly grounded content. In this paper, we propose DeepFaith, an evidence-grounded framework for faithful incident reporting in multi-stage APT defense. DeepFaith transforms structured outputs from autonomous defense and explainability modules into natural-language reports that are explicitly aligned with underlying system evidence. The framework integrates a unified evidence representation, evidence-grounded prompting, faithfulness-aware generation, and post-generation verification to ensure that all generated statements are supported. Experiments in a realistic enterprise testbed demonstrate that DeepFaith improves faithfulness from 0.68 to 0.92, reduces unsupported claims from 0.32 to 0.08, and increases temporal consistency from 0.6 to 0.88, while maintaining concise reports and lower error rates than existing template-based and LLM-based solutions. These results show that evidence-grounded generation enables reliable, interpretable, and actionable reporting for security operations centers.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 31 references that are in the map. First posted on arXiv 27 Jul 2026.
Builds on
16 of 31 references.
References · 16
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 737
- 2023The Falcon Series of Open Language Modelscited by 535
- 2022A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainabilitycited by 118
- 2019Deep Reinforcement Learning for Cyber Securitycited by 95
- 2024Entity-based Reinforcement Learning for Autonomous Cyber Defencecited by 11
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
4 more
- 2025A Survey on Retrieval And Structuring Augmented Generation with Large Language Modelscited by 8
- 2026Learning the APT Kill Chain: Temporal Reasoning over Provenance Data for Attack Stage Estimationcited by 3
- 2026DeepStage: Learning Autonomous Defense Policies Against Multi-Stage APT Campaignscited by 3
- 2026DeepXplain: XAI-Guided Autonomous Defense Against Multi-Stage APT Campaignscited by 1
Built on by
Not cited yet.