CTINexus: Automatic Cyber Threat Intelligence Knowledge Graph Construction Using Large Language Models
Not on the map. Why?
Abstract (arXiv)
Textual descriptions in cyber threat intelligence (CTI) reports, such as security articles and news, are rich sources of knowledge about cyber threats, crucial for organizations to stay informed about the rapidly evolving threat landscape. However, current CTI knowledge extraction methods lack flexibility and generalizability, often resulting in inaccurate and incomplete knowledge extraction. Syntax parsing relies on fixed rules and dictionaries, while model fine-tuning requires large annotated datasets, making both paradigms challenging to adapt to new threats and ontologies. To bridge the gap, we propose CTINexus, a novel framework leveraging optimized in-context learning (ICL) of large language models (LLMs) for data-efficient CTI knowledge extraction and high-quality cybersecurity knowledge graph (CSKG) construction. Unlike existing methods, CTINexus requires neither extensive data nor parameter tuning and can adapt to various ontologies with minimal annotated examples. This is achieved through: (1) a carefully designed automatic prompt construction strategy with optimal demonstration retrieval for extracting a wide range of cybersecurity entities and relations; (2) a hierarchical entity alignment technique that canonicalizes the extracted knowledge and removes redundancy; (3) an long-distance relation prediction technique to further complete the CSKG with missing links. Our extensive evaluations using 150 real-world CTI reports collected from 10 platforms demonstrate that CTINexus significantly outperforms existing methods in constructing accurate and complete CSKG, highlighting its potential to transform CTI analysis with an efficient and adaptable solution for the dynamic threat landscape.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 39 of its 95 references that are in the map. First posted on arXiv 28 Oct 2024.
Builds on
39 of 95 references.
References · 39
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2022A Survey on In-context Learningcited by 717
- 2020Graph Structure Learning for Robust Graph Neural Networkscited by 368
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 283
- 2023MathPrompter: Mathematical Reasoning using Large Language Modelscited by 236
- 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
- 2019Simple BERT Models for Relation Extraction and Semantic Role Labelingcited by 154
- 2023Simulating Opinion Dynamics with Networks of LLM-based Agentscited by 153
27 more
- 2020Deep Learning Based Text Classification: A Comprehensive Reviewcited by 140
- 2024LLM Agents can Autonomously Exploit One-day Vulnerabilitiescited by 125
- 2022Large Language Models are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Modelscited by 102
- 2023PentestGPT: An LLM-empowered Automatic Penetration Testing Toolcited by 94
- 2023Fuzz4All: Universal Fuzzing with Large Language Modelscited by 88
- 2023In-Context Learning with Iterative Demonstration Selectioncited by 74
- 2021A Survey on Graph Structure Learning: Progress and Opportunitiescited by 70
- 2024In-context Learning with Retrieved Demonstrations for Language Models: A Surveycited by 69
- 2020Domain-specific Knowledge Graphs: A surveycited by 68
- 2022SecureBERT: A Domain-Specific Language Model for Cybersecuritycited by 60
- 2023Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repaircited by 55
- 2021AttacKG: Constructing Technique Knowledge Graph from Cyber Threat Intelligence Reportscited by 31
- 2024KnowPhish: Large Language Models Meet Multimodal Knowledge Graphs for Enhancing Reference-Based Phishing Detectioncited by 29
- 2019POIROT: Aligning Attack Behavior with Kernel Audit Records for Cyber Threat Huntingcited by 27
- 2022Looking Beyond IoCs: Automatically Extracting Attack Patterns from External CTIcited by 27
- 2024A Case Study of LLM for Automated Vulnerability Repair: Assessing Impact of Reasoning and Patch Validation Feedbackcited by 22
- 2021EXTRACTOR: Extracting Attack Behavior from Threat Reportscited by 19
- 2023Time for aCTIon: Automated Analysis of Cyber Threat Intelligence in the Wildcited by 15
- 2021What are the attackers doing now? Automating cyber threat intelligence extraction from text on pace with the changing threat landscape: A surveycited by 14
- 2020Enabling Efficient Cyber Threat Hunting With Cyber Threat Intelligencecited by 12
- 2022ThreatKG: An AI-Powered System for Automated Open-Source Cyber Threat Intelligence Gathering and Managementcited by 9
- 2020MALOnt: An Ontology for Malware Threat Intelligencecited by 8
- 2018SAQL: A Stream-based Query System for Real-Time Abnormal System Behavior Detectioncited by 6
- 2018AIQL: Enabling Efficient Attack Investigation from System Monitoring Datacited by 5
- 2023Hue: A User-Adaptive Parser for Hybrid Logscited by 3
- 2023Shedding Light on CVSS Scoring Inconsistencies: A User-Centric Study on Evaluating Widespread Security Vulnerabilitiescited by 2
- 2024P4Control: Line-Rate Cross-Host Attack Prevention via In-Network Information Flow Control Enabled by Programmable Switches and eBPFcited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 9.
12 papers.
- 2025CyberSleuth: Autonomous Blue-Team LLM Agent for Web Attack Forensicscited by 3
- 2026Beyond RAG for Cyber Threat Intelligence: A Systematic Evaluation of Graph-Based and Agentic Retrievalcited by 3
- 2025Neuro-Symbolic AI for Cybersecurity: State of the Art, Challenges, and Opportunitiescited by 2
- 2026GRID: Graph Representation of Intelligence Data for Security Text Knowledge Graph Constructioncited by 1
- 2026TACTIC-KG: Toward Small Agent Teams for Cyber Threat Intelligence Knowledge Graph Constructioncited by 1
- 2025From Retrieval to Reasoning: A Framework for Cyber Threat Intelligence NER with Explicit and Adaptive Instructionscited by 0
- 2026An End-to-End Framework for Functionality-Embedded Provenance Graph Construction and Threat Interpretationcited by 0
- 2026PocketAgents: A Manifest-Driven Library of Autonomous Defense Agentscited by 0
- 2026CTIFoundry: An Agent-Native Corpus Scaffold for Cyber Threat Intelligencecited by 0
- 2026Ranked by the Matcher: A Reproducibility Audit of Knowledge Graph Extraction from Threat Reportscited by 0
- 2026SCRIPTIOC-BENCH: A Benchmark for Recognizing Actionable Threat Intelligence from Script-Based Malware using LLMscited by 0
- 2026Evidence-Grounded Retrieval for Investigation Hunt Lead Generation from CTI Reportscited by 0
- 2026Evidence-Grounded Retrieval for Investigation Hunt Lead Generation from CTI Reports8 Sep 2026
- 2026SCRIPTIOC-BENCH: A Benchmark for Recognizing Actionable Threat Intelligence from Script-Based Malware using LLMs5 Sep 2026
- 2026Ranked by the Matcher: A Reproducibility Audit of Knowledge Graph Extraction from Threat Reports1 Sep 2026
- 2026CTIFoundry: An Agent-Native Corpus Scaffold for Cyber Threat Intelligence19 Aug 2026
- 2026TACTIC-KG: Toward Small Agent Teams for Cyber Threat Intelligence Knowledge Graph Construction6 Jul 2026
- 2026PocketAgents: A Manifest-Driven Library of Autonomous Defense Agents20 May 2026
- 2026GRID: Graph Representation of Intelligence Data for Security Text Knowledge Graph Construction15 May 2026
- 2026Beyond RAG for Cyber Threat Intelligence: A Systematic Evaluation of Graph-Based and Agentic Retrieval13 Apr 2026
- 2026An End-to-End Framework for Functionality-Embedded Provenance Graph Construction and Threat Interpretation17 Mar 2026
- 2025From Retrieval to Reasoning: A Framework for Cyber Threat Intelligence NER with Explicit and Adaptive Instructions22 Dec 2025
- 2025Neuro-Symbolic AI for Cybersecurity: State of the Art, Challenges, and Opportunities8 Sep 2025
- 2025CyberSleuth: Autonomous Blue-Team LLM Agent for Web Attack Forensics28 Aug 2025