mlsanityData to 14 Oct 2026

FALCON: Transforming Cyber Threat Intelligence into Deployable IDS Rules with Self-Reflection

arXiv 2508.18684 ↗First posted 26 Aug 2025cs.CR cs.AI cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Signature-based Intrusion Detection Systems (IDS) detect malicious activity by matching network or host events against predefined rules. Security analysts manually develop these rules from Cyber Threat Intelligence (CTI). As threats evolve, this manual pipeline faces two bottlenecks. Before authoring a new rule, an analyst must reconcile the incoming CTI with the existing rule base and determine whether to create, update, or retire one. This process is challenging due to the representational differences between the CTI and Rule formats. This gap limits the effectiveness of keyword- and embedding-based search, making rule reconciliation cognitively demanding and, in turn, contributing to "rule bloat". Second, automated verification of a new rule is inherently difficult as zero-day threats lack ground truth from simulated testing. Hence, standard metrics cannot prove that a rule semantically adheres to the CTI, and the use of LLMs leads to non-deterministic behavior. To address these challenges, we introduce FALCON, an agentic framework for CTI-grounded rule retrieval, generation, and validation. At its core, a novel CTI-Rule semantic scorer, quantifies the functional alignment between a CTI and a rule; the same signal drives a retriever that surfaces relevant deployed rules and a ground-truth-free validator that scores generated ones. Around it, a generation pipeline produces deployable rules from CTI in real time and refines them through self-reflective syntactic, semantic, and performance validators. Across network (Snort) and host-based (YARA) platforms on a purpose-built CTI-Rule dataset, FALCON attains a mean relevance of 0.72 (approx), with 84% inter-rater agreement among cybersecurity analysts, underscoring the promise of real-time security automation.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 16 of its 41 references that are in the map. First posted on arXiv 26 Aug 2025.

Builds on

16 of 41 references.

References · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
  4. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
  5. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 609
  6. 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 418
  7. 2018Understanding disentangling in β-VAEcited by 335
  8. 2024Search-Based LLMs for Code Optimizationcited by 28
  9. 2025Validating LLM-as-a-Judge Systems under Rating Indeterminacycited by 25
  10. 2024LOCALINTEL: Generating Organizational Threat Intelligence from Global and Local Cyber Knowledgecited by 22
  11. 2024LogLLM: Log-based Anomaly Detection Using Large Language Modelscited by 22
  12. 2024LLMCloudHunter: Harnessing LLMs for Automated Extraction of Detection Rules from Cloud-Based CTIcited by 18
4 more
  1. 2020Automatic Yara Rule Generation Using Biclusteringcited by 17
  2. 2024Agentic LLM Workflows for Generating Patient-Friendly Medical Reportscited by 13
  3. 2025Automatically Generating Rules of Malicious Software Packages via Large Language Modelcited by 2
  4. 2025RuleGenie: SIEM Detection Rule Set Optimizationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025GRIDAI: Generating and Repairing Intrusion Detection Rules via Collaboration among Multiple LLM-based Agents
  2. 2025RulePilot: An LLM-Powered Agent for Security Rule Generation
  3. 2026RuleAutoPilot: Synthesizing Deployable Suricata Rules from Network Traffic ↗
  4. 2026ARuleCon: Agentic Security Rule Conversion
  5. 2025CTIConnect: A Benchmark for Retrieval-Augmented LLMs over Heterogeneous Cyber Threat Intelligence
  6. 2025From Retrieval to Reasoning: A Framework for Cyber Threat Intelligence NER with Explicit and Adaptive Instructions
  7. 2026CTIFoundry: An Agent-Native Corpus Scaffold for Cyber Threat Intelligence
  8. 2025CyberRAG: An Agentic RAG cyber attack classification and reporting tool