mlsanityData to 7 Oct 2026

From Legacy to Standard: LLM-Assisted Transformation of Cybersecurity Playbooks into CACAO Format

arXiv 2508.03342 ↗First posted 5 Aug 2025cs.CR cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Existing cybersecurity playbooks are often written in heterogeneous, non-machine-readable formats, which limits their automation and interoperability across Security Orchestration, Automation, and Response platforms. This paper explores the suitability of Large Language Models, combined with Prompt Engineering, to automatically translate legacy incident response playbooks into the standardized, machine-readable CACAO format. We systematically examine various Prompt Engineering techniques and carefully design prompts aimed at maximizing syntactic accuracy and semantic fidelity for control flow preservation. Our modular transformation pipeline integrates a syntax checker to ensure syntactic correctness and features an iterative refinement mechanism that progressively reduces syntactic errors. We evaluate the proposed approach on a custom-generated dataset comprising diverse legacy playbooks paired with manually created CACAO references. The results demonstrate that our method significantly improves the accuracy of playbook transformation over baseline models, effectively captures complex workflow structures, and substantially reduces errors. It highlights the potential for practical deployment in automated cybersecurity playbook transformation tasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 33 references that are in the map. First posted on arXiv 5 Aug 2025.

Builds on

15 of 33 references.

References · 15

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  5. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  6. 2023A Comprehensive Overview of Large Language Modelscited by 639
  7. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  8. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 428
  9. 2023Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMscited by 175
  10. 2024Quantifying the Persona Effect in LLM Simulationscited by 164
  11. 2021Template-Based Named Entity Recognition Using BARTcited by 153
  12. 2024Is Temperature the Creativity Parameter of Large Language Models?cited by 92
3 more
  1. 2023Extracting Accurate Materials Data from Research Papers with Conversational Language Models and Prompt Engineeringcited by 86
  2. 2024Process Modeling With Large Language Modelscited by 26
  3. 2022Cybersecurity Playbook Sharing with STIX 2.1cited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.