mlsanityData to 7 Oct 2026

From Chasing Ghosts to Missed Attacks: Perspectives and Perceptions of SOC Practitioners on LLM Integration, Risks, and Readiness

arXiv 2608.00672 ↗First posted 1 Aug 2026cs.CR cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Security Operations Centers (SOCs) process large volumes of security events, requiring analysts to accurately detect and assess ongoing cyberattacks under time pressure. Recent advances in Large Language Models (LLMs) suggest potential benefits for security operations, yet their practical suitability for real-world SOC workflows remains poorly understood. To address this gap, we conducted 25 semi-structured interviews with SOC practitioners who had prior experience with LLMs, complemented by interactive scenarios to anticipate challenges and identify opportunities for the responsible integration of LLM-based tools into SOC workflows. We identified 15 LLM use cases grouped into six functional categories. While LLMs are valued for automating repetitive, low-level tasks such as report automation, practitioners rate high-impact tasks such as incident analysis as not yet feasible, reporting limitations in technical depth, context awareness, and organization-specific knowledge. They locate these limitations less in the models than in the readiness of their SOCs and human factors driving over-reliance. Despite concerns, practitioners express a strong willingness to adopt LLMs, describing competitive pressure that leaves few alternatives. This work contributes an empirical, practitioner-driven analysis of LLM use across SOC roles and organizations and derives concrete design and integration requirements for human-centered, operationally safe LLM-assisted security operations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 79 references that are in the map. First posted on arXiv 1 Aug 2026.

Builds on

15 of 79 references.

References · 15

  1. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  2. 2024Cognitive Bias in Decision-Making with LLMscited by 104
  3. 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 65
  4. 2024Get my drift? Catching LLM Task Drift with Activation Deltascited by 61
  5. 2023Revolutionizing Cyber Threat Detection with Large Language Models: A privacy-preserving BERT-based Lightweight Model for IoT/IIoT Devicescited by 38
  6. 2025LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarkscited by 34
  7. 2024A Comprehensive Overview of Large Language Models (LLMs) for Cyber Defences: Opportunities and Directionscited by 33
  8. 2024Using AI Assistants in Software Development: A Qualitative Study on Security Practices and Concernscited by 27
  9. 2024Generative AI in Cybersecurity: A Comprehensive Review of LLM Applications and Vulnerabilitiescited by 20
  10. 2025LLMs in the SOC: An Empirical Study of Human-AI Collaboration in Security Operations Centrescited by 13
  11. 2024Using LLMs to Automate Threat Intelligence Analysis Workflows in Security Operation Centerscited by 10
  12. 2024AI-Driven Guided Response for Security Operation Centers with Microsoft Copilot for Securitycited by 7
3 more
  1. 2020An Assessment of the Usability of Machine Learning Based Tools for the Security Operations Centercited by 5
  2. 2025Large Language Models Are Unreliable for Cyber Threat Intelligencecited by 5
  3. 2024Towards Characterizing Cyber Networks with Large Language Modelscited by 1

Built on by

Not cited yet.