mlsanityData to 14 Oct 2026

LLMs in the SOC: An Empirical Study of Human-AI Collaboration in Security Operations Centres

arXiv 2508.18947 ↗First posted 26 Aug 2025cs.CRcited by 14

Not on the map. Why?

Abstract (arXiv)

The integration of Large Language Models (LLMs) into Security Operations Centres (SOCs) presents a transformative, yet still evolving, opportunity to reduce analyst workload through human-AI collaboration. However, their real-world application in SOCs remains underexplored. To address this gap, we present a longitudinal study of 3,090 analyst queries from 45 SOC analysts over 10 months. Our analysis reveals that analysts use LLMs as on-demand aids for sensemaking and context-building, rather than for making high-stakes determinations, preserving analyst decision authority. The majority of queries are related to interpreting low-level telemetry (e.g., commands) and refining technical communication through short (1-3 turn) interactions. Notably, 93% of queries align with established cybersecurity competencies (NICE Framework), underscoring the relevance of LLM use for SOC-related tasks. Despite variations in tasks and engagement, usage trends indicate a shift from occasional exploration to routine integration, with growing adoption and sustained use among a subset of analysts. We find that LLMs function as flexible, on-demand cognitive aids that augment, rather than replace, SOC expertise. Our study provides actionable guidance for designing context-aware, human-centred AI assistance in security operations, highlighting the need for further in-the-wild research on real-world analyst-LLM collaboration, challenges, and impacts.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Aug 2025.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 13.

14 papers.

Sort:

By area:

  1. 2025A Survey on Agentic Security: Applications, Threats and Defensescited by 20
  2. 2026Retrieval-Augmented LLMs for Security Incident Analysiscited by 4
  3. 2026CAM-LDS: Cyber Attack Manifestations for Automatic Interpretation of System Logs and Security Alertscited by 2
  4. 2026Like a Hammer, It Can Build, It Can Break: Large Language Model Uses, Perceptions, and Adoption in Cybersecurity Operations on Redditcited by 1
  5. 2026Decomposing Memorization Reduction in Privacy-Preserving Fine-Tuning of SLMs for CSIRTscited by 1
  6. 2026Cyber-Capable AI Agents: Vulnerabilities, Evaluation Containment, and Defensive Responsecited by 1
  7. 2026Just Testing, Move Along: Evasion of LLM-based System Log Interpretation by Prompt Injectioncited by 0
  8. 2026From Chasing Ghosts to Missed Attacks: Perspectives and Perceptions of SOC Practitioners on LLM Integration, Risks, and Readinesscited by 0
  9. 2026A Human-LLM Teaming Framework for Privacy Risk Analysis: An Illustration with CBDC-Based Welfare Schemescited by 0
  10. 2026From Noise to Signal: Improving Security Log Anomaly Detection Using LLMs with Endpoint-Specific Logscited by 0
  11. 2026It is Not Yet Another Tool: Creating and Deploying an Agentic AI Companion in a Security Operations Centercited by 0
  12. 2026The MAL Simulator: Cyber Operations Simulation based on Attack & Defense Graphscited by 0
2 more
  1. 2026REFINE: A Resilient Evolution Framework for Intelligent Enterprise Alert Triage in Security Operations Centerscited by 0
  2. 2026From Investigation Failures to Reliable SOC Agents: Understanding and Improving LLM-Based Alert Triagecited by 0