LLMs in the SOC: An Empirical Study of Human-AI Collaboration in Security Operations Centres
Not on the map. Why?
Abstract (arXiv)
The integration of Large Language Models (LLMs) into Security Operations Centres (SOCs) presents a transformative, yet still evolving, opportunity to reduce analyst workload through human-AI collaboration. However, their real-world application in SOCs remains underexplored. To address this gap, we present a longitudinal study of 3,090 analyst queries from 45 SOC analysts over 10 months. Our analysis reveals that analysts use LLMs as on-demand aids for sensemaking and context-building, rather than for making high-stakes determinations, preserving analyst decision authority. The majority of queries are related to interpreting low-level telemetry (e.g., commands) and refining technical communication through short (1-3 turn) interactions. Notably, 93% of queries align with established cybersecurity competencies (NICE Framework), underscoring the relevance of LLM use for SOC-related tasks. Despite variations in tasks and engagement, usage trends indicate a shift from occasional exploration to routine integration, with growing adoption and sustained use among a subset of analysts. We find that LLMs function as flexible, on-demand cognitive aids that augment, rather than replace, SOC expertise. Our study provides actionable guidance for designing context-aware, human-centred AI assistance in security operations, highlighting the need for further in-the-wild research on real-world analyst-LLM collaboration, challenges, and impacts.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Aug 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 1; 2026: 13.
14 papers.
Sort:
By area:
- 2025A Survey on Agentic Security: Applications, Threats and Defensescited by 20
- 2026Retrieval-Augmented LLMs for Security Incident Analysiscited by 4
- 2026CAM-LDS: Cyber Attack Manifestations for Automatic Interpretation of System Logs and Security Alertscited by 2
- 2026Like a Hammer, It Can Build, It Can Break: Large Language Model Uses, Perceptions, and Adoption in Cybersecurity Operations on Redditcited by 1
- 2026Decomposing Memorization Reduction in Privacy-Preserving Fine-Tuning of SLMs for CSIRTscited by 1
- 2026Cyber-Capable AI Agents: Vulnerabilities, Evaluation Containment, and Defensive Responsecited by 1
- 2026Just Testing, Move Along: Evasion of LLM-based System Log Interpretation by Prompt Injectioncited by 0
- 2026From Chasing Ghosts to Missed Attacks: Perspectives and Perceptions of SOC Practitioners on LLM Integration, Risks, and Readinesscited by 0
- 2026A Human-LLM Teaming Framework for Privacy Risk Analysis: An Illustration with CBDC-Based Welfare Schemescited by 0
- 2026From Noise to Signal: Improving Security Log Anomaly Detection Using LLMs with Endpoint-Specific Logscited by 0
- 2026It is Not Yet Another Tool: Creating and Deploying an Agentic AI Companion in a Security Operations Centercited by 0
- 2026The MAL Simulator: Cyber Operations Simulation based on Attack & Defense Graphscited by 0
- 2026From Investigation Failures to Reliable SOC Agents: Understanding and Improving LLM-Based Alert Triage7 Oct 2026
- 2026REFINE: A Resilient Evolution Framework for Intelligent Enterprise Alert Triage in Security Operations Centers26 Sep 2026
- 2026The MAL Simulator: Cyber Operations Simulation based on Attack & Defense Graphs15 Sep 2026
- 2026It is Not Yet Another Tool: Creating and Deploying an Agentic AI Companion in a Security Operations Center5 Sep 2026
- 2026From Noise to Signal: Improving Security Log Anomaly Detection Using LLMs with Endpoint-Specific Logs20 Aug 2026
- 2026A Human-LLM Teaming Framework for Privacy Risk Analysis: An Illustration with CBDC-Based Welfare Schemes17 Aug 2026
- 2026From Chasing Ghosts to Missed Attacks: Perspectives and Perceptions of SOC Practitioners on LLM Integration, Risks, and Readiness1 Aug 2026
- 2026Cyber-Capable AI Agents: Vulnerabilities, Evaluation Containment, and Defensive Response28 Jul 2026
- 2026Just Testing, Move Along: Evasion of LLM-based System Log Interpretation by Prompt Injection27 Jul 2026
- 2026Decomposing Memorization Reduction in Privacy-Preserving Fine-Tuning of SLMs for CSIRTs26 Jun 2026
- 2026Like a Hammer, It Can Build, It Can Break: Large Language Model Uses, Perceptions, and Adoption in Cybersecurity Operations on Reddit11 Apr 2026
- 2026Retrieval-Augmented LLMs for Security Incident Analysis18 Mar 2026
- 2025A Survey on Agentic Security: Applications, Threats and Defensescited by 20
- 2026Cyber-Capable AI Agents: Vulnerabilities, Evaluation Containment, and Defensive Responsecited by 1
- 2026It is Not Yet Another Tool: Creating and Deploying an Agentic AI Companion in a Security Operations Centercited by 0
- 2026From Investigation Failures to Reliable SOC Agents: Understanding and Improving LLM-Based Alert Triagecited by 0
- 2026From Investigation Failures to Reliable SOC Agents: Understanding and Improving LLM-Based Alert Triage7 Oct 2026
- 2026It is Not Yet Another Tool: Creating and Deploying an Agentic AI Companion in a Security Operations Center5 Sep 2026
- 2026Cyber-Capable AI Agents: Vulnerabilities, Evaluation Containment, and Defensive Response28 Jul 2026
- 2025A Survey on Agentic Security: Applications, Threats and Defenses7 Oct 2025
- 2026Retrieval-Augmented LLMs for Security Incident Analysiscited by 4
- 2026Retrieval-Augmented LLMs for Security Incident Analysis18 Mar 2026
- 2026CAM-LDS: Cyber Attack Manifestations for Automatic Interpretation of System Logs and Security Alertscited by 2
- 2026Like a Hammer, It Can Build, It Can Break: Large Language Model Uses, Perceptions, and Adoption in Cybersecurity Operations on Redditcited by 1
- 2026Decomposing Memorization Reduction in Privacy-Preserving Fine-Tuning of SLMs for CSIRTscited by 1
- 2026From Chasing Ghosts to Missed Attacks: Perspectives and Perceptions of SOC Practitioners on LLM Integration, Risks, and Readinesscited by 0
- 2026A Human-LLM Teaming Framework for Privacy Risk Analysis: An Illustration with CBDC-Based Welfare Schemescited by 0
- 2026From Noise to Signal: Improving Security Log Anomaly Detection Using LLMs with Endpoint-Specific Logscited by 0
- 2026The MAL Simulator: Cyber Operations Simulation based on Attack & Defense Graphscited by 0
- 2026REFINE: A Resilient Evolution Framework for Intelligent Enterprise Alert Triage in Security Operations Centerscited by 0
- 2026REFINE: A Resilient Evolution Framework for Intelligent Enterprise Alert Triage in Security Operations Centers26 Sep 2026
- 2026The MAL Simulator: Cyber Operations Simulation based on Attack & Defense Graphs15 Sep 2026
- 2026From Noise to Signal: Improving Security Log Anomaly Detection Using LLMs with Endpoint-Specific Logs20 Aug 2026
- 2026A Human-LLM Teaming Framework for Privacy Risk Analysis: An Illustration with CBDC-Based Welfare Schemes17 Aug 2026
- 2026From Chasing Ghosts to Missed Attacks: Perspectives and Perceptions of SOC Practitioners on LLM Integration, Risks, and Readiness1 Aug 2026
- 2026Decomposing Memorization Reduction in Privacy-Preserving Fine-Tuning of SLMs for CSIRTs26 Jun 2026
- 2026Like a Hammer, It Can Build, It Can Break: Large Language Model Uses, Perceptions, and Adoption in Cybersecurity Operations on Reddit11 Apr 2026
- 2026CAM-LDS: Cyber Attack Manifestations for Automatic Interpretation of System Logs and Security Alerts4 Mar 2026