SecureCAI: Injection-Resilient LLM Assistants for Cybersecurity Operations
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
Large Language Models have emerged as transformative tools for Security Operations Centers, enabling automated log analysis, phishing triage, and malware explanation; however, deployment in adversarial cybersecurity environments exposes critical vulnerabilities to prompt injection attacks where malicious instructions embedded in security artifacts manipulate model behavior. This paper introduces SecureCAI, a novel defense framework extending Constitutional AI principles with security-aware guardrails, adaptive constitution evolution, and Direct Preference Optimization for unlearning unsafe response patterns, addressing the unique challenges of high-stakes security contexts where traditional safety mechanisms prove insufficient against sophisticated adversarial manipulation. Experimental evaluation demonstrates that SecureCAI reduces attack success rates by 94.7% compared to baseline models while maintaining 95.1% accuracy on benign security analysis tasks, with the framework incorporating continuous red-teaming feedback loops enabling dynamic adaptation to emerging attack strategies and achieving constitution adherence scores exceeding 0.92 under sustained adversarial pressure, thereby establishing a foundation for trustworthy integration of language model capabilities into operational cybersecurity workflows and addressing a critical gap in current approaches to AI safety within adversarial domains.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 11 of its 31 references that are in the map. First posted on arXiv 12 Jan 2026.
Builds on
11 of 31 references.
Closest ancestors · 4
Same direction, newest first
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions19 Apr
- 2023Prompt Injection attack against LLM-integrated Applications8 Jun
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection23 Feb
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned23 Aug
Other references · 7
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 651
- 2022BadPrompt: Backdoor Attacks on Continuous Promptscited by 63
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026AI Native Asset Intelligencecited by 2
- 2026AI Native Asset Intelligence9 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Adversarial Attack-Defense Co-Evolution for LLM Safety Alignment via Tree-Group Dual-Aware Search and Optimization
- 2026Evaluation of Prompt Injection Defenses in Large Language Models
- 2024Generative AI in Cybersecurity: A Comprehensive Review of LLM Applications and Vulnerabilities
- 2026When Prompt Optimization Becomes Jailbreaking: Adaptive Red-Teaming of Large Language Models
- 2025OCCULT: Evaluating Large Language Models for Offensive Cyber Operation Capabilities
- 2025A Self-Improving Architecture for Dynamic Safety in Large Language Models
- 2026SafeHarbor: Defining Precise Decision Boundaries via Hierarchical Memory-Augmented Guardrail for LLM Agent Safety
- 2026Architecting Secure AI Agents: Perspectives on System-Level Defenses Against Indirect Prompt Injection Attacks