GenAI Security: Outsmarting the Bots with a Proactive Testing Framework
Not on the map. Why?
Abstract (arXiv)
The increasing sophistication and integration of Generative AI (GenAI) models into diverse applications introduce new security challenges that traditional methods struggle to address. This research explores the critical need for proactive security measures to mitigate the risks associated with malicious exploitation of GenAI systems. We present a framework encompassing key approaches, tools, and strategies designed to outmaneuver even advanced adversarial attacks, emphasizing the importance of securing GenAI innovation against potential liabilities. We also empirically prove the effectiveness of the said framework by testing it against the SPML Chatbot Prompt Injection Dataset. This work highlights the shift from reactive to proactive security practices essential for the safe and responsible deployment of GenAI technologies
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 6 references that are in the map. First posted on arXiv 14 May 2025.
Builds on
5 of 6 references.
References · 5
- 2023SneakyPrompt: Jailbreaking Text-to-image Generative Modelscited by 189
- 2023Abusing Images and Sounds for Indirect Instruction Injection in Multi-Modal LLMscited by 124
- 2024Red-Teaming for Generative AI: Silver Bullet or Security Theater?cited by 83
- 2023SurrogatePrompt: Bypassing the Safety Filter of Text-to-Image Models via Substitutioncited by 34
- 2024SPML: A DSL for Defending Language Models Against Prompt Attackscited by 34
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Identifying and Mitigating the Security Risks of Generative AI
- 2024Review of Generative AI Methods in Cybersecurity
- 2024Poison Attacks and Adversarial Prompts Against an Informed University Virtual Assistant
- 2025How Generative AI Empowers Attackers and Defenders Across the Trust & Safety Landscape
- 2023From ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and Privacy
- 2025Computational Safety for Generative AI: A Hypothesis Testing Perspective
- 2026From Alignment to Access Control: A Framework for GenAI Policy Enforcement
- 2024Attack Atlas: A Practitioner's Perspective on Challenges and Pitfalls in Red Teaming GenAI