GraphAttack: Exploiting Representational Blindspots in LLM Safety Mechanisms
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Large Language Models (LLMs) have been equipped with safety mechanisms to prevent harmful outputs, but these guardrails can often be bypassed through "jailbreak" prompts. This paper introduces a novel graph-based approach to systematically generate jailbreak prompts through semantic transformations. We represent malicious prompts as nodes in a graph structure with edges denoting different transformations, leveraging Abstract Meaning Representation (AMR) and Resource Description Framework (RDF) to parse user goals into semantic components that can be manipulated to evade safety filters. We demonstrate a particularly effective exploitation vector by instructing LLMs to generate code that realizes the intent described in these semantic graphs, achieving success rates of up to 87% against leading commercial LLMs. Our analysis reveals that contextual framing and abstraction are particularly effective at circumventing safety measures, highlighting critical gaps in current safety alignment techniques that focus primarily on surface-level patterns. These findings provide insights for developing more robust safeguards against structured semantic attacks. Our research contributes both a theoretical framework and practical methodology for systematically stress-testing LLM safety mechanisms.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 15 of its 27 references that are in the map. First posted on arXiv 17 Apr 2025.
Builds on
15 of 27 references.
Closest ancestors · 6
Same direction, newest first
- 2024RoleBreak: Character Hallucination as a Jailbreak Attack in Role-Playing Systems25 Sep
- 2024Intention Analysis Makes LLMs A Good Jailbreak Defender12 Jan
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automatically4 Dec
- 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
- 2023Jailbroken: How Does LLM Safety Training Fail?5 Jul
Other references · 9
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2022Red Teaming Language Models with Language Modelscited by 1,026
- 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 722
- 2022Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Spacecited by 532
- 2024CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completioncited by 76
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Forewarned is Forearmed: Pre-Synthesizing Jailbreak-like Instructions to Enhance LLM Safety Guardrail to Potential Attacks
- 2025Logic Jailbreak: Efficiently Unlocking LLM Safety Restrictions Through Formal Logical Expression
- 2024Revisiting Jailbreaking for Large Language Models: A Representation Engineering Perspective
- 2026StealthGraph: Exposing Domain-Specific Risks in LLMs through Knowledge-Graph-Guided Harmful Prompt Generation
- 2026LASA: Language-Agnostic Semantic Alignment at the Semantic Bottleneck for LLM Safety
- 2025ConceptGuard: Neuro-Symbolic Safety Guardrails via Sparse Interpretable Jailbreak Concepts
- 2024LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shifts
- 2025When Harmless Words Harm: A New Threat to LLM Safety via Conceptual Triggers