Metaphor Is Not All Attention Needs
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Large language models are increasingly deployed in safety-critical applications, where their ability to resist harmful instructions is essential. Although post-training aims to make models robust against many jailbreak strategies, recent evidence shows that stylistic reformulations, such as poetic transformation, can still bypass safety mechanisms with alarming effectiveness. This raises a central question: why do literary jailbreaks succeed? In this work, we investigate whether their effectiveness depends on specific poetic devices, on a failure to recognize literary formatting, or on deeper changes in how models process stylistically irregular prompts. We address this problem through an interpretability analysis of attention patterns. We perform input-level ablation studies to assess the contribution of individual and combinations of poetic devices; construct an interpretable vector representation of attention maps; cluster these representations and train linear probes to predict safety outcomes and literary format. Our results show that models distinguish poetic from prose formats with high accuracy, yet struggle to predict jailbreak success within each format. Clustering further reveals clear separation by literary format, but not by safety label. These findings indicate that jailbreak success is not caused by a failure to recognize poetic formatting; rather, poetic prompts induce distinct processing patterns that remain largely independent of harmful-content detection. Overall, literary jailbreaks appear to misalign large language models not through any single poetic device, but through accumulated stylistic irregularities that alter prompt processing and avoid lexical triggers considered during post-training. This suggests that robustness requires safety mechanisms that account for style-induced shifts in model behavior. We use Qwen3-14B as a representative open-weight case study.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 36 of its 46 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
36 of 46 references.
Closest ancestors · 11
Same direction, newest first
- 2026Jailbreaking Leaves a Trace: Understanding and Detecting Jailbreak Attacks from Internal Representations of Large Language Models12 Feb
- 2025From Adversarial Poetry to Adversarial Tales: An Interpretability Research Agenda16 Dec
- 2025Adversarial Poetry as a Universal Single-Turn Jailbreak Mechanism in Large Language Models19 Nov
- 2025Attention Slipping: A Mechanistic Understanding of Jailbreak Attacks and Defenses in LLMs6 Jul
- 2025Universal Jailbreak Suffixes Are Strong Attention Hijackers15 Jun
- 2025AttentionDefense: Leveraging System Prompt Attention for Explainable Defense Against Novel Jailbreaks10 Apr
- 2024Don't Listen To Me: Understanding and Exploring Jailbreak Prompts of Large Language Models26 Mar
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs12 Jan
- 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher12 Aug
- 2023Tricking LLMs into Disobedience: Formalizing, Analyzing, and Detecting Jailbreaks24 May
- 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Study23 May
Other references · 25
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
- 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 1,003
- 2019Attention is not Explanationcited by 929
- 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 856
- 2019Attention is not not Explanationcited by 636
- 2024ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMscited by 216
13 more
- 2025Open Problems in Mechanistic Interpretabilitycited by 179
- 2024Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Mapscited by 142
- 2024Introducing v0.5 of the AI Safety Benchmark from MLCommonscited by 62
- 2025AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommonscited by 35
- 2024Localizing Paragraph Memorization in Language Modelscited by 31
- 2025The Universal Weight Subspace Hypothesiscited by 24
- 2025LLMs are Vulnerable to Malicious Prompts Disguised as Scientific Languagecited by 17
- 2025Attention Sinks: A 'Catch, Tag, Release' Mechanism for Embeddingscited by 16
- 2025Analyzing Memorization in Large Language Models through the Lens of Model Attributioncited by 14
- 2024DHCP: Detecting Hallucinations by Cross-modal Attention Pattern in Large Vision-Language Modelscited by 11
- 2025Safety Alignment Should Be Made More Than Just A Few Attention Headscited by 5
- 2025The Map of Misbelief: Tracing Intrinsic and Extrinsic Hallucinations Through Attention Patternscited by 2
- 2025Guess or Recall? Training CNNs to Classify and Localize Memorization in LLMscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Say It Differently: Linguistic Styles as Jailbreak Vectors
- 2025Innocence in the Crossfire: Roles of Skip Connections in Jailbreaking Visual Language Models
- 2025Anyone Can Jailbreak: Prompt-Based Attacks on LLMs and T2Is
- 2023Latent Jailbreak: A Benchmark for Evaluating Text Safety and Output Robustness of Large Language Models
- 2026Same Model, Different Weakness: How Language and Modality Reshape the Jailbreak Attack Surface in Frontier MLLMs
- 2025Behind the Mask: Benchmarking Camouflaged Jailbreaks in Large Language Models
- 2026When Words Are Safe But Actions Kill: Probing Physical Jailbreak Beyond Textual Jailbreak in Hidden-State Risk Space
- 2025Probing Semantic Alignment, Lexical Invariance, and Syntactic Influence in LLM Metaphor Processing