mlsanityData to 7 Oct 2026

Adversarial Poetry as a Universal Single-Turn Jailbreak Mechanism in Large Language Models

arXiv 2511.15304 ↗First posted 19 Nov 2025cs.CL cs.AIcited by 14

On the map: LLM safety and security → Jailbreaking

Abstract (arXiv)

We present evidence that adversarial poetry functions as a universal single-turn jailbreak technique for Large Language Models (LLMs). Across 25 frontier proprietary and open-weight models, curated poetic prompts yielded high attack-success rates (ASR), with some providers exceeding 90%. Mapping prompts to MLCommons and EU CoP risk taxonomies shows that poetic attacks transfer across CBRN, manipulation, cyber-offence, and loss-of-control domains. Converting 1,200 MLCommons harmful prompts into verse via a standardized meta-prompt produced ASRs up to 18 times higher than their prose baselines. Outputs are evaluated using an ensemble of 3 open-weight LLM judges, whose binary safety assessments were validated on a stratified human-labeled subset. Poetic framing achieved an average jailbreak success rate of 62% for hand-crafted poems and approximately 43% for meta-prompt conversions (compared to non-poetic baselines), substantially outperforming non-poetic baselines and revealing a systematic vulnerability across model families and safety training approaches. These findings demonstrate that stylistic variation alone can circumvent contemporary safety mechanisms, suggesting fundamental limitations in current alignment methods and evaluation protocols.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 16 of its 21 references that are in the map. First posted on arXiv 19 Nov 2025.

Builds on

16 of 21 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024Hidden You Malicious Goal Into Benign Narratives: Jailbreak Large Language Models through Logic Chain Injection7 Apr
  2. 2024Don't Listen To Me: Understanding and Exploring Jailbreak Prompts of Large Language Models26 Mar
  3. 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs12 Jan
  4. 2023Multilingual Jailbreak Challenges in Large Language Models10 Oct
  5. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
  6. 2023Jailbroken: How Does LLM Safety Training Fail?5 Jul
  7. 2023Tricking LLMs into Disobedience: Formalizing, Analyzing, and Detecting Jailbreaks24 May

Other references · 9

  1. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  2. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  3. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
  4. 2023Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attackscited by 268
  5. 2024Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Mapscited by 140
  6. 2024Introducing v0.5 of the AI Safety Benchmark from MLCommonscited by 60
  7. 2025No Free Labels: Limitations of LLM-as-a-Judge Without Human Groundingcited by 50
  8. 2023Characterizing Manipulation from AI Systemscited by 43
  9. 2025AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommonscited by 31

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 12.

14 papers.

Sort:

By area: