mlsanityData to 7 Oct 2026

Safety Paradox: How Enhanced Safety Awareness Leaves LLMs Vulnerable to Posterior Attack

arXiv 2606.05614 ↗First posted 4 Jun 2026cs.AIcited by 0

On the map: LLM safety and security → Safety alignment, refusal and guardrails

Abstract (arXiv)

Large language models (LLMs) are rigorously aligned to refuse harmful requests, a process that inherently cultivates a latent capacity to evaluate and recognize unsafe content. In this work, we reveal that this advanced safety awareness inadvertently introduces a fatal vulnerability. We introduce Posterior Attack, a single-query jailbreak that bypasses guardrails by prompting the model to generate the exact harmful response its internal classifier would normally flag as unsafe. Through extensive empirical evaluation across 30 open-source LLMs (up to 35B parameters in size) and frontier models (e.g., GPT-5, Claude 4.6), we observe a striking phenomenon: models with superior safety-judgment capabilities are disproportionately more susceptible to this exploitation. To explain this, we formalize the Safety Paradox, analytically showing that monotonic improvements in safety alignment naturally amplify posterior vulnerability. Finally, we establish a causal link via reinforcement learning interventions, exemplifying that artificially degrading a model's safety judgment immunizes it against the attack, whereas enhancing judgment exacerbates the vulnerability. Our findings highlight potential flaws in current alignment paradigms, indicating that defense mechanisms may require further structural refinement.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 32 of its 51 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

32 of 51 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Safety Alignment Can Be Not Superficial With Explicit Safety Signals19 May
  2. 2025Activation Space Interventions Can Be Transferred Between Large Language Models6 Mar
  3. 2025The Hidden Dimensions of LLM Alignment: A Multi-Dimensional Analysis of Orthogonal Safety Directions13 Feb
  4. 2024Does Safety Training of LLMs Generalize to Semantically Related Natural Prompts?4 Dec
  5. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs26 Jun
  6. 2024Refusal in Language Models Is Mediated by a Single Direction17 Jun
  7. 2024Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications7 Feb
  8. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!5 Oct

Other references · 24

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  7. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  8. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  9. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  10. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
  11. 2021Ethical and social risks of harm from Language Modelscited by 957
  12. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
12 more
  1. 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 505
  2. 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Ciphercited by 401
  3. 2023Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructionscited by 377
  4. 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 337
  5. 2023A Wolf in Sheep's Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models Easilycited by 242
  6. 2024ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMscited by 197
  7. 2024Safety Layers in Aligned Large Language Models: The Key to LLM Securitycited by 126
  8. 2023An LLM can Fool Itself: A Prompt-Based Adversarial Attackcited by 111
  9. 2025From Hard Refusals to Safe-Completions: Toward Output-Centric Safety Trainingcited by 49
  10. 2024Steering Away from Harm: An Adaptive Approach to Defending Vision Language Model Against Jailbreakscited by 44
  11. 2025Refusal Direction is Universal Across Safety-Aligned Languagescited by 37
  12. 2024Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilitiescited by 16

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deep
  2. 2026Understanding the Effects of Safety Unalignment on Large Language Models
  3. 2024Towards Understanding Safety Alignment: A Mechanistic Perspective from Safety Neurons
  4. 2026Understanding and Preserving Safety in Fine-Tuned LLMs
  5. 2025Noise Injection Systemically Degrades Large Language Model Safety Guardrails
  6. 2025Read the Scene, Not the Script: Outcome-Aware Safety for LLMs
  7. 2025Vulnerability Mitigation for Safety-Aligned Language Models via Debiasing
  8. 2026Few Tokens, Big Leverage: Preserving Safety Alignment by Constraining Safety Tokens during Fine-tuning