mlsanityData to 14 Oct 2026

Ablating Safety: Mechanisms for Removing Alignment in Language Models for Security Applications

arXiv 2605.17413 ↗First posted 17 May 2026cs.CR cs.AIcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks

Abstract (arXiv)

Safety-aligned language models often refuse cybersecurity requests whose wording resembles misuse, even when the task is authorized and defensive. This makes security evaluation ambiguous: a failed answer may reflect missing capability or refusal-policy intervention. Ablating Safety studies alignment removal as a controlled transformation-evaluation protocol for authorized security tasks, comparing authorized-context prompting, reversible refusal-direction activation projection, representation-control projections, and LoRA-based de-alignment or task adaptation. We evaluate refusal, attempt rate, validated security success, general-capability retention, instability, and out-of-scope unsafe compliance on Security-AR, a 60-prompt suite of authorized security, benign general, and non-operational spillover probes. The reported runs include a four-model projection pilot with 416 completions, a three-model Qwen2.5 LoRA extension with 1,980 held-out completions, representation and robustness sweeps, and executable secure-repair validators. Single-vector refusal projection raises mean security score only from 0.46 to 0.50 while increasing unsafe compliance from 0.10 to 0.47; rank-4 refusal-subspace projection reaches 0.51 while matching the aligned spillover rate. Task-only LoRA raises mean security score to 0.87 with general score 0.83 and unsafe compliance 0.13, while refusal-suppression with retention raises spillover to 0.27. These results support evaluating alignment removal as a utility-risk frontier, not as an uncensoring recipe, and treating compliance alone as neither competence nor safe deployment.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 41 of its 42 references that are in the map. First posted on arXiv 17 May 2026.

Builds on

41 of 42 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Few Tokens, Big Leverage: Preserving Safety Alignment by Constraining Safety Tokens during Fine-tuning8 Mar
  2. 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deep10 Jun
  3. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!5 Oct
  4. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
  5. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned23 Aug

Other references · 36

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  7. 2024Qwen2.5 Technical Reportcited by 4,942
  8. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  9. 2021Program Synthesis with Large Language Modelscited by 3,637
  10. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  11. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  12. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
24 more
  1. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  2. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  3. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  4. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  5. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  6. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  7. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  8. 2022Red Teaming Language Models with Language Modelscited by 1,026
  9. 2023Steering Language Models With Activation Engineeringcited by 922
  10. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
  11. 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 431
  12. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 365
  13. 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 335
  14. 2024Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Modelscited by 164
  15. 2023Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Modelscited by 138
  16. 2025LlamaFirewall: An open source guardrail system for building secure AI agentscited by 127
  17. 2024Steering Language Model Refusal with Sparse Autoencoderscited by 95
  18. 2024Refusal in LLMs is an Affine Functioncited by 29
  19. 2025COSMIC: Generalized Refusal Direction Identification in LLM Activationscited by 19
  20. 2025An Embarrassingly Simple Defense Against LLM Abliteration Attackscited by 13
  21. 2025A Granular Study of Safety Pretraining under Model Abliterationcited by 6
  22. 2026Detection Is Cheap, Routing Is Learned: Why Refusal-Based Alignment Evaluation Failscited by 3
  23. 2026On the Failure of Topic-Matched Contrast Baselines in Multi-Directional Refusal Abliterationcited by 3
  24. 2026How Alignment Routes: Localizing, Scaling, and Controlling Policy Circuits in Language Modelscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Refusal: A Same-Lineage Study of Aligned and Abliterated LLMs for Vulnerability Analysis
  2. 2026Deactivating Refusal Triggers: Understanding and Mitigating Overrefusal in Safety Alignment
  3. 2026Defensive Refusal Bias: How Safety Alignment Fails Cyber Defenders
  4. 2026Measuring Safety Alignment Effects in Autonomous Security Agents
  5. 2026Understanding the Effects of Safety Unalignment on Large Language Models
  6. 2024SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal
  7. 2026Not All Refusals Are Equal: How Safety Alignment Fails Cybersecurity at Scale
  8. 2025The Hidden Dimensions of LLM Alignment: A Multi-Dimensional Analysis of Orthogonal Safety Directions