mlsanityData to 7 Oct 2026

Model-Editing-Based Jailbreak against Safety-aligned Large Language Models

arXiv 2412.08201 ↗First posted 11 Dec 2024cs.CR cs.LGcited by 4

On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks

also in 1 more
Abstract (arXiv)

Large Language Models (LLMs) have transformed numerous fields by enabling advanced natural language interactions but remain susceptible to critical vulnerabilities, particularly jailbreak attacks. Current jailbreak techniques, while effective, often depend on input modifications, making them detectable and limiting their stealth and scalability. This paper presents Targeted Model Editing (TME), a novel white-box approach that bypasses safety filters by minimally altering internal model structures while preserving the model's intended functionalities. TME identifies and removes safety-critical transformations (SCTs) embedded in model matrices, enabling malicious queries to bypass restrictions without input modifications. By analyzing distinct activation patterns between safe and unsafe queries, TME isolates and approximates SCTs through an optimization process. Implemented in the D-LLM framework, our method achieves an average Attack Success Rate (ASR) of 84.86% on four mainstream open-source LLMs, maintaining high performance. Unlike existing methods, D-LLM eliminates the need for specific triggers or harmful response collections, offering a stealthier and more effective jailbreak strategy. This work reveals a covert and robust threat vector in LLM security and emphasizes the need for stronger safeguards in model safety alignment.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 33 of its 61 references that are in the map. First posted on arXiv 11 Dec 2024.

Builds on

33 of 61 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024Uncovering Logit Suppression Vulnerabilities in LLM Safety Alignment20 May
  2. 2023Universal Jailbreak Backdoors from Poisoned Human Feedback24 Nov
  3. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
  4. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul

Other references · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  4. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  5. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  6. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
  7. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  8. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 579
  9. 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 533
  10. 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Promptscited by 520
  11. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 494
  12. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 478
17 more
  1. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 457
  2. 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 450
  3. 2024COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllabilitycited by 162
  4. 2024Weak-to-Strong Jailbreaking on Large Language Modelscited by 100
  5. 2024Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise and Reconstructioncited by 95
  6. 2023BadGPT: Exploring Security Vulnerabilities of ChatGPT via Backdoor Attacks to InstructGPTcited by 70
  7. 2024Pandora: Jailbreak GPTs by Retrieval Augmented Generation Poisoningcited by 62
  8. 2024What Makes and Breaks Safety Fine-tuning? A Mechanistic Studycited by 54
  9. 2024BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Modelscited by 44
  10. 2024AttnGCG: Enhancing Jailbreaking Attacks on LLMs with Attention Manipulationcited by 31
  11. 2024Competition Report: Finding Universal Jailbreak Backdoors in Aligned LLMscited by 27
  12. 2024GenderCARE: A Comprehensive Framework for Assessing and Reducing Gender Bias in Large Language Modelscited by 9
  13. 2024DPPA: Pruning Method for Large Language Model to Model Mergingcited by 7
  14. 2024Adanonymizer: Interactively Navigating and Balancing the Duality of Privacy and Output Performance in Human-LLM Interactioncited by 6
  15. 2024The Tug of War Within: Mitigating the Fairness-Privacy Conflicts in Large Language Modelscited by 5
  16. 2024Logicbreaks: A Framework for Understanding Subversion of Rule-based Inferencecited by 3
  17. 2024Privacy-hardened and hallucination-resistant synthetic data generation with logic-solverscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Stealthy Jailbreak Attacks on Large Language Models via Benign Data Mirroring
  2. 2025DELMAN: Dynamic Defense Against Large Language Model Jailbreaking with Model Editing
  3. 2026Exploring and Developing a Pre-Model Safeguard with Draft Models
  4. 2025Jailbreaking Attacks vs. Content Safety Filters: How Far Are We in the LLM Safety Arms Race?
  5. 2024Defending Large Language Models Against Jailbreak Attacks via Layer-specific Editing
  6. 2024Defensive Prompt Patch: A Robust and Interpretable Defense of LLMs against Jailbreak Attacks
  7. 2025One Model Transfer to All: On Robust Jailbreak Prompts Generation against LLMs
  8. 2025Exploiting Prefix-Tree in Structured Output Interfaces for Enhancing Jailbreak Attacking