mlsanityData to 7 Oct 2026

ASGuard: Activation-Scaling Guard to Mitigate Targeted Jailbreaking Attack

arXiv 2509.25843 ↗First posted 30 Sep 2025cs.AIcited by 1

On the map: LLM safety and security → Jailbreaking

Abstract (arXiv)

Large language models (LLMs), despite being safety-aligned, exhibit brittle refusal behaviors that can be circumvented by simple linguistic changes. As tense jailbreaking demonstrates that models refusing harmful requests often comply when rephrased in past tense, a critical generalization gap is revealed in current alignment methods whose underlying mechanisms are poorly understood. In this work, we introduce Activation-Scaling Guard (ASGuard), an insightful, mechanistically-informed framework that surgically mitigates this specific vulnerability. In the first step, we use circuit analysis to identify the specific attention heads causally linked to the targeted jailbreaking such as a tense-changing attack. Second, we train a precise, channel-wise scaling vector to recalibrate the activation of tense vulnerable heads. Lastly, we apply it into a "preventative fine-tuning", forcing the model to learn a more robust refusal mechanism. Across four LLMs, ASGuard effectively reduces the attack success rate of targeted jailbreaking while preserving general capabilities and minimizing over refusal, achieving a Pareto-optimal balance between safety and utility. Our findings underscore how adversarial suffixes suppress the propagation of the refusal-mediating direction, based on mechanistic analysis. Furthermore, our work showcases how a deep understanding of model internals can be leveraged to develop practical, efficient, and targeted methods for adjusting model behavior, charting a course for more reliable and interpretable AI safety.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 57 of its 72 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

57 of 72 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025Logic Jailbreak: Efficiently Unlocking LLM Safety Restrictions Through Formal Logical Expression18 May
  2. 2024AmpleGCG-Plus: A Strong Generative Model of Adversarial Suffixes to Jailbreak LLMs with Higher Success Rates in Fewer Attempts29 Oct
  3. 2024Jailbreaking and Mitigation of Vulnerabilities in Large Language Models20 Oct
  4. 2024Jailbreak Attacks and Defenses Against Large Language Models: A Survey5 Jul
  5. 2024WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Models26 Jun
  6. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models28 Mar
  7. 2024Gradient Cuff: Detecting Jailbreak Attacks on Large Language Models by Exploring Refusal Loss Landscapes1 Mar
  8. 2023A Wolf in Sheep's Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models Easily14 Nov
  9. 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
  10. 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks5 Oct
  11. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models7 Aug
  12. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
1 more
  1. 2023Jailbroken: How Does LLM Safety Training Fail?5 Jul

Other references · 44

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  5. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  6. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  7. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  8. 2025Gemma 3 Technical Reportcited by 1,686
  9. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  10. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  11. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  12. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
32 more
  1. 2023Steering Language Models With Activation Engineeringcited by 824
  2. 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
  3. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
  4. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
  5. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
  6. 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 477
  7. 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deepcited by 450
  8. 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
  9. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
  10. 2024Improving Alignment and Robustness with Circuit Breakerscited by 302
  11. 20242 OLMo 2 Furiouscited by 302
  12. 2024OR-Bench: An Over-Refusal Benchmark for Large Language Modelscited by 222
  13. 2025Open Problems in Mechanistic Interpretabilitycited by 173
  14. 2024Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanismscited by 144
  15. 2024Attacks, Defenses and Evaluations for LLM Conversation Safety: A Surveycited by 124
  16. 2024Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systemscited by 94
  17. 2024Steering Language Model Refusal with Sparse Autoencoderscited by 89
  18. 2025LLMs Encode Harmfulness and Refusal Separatelycited by 75
  19. 2024Does Refusal Training in LLMs Generalize to the Past Tense?cited by 74
  20. 2024On the Role of Attention Heads in Large Language Model Safetycited by 70
  21. 2024Robust LLM safeguarding via refusal feature adversarial trainingcited by 60
  22. 2023Managing extreme AI risks amid rapid progresscited by 48
  23. 2024Steering Without Side Effects: Improving Post-Deployment Control of Language Modelscited by 44
  24. 2024Activation Scaling for Steering and Interpreting Language Modelscited by 33
  25. 2023Provably safe systems: the only path to controllable AGIcited by 29
  26. 2025Representation Bending for Large Language Model Safetycited by 28
  27. 2025Steering MoE LLMs via Expert (De)Activationcited by 23
  28. 2025How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Trainingcited by 22
  29. 2023Outlier Dimensions Encode Task-Specific Knowledgecited by 15
  30. 2024Does Safety Training of LLMs Generalize to Semantically Related Natural Prompts?cited by 15
  31. 2025Does Time Have Its Place? Temporal Heads: Where Language Models Recall Time-specific Informationcited by 14
  32. 2025SEAL: Scaling to Emphasize Attention for Long-Context Retrievalcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.