ASGuard: Activation-Scaling Guard to Mitigate Targeted Jailbreaking Attack
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Large language models (LLMs), despite being safety-aligned, exhibit brittle refusal behaviors that can be circumvented by simple linguistic changes. As tense jailbreaking demonstrates that models refusing harmful requests often comply when rephrased in past tense, a critical generalization gap is revealed in current alignment methods whose underlying mechanisms are poorly understood. In this work, we introduce Activation-Scaling Guard (ASGuard), an insightful, mechanistically-informed framework that surgically mitigates this specific vulnerability. In the first step, we use circuit analysis to identify the specific attention heads causally linked to the targeted jailbreaking such as a tense-changing attack. Second, we train a precise, channel-wise scaling vector to recalibrate the activation of tense vulnerable heads. Lastly, we apply it into a "preventative fine-tuning", forcing the model to learn a more robust refusal mechanism. Across four LLMs, ASGuard effectively reduces the attack success rate of targeted jailbreaking while preserving general capabilities and minimizing over refusal, achieving a Pareto-optimal balance between safety and utility. Our findings underscore how adversarial suffixes suppress the propagation of the refusal-mediating direction, based on mechanistic analysis. Furthermore, our work showcases how a deep understanding of model internals can be leveraged to develop practical, efficient, and targeted methods for adjusting model behavior, charting a course for more reliable and interpretable AI safety.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 57 of its 72 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
57 of 72 references.
Closest ancestors · 13
Same direction, newest first
- 2025Logic Jailbreak: Efficiently Unlocking LLM Safety Restrictions Through Formal Logical Expression18 May
- 2024AmpleGCG-Plus: A Strong Generative Model of Adversarial Suffixes to Jailbreak LLMs with Higher Success Rates in Fewer Attempts29 Oct
- 2024Jailbreaking and Mitigation of Vulnerabilities in Large Language Models20 Oct
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Survey5 Jul
- 2024WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Models26 Jun
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models28 Mar
- 2024Gradient Cuff: Detecting Jailbreak Attacks on Large Language Models by Exploring Refusal Loss Landscapes1 Mar
- 2023A Wolf in Sheep's Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models Easily14 Nov
- 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks5 Oct
- 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models7 Aug
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
1 more
Other references · 44
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2025Gemma 3 Technical Reportcited by 1,686
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
32 more
- 2023Steering Language Models With Activation Engineeringcited by 824
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
- 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 477
- 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deepcited by 450
- 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
- 2024Improving Alignment and Robustness with Circuit Breakerscited by 302
- 20242 OLMo 2 Furiouscited by 302
- 2024OR-Bench: An Over-Refusal Benchmark for Large Language Modelscited by 222
- 2025Open Problems in Mechanistic Interpretabilitycited by 173
- 2024Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanismscited by 144
- 2024Attacks, Defenses and Evaluations for LLM Conversation Safety: A Surveycited by 124
- 2024Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systemscited by 94
- 2024Steering Language Model Refusal with Sparse Autoencoderscited by 89
- 2025LLMs Encode Harmfulness and Refusal Separatelycited by 75
- 2024Does Refusal Training in LLMs Generalize to the Past Tense?cited by 74
- 2024On the Role of Attention Heads in Large Language Model Safetycited by 70
- 2024Robust LLM safeguarding via refusal feature adversarial trainingcited by 60
- 2023Managing extreme AI risks amid rapid progresscited by 48
- 2024Steering Without Side Effects: Improving Post-Deployment Control of Language Modelscited by 44
- 2024Activation Scaling for Steering and Interpreting Language Modelscited by 33
- 2023Provably safe systems: the only path to controllable AGIcited by 29
- 2025Representation Bending for Large Language Model Safetycited by 28
- 2025Steering MoE LLMs via Expert (De)Activationcited by 23
- 2025How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Trainingcited by 22
- 2023Outlier Dimensions Encode Task-Specific Knowledgecited by 15
- 2024Does Safety Training of LLMs Generalize to Semantically Related Natural Prompts?cited by 15
- 2025Does Time Have Its Place? Temporal Heads: Where Language Models Recall Time-specific Informationcited by 14
- 2025SEAL: Scaling to Emphasize Attention for Long-Context Retrievalcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.