mlsanityData to 7 Oct 2026

Proactive defense against LLM Jailbreak

arXiv 2510.05052 ↗First posted 6 Oct 2025cs.CR cs.CLcited by 6

On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks

also in 1 more
Abstract (arXiv)

The proliferation of powerful large language models (LLMs) has necessitated robust safety alignment, yet these models remain vulnerable to evolving adversarial attacks, including multi-turn jailbreaks that iteratively search for successful queries. Current defenses, which are primarily reactive and static, often fail to handle these iterative attacks. In this paper, we introduce ProAct, a novel proactive defense framework designed to disrupt and mislead these iterative search jailbreak methods. Our core idea is to intentionally mislead these jailbreak methods into thinking that the model has been jailbroken with "spurious responses". These misleading responses provide false signals to the attacker's internal optimization loop, causing the adversarial search to terminate prematurely and effectively jailbreaking the jailbreak. By conducting extensive experiments across state-of-the-art LLMs, jailbreaking frameworks, and safety benchmarks, we demonstrate that our method consistently and significantly reduces attack success rates by up to 94% without affecting utility. When combined with other defense fraeworks, it further reduces the latest attack strategies' success rate to 0%. ProActrepresents an orthogonal defense strategy that serves as an additional guardrail to enhance LLM safety against the most effective jailbreaking attacks.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 40 of its 52 references that are in the map. First posted on arXiv 6 Oct 2025.

Builds on

40 of 52 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024Defending Large Language Models against Jailbreak Attacks via Semantic Smoothing25 Feb
  2. 2024Intention Analysis Makes LLMs A Good Jailbreak Defender12 Jan
  3. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
  4. 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Models1 Sep
  5. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
  6. 2023Are aligned neural networks adversarially aligned?26 Jun
  7. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned23 Aug

Other references · 33

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  3. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  4. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  5. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
  6. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  7. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
  8. 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 619
  9. 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 533
  10. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 494
  11. 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 434
  12. 2023Detecting Language Model Attacks with Perplexitycited by 411
21 more
  1. 2023Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructionscited by 377
  2. 2024SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decodingcited by 233
  3. 2024AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehensioncited by 215
  4. 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 215
  5. 2019Build it Break it Fix it for Dialogue Safety: Robustness from Adversarial Human Attackcited by 176
  6. 2023MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbotscited by 172
  7. 2024Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attackscited by 150
  8. 2023RAIN: Your Language Models Can Align Themselves without Finetuningcited by 149
  9. 2024AutoDefense: Multi-Agent LLM Defense against Jailbreak Attackscited by 135
  10. 2024Attacks, Defenses and Evaluations for LLM Conversation Safety: A Surveycited by 124
  11. 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agentscited by 112
  12. 2024On Prompt-Driven Safeguarding for Large Language Modelscited by 109
  13. 2024Weak-to-Strong Jailbreaking on Large Language Modelscited by 100
  14. 2023Jatmo: Prompt Injection Defense by Task-Specific Finetuningcited by 89
  15. 2025Reasoning-Augmented Conversation for Multi-Turn Jailbreak Attacks on Large Language Modelscited by 61
  16. 2024Enhancing LLM Safety via Constrained Direct Preference Optimizationcited by 47
  17. 2024Break the Breakout: Reinventing LM Defense Against Jailbreak Attacks with Self-Refinementcited by 25
  18. 2024Defending Against Social Engineering Attacks in the Age of LLMscited by 15
  19. 2025SecurityLingua: Efficient Defense of LLM Jailbreak Attacks via Security-Aware Prompt Compressioncited by 12
  20. 2024Root Defence Strategies: Ensuring Safety of LLM at the Decoding Levelcited by 11
  21. 2024Diversity Helps Jailbreak Large Language Modelscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 5.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Scalable Defense against In-the-wild Jailbreaking Attacks with Safety Context Retrieval
  2. 2024Defending Large Language Models Against Jailbreak Attacks via Layer-specific Editing
  3. 2024SelfDefend: LLMs Can Defend Themselves against Jailbreaking in a Practical Manner
  4. 2025PandaGuard: Systematic Evaluation of LLM Safety against Jailbreaking Attacks
  5. 2024Defensive Prompt Patch: A Robust and Interpretable Defense of LLMs against Jailbreak Attacks
  6. 2024LLMs Can Defend Themselves Against Jailbreaking in a Practical Manner: A Vision Paper
  7. 2025DELMAN: Dynamic Defense Against Large Language Model Jailbreaking with Model Editing
  8. 2025Do Methods to Jailbreak and Defend LLMs Generalize Across Languages?