mlsanityData to 14 Oct 2026

Beyond Surface-Level Detection: Towards Cognitive-Driven Defense Against Jailbreak Attacks via Meta-Operations Reasoning

arXiv 2508.03054 ↗First posted 5 Aug 2025cs.AIcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Defending large language models (LLMs) against jailbreak attacks is essential for their safe and reliable deployment. Existing defenses often rely on shallow pattern matching, which struggles to generalize to novel and unseen attack strategies. To address this challenge, we propose the Cognitive-Driven Defense (CDD) framework, which targets the underlying structure of jailbreak prompts by applying meta-operations, defined as basic manipulations that conceal harmful intent.CDD emulates human cognitive reasoning through a structured reasoning chain. It begins with a global perception of the prompt and follows with a localized analysis to uncover hidden manipulations. By applying supervised fine-tuning on this structured chain, the model learns to identify and reason about known manipulation patterns. To enhance generalization to unseen threats, an entropy-guided reinforcement learning algorithm (EG-GRPO) is introduced to encourage exploration of new types and variants of meta-operations. Experiments demonstrate that CDD can achieve state-of-the-art defense performance and exhibit strong generalization to unseen jailbreak attacks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 34 of its 62 references that are in the map. First posted on arXiv 5 Aug 2025.

Builds on

34 of 62 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025RSafe: Incentivizing proactive reasoning to build robust and adaptive LLM safeguards9 Jun
  2. 2025Reasoning-to-Defend: Safety-Aware Reasoning Can Defend Large Language Models from Jailbreaking18 Feb
  3. 2025STAIR: Improving Safety Alignment with Introspective Reasoning4 Feb
  4. 2025GuardReasoner: Towards Reasoning-based LLM Safeguards30 Jan
  5. 2024OpenAI o1 System Card21 Dec
  6. 2024Deliberative Alignment: Reasoning Enables Safer Language Models20 Dec
  7. 2024Reasoning as a Weapon: Adaptive Dual-Path Jailbreak Attack on Large Language Models23 Jul

Other references · 27

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  5. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
  6. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  7. 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 651
  8. 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Promptscited by 560
  9. 2023Detecting Language Model Attacks with Perplexitycited by 431
  10. 2025Reasoning with Exploration: An Entropy Perspectivecited by 281
  11. 2023A Wolf in Sheep's Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models Easilycited by 259
  12. 2024SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decodingcited by 247
15 more
  1. 2024OR-Bench: An Over-Refusal Benchmark for Large Language Modelscited by 244
  2. 2024Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8Bcited by 158
  3. 2024Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attackscited by 156
  4. 2024On Prompt-Driven Safeguarding for Large Language Modelscited by 116
  5. 2024Weak-to-Strong Jailbreaking on Large Language Modelscited by 107
  6. 2024DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakerscited by 101
  7. 2024FlipAttack: Jailbreak LLMs via Flippingcited by 80
  8. 2024CodeChameleon: Personalized Encryption Framework for Jailbreaking Large Language Modelscited by 76
  9. 2024Intention Analysis Makes LLMs A Good Jailbreak Defendercited by 74
  10. 2024Distract Large Language Models for Automatic Jailbreak Attackcited by 45
  11. 2025QueryAttack: Jailbreaking Aligned Large Language Models Using Structured Non-natural Query Languagecited by 18
  12. 2025Generative AI Act II: Test Time Scaling Drives Cognition Engineeringcited by 15
  13. 2024You Know What I'm Saying: Jailbreak Attack via Implicit Referencecited by 14
  14. 2025Bleeding Pathways: Vanishing Discriminability in LLM Hidden States Fuels Jailbreak Attackscited by 5
  15. 2025STShield: Single-Token Sentinel for Real-Time Jailbreak Detection in Large Language Modelscited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Defending Large Language Models Against Jailbreak Exploits with Responsible AI Considerations
  2. 2025SafeBehavior: Simulating Human-Like Multistage Reasoning to Mitigate Jailbreak Attacks in Large Language Models
  3. 2025MirrorShield: Towards Universal Defense Against Jailbreaks via Entropy-Guided Mirror Crafting
  4. 2025Defense-to-Attack: Bypassing Weak Defenses Enables Stronger Jailbreaks in Vision-Language Models
  5. 2025Jailbreak Mimicry: Automated Discovery of Narrative-Based Jailbreaks for Large Language Models
  6. 2025Guarding the Guardrails: A Taxonomy-Driven Approach to Jailbreak Detection
  7. 2026Metis: Learning to Jailbreak LLMs via Self-Evolving Metacognitive Policy Optimization
  8. 2024Foot In The Door: Understanding Large Language Model Jailbreaking via Cognitive Psychology