Defending Jailbreak Attacks on Large Language Models via Manifold Trajectory Kinetics
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Jailbreak prompts can bypass alignment guardrails in large language models (LLMs) and elicit unsafe outputs, making reliable deployment-time detection critical. Prior detection approaches largely rely on a fixed metric space, e.g., raw inputs, gradients, or hidden features, in which benign and jailbreak prompts are linearly separable. We show this assumption breaks under (i) pseudo-malicious prompts that are benign by intent but contain safety-related keywords, and (ii) adaptive attacks that explicitly optimize against the deployed detector. To overcome this limitation, we shift our focus from identifying a universal metric space to analyzing the more robust neighborhood structure of the underlying data manifold. We present Manifold Trajectory Kinetics (MTK), which treats an LLM as a kinetic system transforming inputs into outputs and detects jailbreaks by tracking how a prompt's neighborhood structure evolves across layers. Benign prompts remain close to benign neighborhoods throughout inference, whereas jailbreak prompts exhibit a characteristic trajectory that begins near malicious seeds and later strategically shifts toward benign neighborhoods to evade refusal.Across four LLMs and ten jailbreak attacks, MTK achieves strong robustness to both failure modes: on pseudo-malicious prompts, it attains a jailbreak true positive rate of 95% at a false positive rate of 5% on benign prompts and 2% on pseudo-malicious prompts, and under adaptive attacks, it maintains a true positive rate of 85%. We further demonstrate the superior performance of MTK for jailbreak detection in vision-language models. Our code is available at https://github.com/Rookie143/mtk.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. First posted on arXiv 5 Jun 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026PVDetector: Detecting Prompt Injection Attacks on Purpose-Specific LLM Agents through Policy-Violation Concept Analysiscited by 3
- 2026TYPO: Instruction-Dense Visual Jailbreaks against Commercial Closed-Source Image-Generation Modelscited by 2
- 2026Why Jailbreaks Succeed in Diffusion Language Models: An Energy Landscape Analysiscited by 0
- 2026Why Jailbreaks Succeed in Diffusion Language Models: An Energy Landscape Analysis25 Sep 2026
- 2026TYPO: Instruction-Dense Visual Jailbreaks against Commercial Closed-Source Image-Generation Models27 Jul 2026
- 2026PVDetector: Detecting Prompt Injection Attacks on Purpose-Specific LLM Agents through Policy-Violation Concept Analysis14 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Systematic Scaling Analysis of Jailbreak Attacks in Large Language Models
- 2025A Domain-Based Taxonomy of Jailbreak Vulnerabilities in Large Language Models
- 2026Jailbreaking Leaves a Trace: Understanding and Detecting Jailbreak Attacks from Internal Representations of Large Language Models
- 2025Behind the Mask: Benchmarking Camouflaged Jailbreaks in Large Language Models
- 2026Reactivating Alignment: Defending LLMs from Jailbreaks via Intention-Aware Input-Output Matching
- 2024Understanding Jailbreak Success: A Study of Latent Space Dynamics in Large Language Models
- 2026Causal Front-Door Adjustment for Robust Jailbreak Attacks on LLMs
- 2026JPU: Bridging Jailbreak Defense and Unlearning via On-Policy Path Rectification