Disentangling Adversarial Prompts: A Semantic-Graph Defense for Robust LLM Security
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Large Language Models (LLMs) are increasingly vulnerable to adversarial prompts that exploit semantic ambiguities to bypass safety mechanisms, resulting in harmful or inappropriate outputs. Such attacks, including jailbreaking and prompt injection, pose significant risks to the integrity and availability of LLMs in security-critical applications. This paper proposes the Adversarial Prompt Disentanglement (APD) framework, a novel defense mechanism that proactively identifies and neutralizes malicious components in input prompts before they are processed by the LLM. The APD framework integrates three key innovations: (1) a mutual information-based semantic decomposition method to isolate adversarial and benign prompt components, ensuring statistical independence; (2) a graph-based intent classification approach that leverages spectral analysis to detect malicious patterns in prompt semantics; and (3) a lightweight transformer-based classifier trained on real-world datasets of toxic and jailbreaking prompts, enabling efficient and accurate adversarial intent detection. Evaluated on diverse datasets containing adversarial prompts, APD demonstrates superior robustness, reducing harmful output generation by over 85% while maintaining negligible impact on model performance. The framework's computational efficiency supports real-time deployment, making it a practical solution for securing LLMs. Our work addresses critical challenges in machine learning security on novel attacks and integrity methods for ML systems, and offers a scalable, ethically grounded defense against prompt-based adversarial threats.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 21 of its 68 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
21 of 68 references.
Closest ancestors · 1
Same direction, newest first
Other references · 20
- 2023An LLM can Fool Itself: A Prompt-Based Adversarial Attackcited by 116
- 2024Rule Based Rewards for Language Model Safetycited by 108
- 2020Adv-watermark: A Novel Watermark Perturbation for Adversarial Examplescited by 56
- 2022Multi-Modal Cross-Domain Alignment Network for Video Moment Retrievalcited by 43
- 2025Adversarial Attacks against Closed-Source MLLMs via Feature Optimal Alignmentcited by 43
- 2023You Can Ground Earlier than See: An Effective and Efficient Pipeline for Temporal Sentence Grounding in Compressed Videoscited by 41
- 2022Hierarchical Local-Global Transformer for Temporal Sentence Groundingcited by 38
- 2024Boosting Transferability in Vision-Language Attacks via Diversification along the Intersection Region of Adversarial Trajectorycited by 36
- 2022Exploring Optical-Flow-Guided Motion and Detection-Based Appearance for Temporal Sentence Groundingcited by 35
- 2020Unbalanced Incomplete Multi-view Clustering via the Scheme of View Evolution: Weak Views are Meat; Strong Views do Eatcited by 30
- 2020ANIMC: A Soft Framework for Auto-weighted Noisy and Incomplete Multi-view Clusteringcited by 30
- 2023Hypotheses Tree Building for One-Shot Temporal Sentence Localizationcited by 25
8 more
- 2020Double Self-weighted Multi-view Clustering via Adaptive View Fusioncited by 23
- 2024Semantic-Aligned Adversarial Evolution Triangle for High-Transferability Vision-Language Attackcited by 18
- 2024Multi-Pair Temporal Sentence Grounding via Multi-Thread Knowledge Transfer Networkcited by 15
- 2025Taylor Series-Inspired Local Structure Fitting Network for Few-shot Point Cloud Semantic Segmentationcited by 14
- 2025To Align or Not to Align: Strategic Multimodal Representation Alignment for Optimal Performancecited by 14
- 2025Prototype-Driven Structure Synergy Network for Remote Sensing Images Segmentationcited by 11
- 2026Unveiling the Fragility of Vision-Language Models: Multi-Modal Adversarial Synergy via Texture-Constrained Perturbations and Cross-Modal Optimizationcited by 9
- 2023RoAST: Robustifying Language Models via Adversarial Perturbation with Selective Trainingcited by 3
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Not All Inputs Are Valid: Towards Open-Set Video Moment Retrieval Using Languagecited by 6
- 2026Fewer Steps, Better Performance: Efficient Cross-Modal Clip Trimming for Video Moment Retrieval Using Languagecited by 5
- 2026CogniVerse: Revolutionizing Multi-Modal Retrieval-Augmented Generation with Cognitive Reflection and Geometric Reasoningcited by 3
- 2026Immuno-VLM: Immunizing Large Vision-Language Models via Generative Semantic Antibodies for Open-World Trustworthinesscited by 2
- 2026SLAP: The Semantic Least Action Principle for Variational Video-Language Modelingcited by 2
- 2026Hierarchical Semantic-Augmented Navigation: Optimal Transport and Graph-Driven Reasoning for Vision-Language Navigationcited by 1
- 2026Turing Patterns for Multimedia: Reaction-Diffusion Multi-Modal Fusion for Language-Guided Video Moment Retrievalcited by 0
- 2026Let Prompts Bridge Defense Knowledge: Transferable Graph Purification via Vulnerability-Aware GPLcited by 0
- 2026Let Prompts Bridge Defense Knowledge: Transferable Graph Purification via Vulnerability-Aware GPL29 Aug 2026
- 2026Turing Patterns for Multimedia: Reaction-Diffusion Multi-Modal Fusion for Language-Guided Video Moment Retrieval1 Jun 2026
- 2026Hierarchical Semantic-Augmented Navigation: Optimal Transport and Graph-Driven Reasoning for Vision-Language Navigation1 Jun 2026
- 2026SLAP: The Semantic Least Action Principle for Variational Video-Language Modeling29 May 2026
- 2026Immuno-VLM: Immunizing Large Vision-Language Models via Generative Semantic Antibodies for Open-World Trustworthiness29 May 2026
- 2026Not All Inputs Are Valid: Towards Open-Set Video Moment Retrieval Using Language28 May 2026
- 2026Fewer Steps, Better Performance: Efficient Cross-Modal Clip Trimming for Video Moment Retrieval Using Language28 May 2026
- 2026CogniVerse: Revolutionizing Multi-Modal Retrieval-Augmented Generation with Cognitive Reflection and Geometric Reasoning28 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Mechanistic Interpretability of LLM Jailbreaks via Internal Attribution Graphs
- 2023Token-Level Adversarial Prompt Detection Based on Perplexity Measures and Contextual Information
- 2025AutoAdv: Automated Adversarial Prompting for Multi-Turn Jailbreaking of Large Language Models
- 2024Adversarial Tuning: Defending Against Jailbreak Attacks for LLMs
- 2025Graph of Attacks: Improved Black-Box and Interpretable Jailbreaks for LLMs
- 2024Jailbreaking and Mitigation of Vulnerabilities in Large Language Models
- 2025GuardNet: Graph-Attention Filtering for Jailbreak Defense in Large Language Models
- 2024Exploring Vulnerabilities and Protections in Large Language Models: A Survey