mlsanityData to 14 Oct 2026

DeepSeek Robustness Against Semantic-Character Dual-Space Mutated Prompt Injection

arXiv 2604.12548 ↗First posted 14 Apr 2026cs.CRcited by 0

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

Prompt injection has emerged as a critical security threat to large language models (LLMs), yet existing studies predominantly focus on single-dimensional attack strategies, such as semantic rewriting or character-level obfuscation, which fail to capture the combined effects of multi-space perturbations in realistic scenarios. In addition, systematic black-box robustness evaluations of recent Chinese LLMs, such as DeepSeek, remain limited. To address these gaps, we propose PromptFuzz-SC, a semantic-character dual-space mutation framework for evaluating LLM robustness against prompt injection. The framework integrates semantic transformations (e.g., paraphrasing and word-order perturbation) with character-level obfuscation (e.g., zero-width insertion and encoding-based mutation), forming a unified and extensible mutation operator library. A hybrid search strategy combining epsilon-greedy exploration and hill-climbing refinement is adopted to efficiently discover high-quality adversarial prompts. We further introduce a unified evaluation protocol based on three metrics: misuse success rate (MSR), Average Queries to Success (AQS), and Stealth. Experimental results on DeepSeek demonstrate that dual-space mutation achieves the strongest overall attack performance among the evaluated strategies, attaining the highest mean MSR (0.189), peak MSR (0.375), and mean Stealth. Compared with semantic-only and character-only mutation, it improves mean MSR by 12.5% and 5.6%, respectively. While not consistently minimizing query cost, the proposed method achieves competitive best-case efficiency and maintains strong imperceptibility, indicating a more favorable balance between attack effectiveness and concealment. These findings highlight the importance of composite mutation strategies for robust red-teaming of LLMs and provide practical insights for the design of multi-layer defense mechanisms.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 33 of its 36 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

33 of 36 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Token-Efficient Prompt Injection Attack: Provoking Cessation in LLM Reasoning via Adaptive Token Compression29 Apr
  2. 2024Red Teaming Visual Language Models23 Jan
  3. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection23 Feb
  4. 2022Red Teaming Language Models with Language Models7 Feb

Other references · 29

  1. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  2. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  3. 2020Extracting Training Data from Large Language Modelscited by 2,189
  4. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  5. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 722
  6. 2019Adversarial Training for Free!cited by 643
  7. 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 518
  8. 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 459
  9. 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 456
  10. 2020Amnesiac Machine Learningcited by 319
  11. 2017Certified Defenses for Data Poisoning Attackscited by 303
  12. 2023Poisoning Language Models During Instruction Tuningcited by 269
17 more
  1. 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Promptscited by 226
  2. 2023A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generationcited by 206
  3. 2023Multimodal Large Language Models: A Surveycited by 195
  4. 2023Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritizationcited by 170
  5. 2024AdvPrompter: Fast Adaptive Adversarial Prompting for LLMscited by 156
  6. 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 129
  7. 2025The Hidden Risks of Large Reasoning Models: A Safety Assessment of R1cited by 91
  8. 2025Poisoning Attacks on LLMs Require a Near-constant Number of Poison Samplescited by 72
  9. 2025Safety in Large Reasoning Models: A Surveycited by 64
  10. 2024SelfDefend: LLMs Can Defend Themselves against Jailbreaking in a Practical Mannercited by 63
  11. 2023Model-as-a-Service (MaaS): A Surveycited by 25
  12. 2024Emoji Attack: Enhancing Jailbreak Attacks Against Judge LLM Detectioncited by 23
  13. 2025Mixture of Experts (MoE): A Big Data Perspectivecited by 18
  14. 2025Exploring Typographic Visual Prompts Injection Threats in Cross-Modality Generation Modelscited by 14
  15. 2025ShieldLearner: A New Paradigm for Jailbreak Attack Defense in LLMscited by 7
  16. 2025Sugar-Coated Poison: Benign Generation Unlocks LLM Jailbreakingcited by 6
  17. 2025Mitigating Many-Shot Jailbreakingcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024PROMPTFUZZ: Harnessing Fuzzing Techniques for Robust Testing of Prompt Injection in LLMs
  2. 2025Prompt Injection as an Emerging Threat: Evaluating the Resilience of Large Language Models
  3. 2025OET: Optimization-based prompt injection Evaluation Toolkit
  4. 2024Automatic and Universal Prompt Injection Attacks against Large Language Models
  5. 2026An Empirical Evaluation of Prompt Injection Vulnerabilities in Large Language Models Across Multilingual and Obfuscated Attack Scenarios
  6. 2026AttackEval: A Systematic Empirical Study of Prompt Injection Attack Effectiveness Against Large Language Models
  7. 2025System Prompt Poisoning: Persistent Attacks on Large Language Models Beyond User Injection
  8. 2025Robustness via Referencing: Defending against Prompt Injection Attacks by Referencing the Executed Instruction