mlsanityData to 14 Oct 2026

Knowledge Return Oriented Prompting (KROP)

arXiv 2406.11880 ↗First posted 11 Jun 2024cs.CR cs.LGcited by 0

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

Many Large Language Models (LLMs) and LLM-powered apps deployed today use some form of prompt filter or alignment to protect their integrity. However, these measures aren't foolproof. This paper introduces KROP, a prompt injection technique capable of obfuscating prompt injection attacks, rendering them virtually undetectable to most of these security measures.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 5 of its 12 references that are in the map. First posted on arXiv 11 Jun 2024.

Builds on

5 of 12 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competition24 Oct

Other references · 4

  1. 2022Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methodscited by 79
  2. 2024Safeguarding Large Language Models: A Surveycited by 78
  3. 2022Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examplescited by 69
  4. 2024WordGame: Efficient & Effective LLM Jailbreak via Simultaneous Obfuscation in Query and Responsecited by 29

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection
  2. 2024StruQ: Defending Against Prompt Injection with Structured Queries
  3. 2024Palisade -- Prompt Injection Detection Framework
  4. 2024Fine-tuned Large Language Models (LLMs): Improved Prompt Injection Attacks Detection
  5. 2024Signed-Prompt: A New Approach to Prevent Prompt Injection Attacks Against LLM-Integrated Applications
  6. 2023Jatmo: Prompt Injection Defense by Task-Specific Finetuning
  7. 2023Prompt Injection attack against LLM-integrated Applications
  8. 2025Defending Against Prompt Injection With a Few DefensiveTokens