LTBD: Learnable Trust-Boundary Delimiters for Prompt Injection Defense
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
Large language models (LLMs) perform remarkably well on complex tasks, yet remain highly vulnerable to prompt injection attacks, where malicious instructions embedded in external data can override user intent. Existing defenses remain limited by model fine-tuning requirements, vulnerability to adaptive attacks, or reliance on brittle handcrafted prompts. We argue that a fundamental source of this vulnerability is the lack of an explicit representation of trust provenance. To address this, we introduce Learnable Trust-Boundary Delimiters (LTBD), a lightweight defense that explicitly encodes trust boundaries in the input while keeping the LLM parameters unchanged. LTBD uses a small number of learnable delimiters to distinguish trusted user instructions from untrusted external data, enabling the model to better respect the intended trust hierarchy. Experimental results show that LTBD substantially outperforms inference-time defenses and performs competitively with training-based approaches, while preserving benign-task utility and introducing negligible inference overhead. In particular, LTBD achieves 0.00% ASR on AlpacaFarm and only 0.11-0.19% ASR on TaskTracker. LTBD also remains effective under adaptive attacks, where adversaries have full knowledge of the defense and explicitly attempt to bypass it.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 4 of its 27 references that are in the map. First posted on arXiv 8 Oct 2026.
Builds on
4 of 27 references.
Closest ancestors · 2
Same direction, newest first
- 2025Meta SecAlign: A Secure Foundation LLM Against Prompt Injection Attacks3 Jul
- 2024CyberSecEval 2: A Wide-Ranging Cybersecurity Evaluation Suite for Large Language Models19 Apr
Other references · 2
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Know Thy Enemy: Securing LLMs Against Prompt Injection via Diverse Data Synthesis and Instruction-Level Chain-of-Thought Learning
- 2026Safety Targeted Embedding Exploit via Refinement
- 2026SRD-GUARD: A Defense Framework of LLMs via Semantic Rewriting and Joint Multi-Model Scoring for Latent Intent Exposure
- 2025Prompt Injection as an Emerging Threat: Evaluating the Resilience of Large Language Models
- 2024Automatic and Universal Prompt Injection Attacks against Large Language Models
- 2023Evaluating the Instruction-Following Robustness of Large Language Models to Prompt Injection
- 2026ClawGuard: A Runtime Security Framework for Tool-Augmented LLM Agents Against Indirect Prompt Injection
- 2025Robustness via Referencing: Defending against Prompt Injection Attacks by Referencing the Executed Instruction