mlsanityData to 7 Oct 2026

BodhiPromptShield: Pre-Inference Prompt Mediation for Surface-Form Privacy Propagation in LLM Agent Pipelines

arXiv 2604.05793 ↗First posted 7 Apr 2026cs.CR cs.CVcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

In LLM agent pipelines, prompt privacy risk propagates beyond a single model call: raw user content enters retrieval queries, memory writes, tool arguments, OCR-derived text, and logs, and every downstream copy inherits what the first write contained. Existing de-identification pipelines protect document boundaries but not this cross-stage surface. We present BodhiPromptShield, a policy-aware mediation layer that detects sensitive spans before they propagate, replaces each with a typed placeholder, a semantic abstraction, or a secure symbolic token under a configured policy, and defers restoration to authorized execution boundaries. We evaluate it under one protocol against Presidio, Casper-style sanitization, an LLM sanitizer, and transformer and learned detectors, on 300 AI4Privacy documents, 493 PrivacyLens trajectories, 200 PrivacyLens tasks scored by that benchmark's own judge, and AgentDojo tasks under injection. Three findings result. Identifier propagation is controllable: residual exposure falls to 7.4% on AI4Privacy and 1.8% on PrivacyLens, and exact identifiers in an agent's final action fall from 13.7% to 2.1-3.1%. Restoration timing governs what every stage upstream of the authorized boundary sees: deferring it leaves 1.6% of protected values readable in the released context against 51.0%, and 2.7% against 4.8% in what the agent emits, for 0.11 helpfulness points. Measuring factual disclosure is harder: a word-overlap metric and an LLM judge both report that mediation leaves facts intact, and both disagree with blind human annotation (kappa = 0.25 and 0.09). The human labels reverse that: inferability falls from 100% to 24-53% under mediation, so semantic-leakage measures need human validation before they are trusted. These are systems results on English text with open-weight models, not formal guarantees.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 18 of its 45 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

18 of 45 references.

References · 18

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  5. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  6. 2020Extracting Training Data from Large Language Modelscited by 2,144
  7. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  8. 2021Ethical and social risks of harm from Language Modelscited by 957
  9. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
  10. 2023Extracting Training Data from Diffusion Modelscited by 723
  11. 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 278
  12. 2024PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Actioncited by 161
6 more
  1. 2022The Text Anonymization Benchmark (TAB): A Dedicated Corpus and Evaluation Framework for Text Anonymizationcited by 94
  2. 2016De-identification of Patient Notes with Recurrent Neural Networkscited by 88
  3. 2024PAPILLON: Privacy Preservation from Internet-based and Local Language Model Ensemblescited by 54
  4. 2023Reducing Privacy Risks in Online Self-Disclosures with Language Modelscited by 47
  5. 2024PrivacyRestore: Privacy-Preserving Inference in Large Language Models via Privacy Removal and Restorationcited by 27
  6. 2024Rescriber: Smaller-LLM-Powered User-Led Data Minimization for LLM-Based Chatbotscited by 16

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026OCELOT: Inference-Leakage Budgets for Privacy-Preserving LLM Agents
  2. 2026LLM-Redactor: An Empirical Evaluation of Eight Techniques for Privacy-Preserving LLM Requests
  3. 2026Privacy-Preserving RAG via Multi-Agent Semantic Rewriting: Achieving Confidentiality Without Compromising Contextual Fidelity
  4. 2026CIPL: A Channel-Aware Framework for Recoverable Privacy Leakage in LLM Agents
  5. 20251-2-3 Check: Enhancing Contextual Privacy in LLM via Multi-Agent Reasoning
  6. 2026Observable Channels, Not Just Storage: Evaluating Privacy Leakage in LLM Agent Pipelines
  7. 2026The Claws in Plain Sight: Unauthorized Context Disclosure through LLM Agent Tool Calls
  8. 2026PrivAct: Internalizing Contextual Privacy Preservation via Multi-Agent Preference Training