BinaryShield: Cross-Service Threat Intelligence in LLM Services using Privacy-Preserving Fingerprints
Not on the map. Why?
Abstract (arXiv)
The widespread deployment of LLMs across enterprise services has created a critical security blind spot. Organizations operate multiple LLM services handling billions of queries daily, yet regulatory compliance boundaries prevent these services from sharing threat intelligence about prompt injection attacks, the top security risk for LLMs. When an attack is detected in one service, the same threat may persist undetected in others for months, as privacy regulations prohibit sharing user prompts across compliance boundaries. We present BinaryShield, the first privacy-preserving threat intelligence system that enables secure sharing of attack fingerprints across compliance boundaries. BinaryShield transforms suspicious prompts through a unique pipeline combining PII redaction, semantic embedding, binary quantization, and randomized response mechanism to potentially generate privacy-preserving fingerprints that preserve attack patterns while providing privacy. Our evaluations demonstrate that BinaryShield achieves an F1-score of 0.94, significantly outperforming SimHash (0.77), the privacy-preserving baseline, while achieving storage reduction and 38x faster similarity search compared to dense embeddings.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 47 of its 61 references that are in the map. First posted on arXiv 6 Sep 2025.
Builds on
47 of 61 references.
References · 47
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
- 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
- 2023Catastrophic Jailbreak of Open-source LLMs via Exploiting Generationcited by 451
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
- 2024Improving Alignment and Robustness with Circuit Breakerscited by 322
- 2025Defeating Prompt Injections by Designcited by 297
35 more
- 2014RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Responsecited by 272
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 267
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 264
- 2023Multilingual Jailbreak Challenges in Large Language Modelscited by 240
- 2024JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attackscited by 230
- 2024WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Modelscited by 223
- 2018Improving the Gaussian Mechanism for Differential Privacy: Analytical Calibration and Optimal Denoisingcited by 218
- 2023MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbotscited by 183
- 2017Collecting Telemetry Data Privatelycited by 149
- 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 143
- 2018Protection Against Reconstruction and Its Applications in Private Federated Learningcited by 130
- 2025Securing AI Agents with Information-Flow Controlcited by 121
- 2023Effective Prompt Extraction from Language Modelscited by 85
- 2023Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Recover the Whole Sentencecited by 81
- 2024Differentially Private Synthetic Data via Foundation Model APIs 2: Textcited by 76
- 2025Design Patterns for Securing LLM Agents against Prompt Injectionscited by 73
- 2024Get my drift? Catching LLM Task Drift with Activation Deltascited by 72
- 2024RigorLLM: Resilient Guardrails for Large Language Models against Undesired Contentcited by 68
- 2017Prochlo: Strong Privacy for Analytics in the Crowdcited by 51
- 2023SoK: Privacy-Preserving Data Synthesiscited by 38
- 2022Optimal Algorithms for Mean Estimation under Local Differential Privacycited by 36
- 2014Differential Privacy: An Economic Method for Choosing Epsiloncited by 35
- 2024SafeEar: Content Privacy-Preserving Audio Deepfake Detectioncited by 21
- 2025LLMail-Inject: A Dataset from a Realistic Adaptive Prompt Injection Challengecited by 21
- 2015Building a RAPPOR with the Unknown: Privacy-Preserving Learning of Associations and Data Dictionariescited by 16
- 2022Sentence-level Privacy for Document Embeddingscited by 16
- 2021Concurrent Composition of Differential Privacycited by 12
- 2024SOS! Soft Prompt Attack Against Open-Source Large Language Modelscited by 10
- 2025A Representation Engineering Perspective on the Effectiveness of Multi-Turn Jailbreakscited by 10
- 2025Advancing Semantic Caching for LLMs with Domain-Specific Embeddings and Synthetic Datacited by 7
- 2021BRR: Preserving Privacy of Text Data Efficiently on Devicecited by 6
- 2025JailbreaksOverTime: Detecting Jailbreak Attacks Under Distribution Shiftcited by 5
- 2023A Neighbourhood-Aware Differential Privacy Mechanism for Static Word Embeddingscited by 4
- 2025Information Leakage of Sentence Embeddings via Generative Embedding Inversion Attackscited by 3
- 2024Differential Privacy Overview and Fundamental Techniquescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026LLM-Redactor: An Empirical Evaluation of Eight Techniques for Privacy-Preserving LLM Requests
- 2026aiXamine: Unified Black-Box Evaluation of Cross-Dimensional Trade-offs in LLM Safety, Security, and Privacy
- 2026Securing LLMs in the Wild: Privacy and Security Challenges at the Edge
- 2025PrivacyXray: Detecting Privacy Breaches in LLMs through Semantic Consistency and Probability Certainty
- 2025Multi-Stage Prompt Inference Attacks on Enterprise LLM Systems
- 2025SOFT: Selective Data Obfuscation for Protecting LLM Fine-tuning against Membership Inference Attacks
- 2026On the Privacy of LLMs: An Ablation Study
- 2025CTIGuardian: A Few-Shot Framework for Mitigating Privacy Leakage in Fine-Tuned LLMs