mlsanityData to 14 Oct 2026

ExpShield: Safeguarding Web Text from Unauthorized Crawling and LLM Exploitation

arXiv 2412.21123 ↗First posted 30 Dec 2024cs.CRcited by 3

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

As large language models increasingly memorize web-scraped training content, they risk exposing copyrighted or private information. Existing protections require compliance from crawlers or model developers, fundamentally limiting their effectiveness. We propose ExpShield, a proactive self-guard that mitigates memorization while maintaining readability via invisible perturbations, and we formulate it as a constrained optimization problem. Due to the lack of an individual-level risk metric for natural text, we first propose instance exploitation, a metric that measures how much training on a specific text increases the chance of guessing that text from a set of candidates-with zero indicating perfect defense. Directly solving the problem is infeasible for defenders without sufficient knowledge, thus we develop two effective proxy solutions: single-level optimization and synthetic perturbation. To enhance the defense, we reveal and verify the memorization trigger hypothesis, which can help to identify key tokens for memorization. Leveraging this insight, we design targeted perturbations that (i) neutralize inherent trigger tokens to reduce memorization and (ii) introduce artificial trigger tokens to misdirect model memorization. Experiments validate our defense across attacks, model scales, and tasks in language and vision-to-language modeling. Even with privacy backdoor, the Membership Inference Attack (MIA) AUC drops from 0.95 to 0.55 under the defense, and the instance exploitation approaches zero. This suggests that compared to the ideal no-misuse scenario, the risk of exposing a text instance remains nearly unchanged despite its inclusion in the training data.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 52 of its 75 references that are in the map. First posted on arXiv 30 Dec 2024.

Builds on

52 of 75 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  7. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  8. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  9. 2016Deep Learning with Differential Privacycited by 2,728
  10. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  11. 2020Extracting Training Data from Large Language Modelscited by 2,189
  12. 2021Membership Inference Attacks From First Principlescited by 878
38 more
  1. 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 864
  2. 2020Aligning AI With Shared Human Valuescited by 723
  3. 2024Large Language Models: A Surveycited by 525
  4. 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 434
  5. 2021Large Language Models Can Be Strong Differentially Private Learnerscited by 412
  6. 2021Differentially Private Fine-tuning of Language Modelscited by 400
  7. 2023Detecting Pretraining Data from Large Language Modelscited by 387
  8. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 372
  9. 2022Deduplicating Training Data Mitigates Privacy Risks in Language Modelscited by 314
  10. 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 285
  11. 2021Unlearnable Examples: Making Personal Data Unexploitablecited by 193
  12. 2023A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicitycited by 182
  13. 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 161
  14. 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakagecited by 150
  15. 2022Reconstructing Training Data with Informed Adversariescited by 148
  16. 2022The Privacy Onion Effect: Memorization is Relativecited by 136
  17. 2021Adversarial Examples Make Strong Poisonscited by 119
  18. 2023Foundation Models and Fair Usecited by 116
  19. 2022Position: Considerations for Differentially Private Learning with Large-Scale Public Pretrainingcited by 88
  20. 2021Differential Privacy for Text Analytics via Natural Text Sanitizationcited by 77
  21. 2021Bad Characters: Imperceptible NLP Attackscited by 71
  22. 2021Availability Attacks Create Shortcutscited by 62
  23. 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 51
  24. 2024Learn What You Want to Unlearn: Unlearning Inversion Attacks against Machine Unlearningcited by 48
  25. 2022Transferable Unlearnable Examplescited by 43
  26. 2019Differentially Private Meta-Learningcited by 41
  27. 2024Measuring memorization in language models via probabilistic extractioncited by 41
  28. 2024Proving membership in LLM pretraining data via data watermarkscited by 40
  29. 2023The Janus Interface: How Fine-Tuning in Large Language Models Amplifies the Privacy Riskscited by 36
  30. 2022Robust Unlearnable Examples: Protecting Data Against Adversarial Learningcited by 35
  31. 2024Privacy Backdoors: Enhancing Membership Inference through Poisoning Pre-trained Modelscited by 30
  32. 2023DP-BART for Privatized Text Rewriting under Local Differential Privacycited by 28
  33. 2023Stable Unlearnable Example: Enhancing the Robustness of Unlearnable Examples via Stable Error-Minimizing Noisecited by 25
  34. 2024Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Modelscited by 24
  35. 2024PreCurious: How Innocent Pre-Trained Language Models Turn into Privacy Trapscited by 23
  36. 2024Can Watermarking Large Language Models Prevent Copyrighted Text Generation and Hide Training Data?cited by 18
  37. 2024Exploring Memorization and Copyright Violation in Frontier LLMs: A Study of the New York Times v. OpenAI 2023 Lawsuitcited by 18
  38. 2024Unlearn and Burn: Adversarial Machine Unlearning Requests Destroy Model Accuracycited by 17

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026CopyShield: A Cross-Level Benchmark of Copyright Defenses in LLMs
  2. 2026When Optimization Becomes Manipulation: Defending Generative Search against Malicious Generative Engine Optimization
  3. 2025Robustness via Referencing: Defending against Prompt Injection Attacks by Referencing the Executed Instruction
  4. 2026Out of Sight: Compression-Aware Content Protection against Agentic Crawlers
  5. 2026BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser Views
  6. 2026Overcoming the Retrieval Barrier: Indirect Prompt Injection in the Wild for LLM Systems
  7. 2024Undesirable Memorization in Large Language Models: A Survey
  8. 2025Exploiting Web Search Tools of AI Agents for Data Exfiltration