ExpShield: Safeguarding Web Text from Unauthorized Crawling and LLM Exploitation
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
As large language models increasingly memorize web-scraped training content, they risk exposing copyrighted or private information. Existing protections require compliance from crawlers or model developers, fundamentally limiting their effectiveness. We propose ExpShield, a proactive self-guard that mitigates memorization while maintaining readability via invisible perturbations, and we formulate it as a constrained optimization problem. Due to the lack of an individual-level risk metric for natural text, we first propose instance exploitation, a metric that measures how much training on a specific text increases the chance of guessing that text from a set of candidates-with zero indicating perfect defense. Directly solving the problem is infeasible for defenders without sufficient knowledge, thus we develop two effective proxy solutions: single-level optimization and synthetic perturbation. To enhance the defense, we reveal and verify the memorization trigger hypothesis, which can help to identify key tokens for memorization. Leveraging this insight, we design targeted perturbations that (i) neutralize inherent trigger tokens to reduce memorization and (ii) introduce artificial trigger tokens to misdirect model memorization. Experiments validate our defense across attacks, model scales, and tasks in language and vision-to-language modeling. Even with privacy backdoor, the Membership Inference Attack (MIA) AUC drops from 0.95 to 0.55 under the defense, and the instance exploitation approaches zero. This suggests that compared to the ideal no-misuse scenario, the risk of exposing a text instance remains nearly unchanged despite its inclusion in the training data.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 52 of its 75 references that are in the map. First posted on arXiv 30 Dec 2024.
Builds on
52 of 75 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2016Deep Learning with Differential Privacycited by 2,728
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2021Membership Inference Attacks From First Principlescited by 878
38 more
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 864
- 2020Aligning AI With Shared Human Valuescited by 723
- 2024Large Language Models: A Surveycited by 525
- 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 434
- 2021Large Language Models Can Be Strong Differentially Private Learnerscited by 412
- 2021Differentially Private Fine-tuning of Language Modelscited by 400
- 2023Detecting Pretraining Data from Large Language Modelscited by 387
- 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 372
- 2022Deduplicating Training Data Mitigates Privacy Risks in Language Modelscited by 314
- 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 285
- 2021Unlearnable Examples: Making Personal Data Unexploitablecited by 193
- 2023A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicitycited by 182
- 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 161
- 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakagecited by 150
- 2022Reconstructing Training Data with Informed Adversariescited by 148
- 2022The Privacy Onion Effect: Memorization is Relativecited by 136
- 2021Adversarial Examples Make Strong Poisonscited by 119
- 2023Foundation Models and Fair Usecited by 116
- 2022Position: Considerations for Differentially Private Learning with Large-Scale Public Pretrainingcited by 88
- 2021Differential Privacy for Text Analytics via Natural Text Sanitizationcited by 77
- 2021Bad Characters: Imperceptible NLP Attackscited by 71
- 2021Availability Attacks Create Shortcutscited by 62
- 2022SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learningcited by 51
- 2024Learn What You Want to Unlearn: Unlearning Inversion Attacks against Machine Unlearningcited by 48
- 2022Transferable Unlearnable Examplescited by 43
- 2019Differentially Private Meta-Learningcited by 41
- 2024Measuring memorization in language models via probabilistic extractioncited by 41
- 2024Proving membership in LLM pretraining data via data watermarkscited by 40
- 2023The Janus Interface: How Fine-Tuning in Large Language Models Amplifies the Privacy Riskscited by 36
- 2022Robust Unlearnable Examples: Protecting Data Against Adversarial Learningcited by 35
- 2024Privacy Backdoors: Enhancing Membership Inference through Poisoning Pre-trained Modelscited by 30
- 2023DP-BART for Privatized Text Rewriting under Local Differential Privacycited by 28
- 2023Stable Unlearnable Example: Enhancing the Robustness of Unlearnable Examples via Stable Error-Minimizing Noisecited by 25
- 2024Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Modelscited by 24
- 2024PreCurious: How Innocent Pre-Trained Language Models Turn into Privacy Trapscited by 23
- 2024Can Watermarking Large Language Models Prevent Copyrighted Text Generation and Hide Training Data?cited by 18
- 2024Exploring Memorization and Copyright Violation in Frontier LLMs: A Study of the New York Times v. OpenAI 2023 Lawsuitcited by 18
- 2024Unlearn and Burn: Adversarial Machine Unlearning Requests Destroy Model Accuracycited by 17
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026CopyShield: A Cross-Level Benchmark of Copyright Defenses in LLMs
- 2026When Optimization Becomes Manipulation: Defending Generative Search against Malicious Generative Engine Optimization
- 2025Robustness via Referencing: Defending against Prompt Injection Attacks by Referencing the Executed Instruction
- 2026Out of Sight: Compression-Aware Content Protection against Agentic Crawlers
- 2026BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser Views
- 2026Overcoming the Retrieval Barrier: Indirect Prompt Injection in the Wild for LLM Systems
- 2024Undesirable Memorization in Large Language Models: A Survey
- 2025Exploiting Web Search Tools of AI Agents for Data Exfiltration