TextCloak: Thwarting Unauthorized LLM Exploitation via RL-Driven Unlearnable Text
Not on the map. Why?
Abstract (arXiv)
The rapid development of Large Language Models (LLMs) has led to significant advances across a wide range of language tasks, while simultaneously raising growing concerns about unauthorized data exploitation and privacy leakage. Unlearnable examples (UEs) offer a promising defense by introducing carefully designed perturbations into data such that models trained on them exhibit degraded utility. However, existing methods for text protection are primarily designed for classification tasks (e.g., sentiment analysis) in discriminative language models and often rely on injecting class-specific linguistic cues, which limits their effectiveness in the open-ended generation settings of LLMs. In this work, we propose TextCloak, an RL-driven framework for protecting textual data against unauthorized LLM exploitation. TextCloak employs a generative policy that transforms batches of clean text into unlearnable examples while preserving semantic fidelity and linguistic naturalness. To optimize the policy, we introduce GRPO-UE, which rewards generated unlearnable text based on the downstream degradation they induce in fine-tuned surrogate LLMs and updates the generator parameters via group-relative policy optimization. This bi-level optimization enables the generator to discover generalizable protective patterns beyond class-specific cues. Comprehensive experiments on six publicly available datasets and nine state-of-the-art LLMs demonstrate that TextCloak consistently impairs unauthorized fine-tuning while maintaining text utility for legitimate use. Further analyses establish its transferability and robustness across model architectures, training configurations, and adaptive attacks, highlighting its broad applicability as a practical defense against unauthorized LLM exploitation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 43 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
38 of 43 references.
References · 38
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2023Mistral 7Bcited by 3,065
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
26 more
- 2025Gemma 3 Technical Reportcited by 1,686
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
- 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
- 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
- 2024Phi-4 Technical Reportcited by 675
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
- 2022Deduplicating Training Data Mitigates Privacy Risks in Language Modelscited by 309
- 2017Certified Defenses for Data Poisoning Attackscited by 288
- 2023Large Language Model Unlearningcited by 288
- 2023Poisoning Language Models During Instruction Tuningcited by 254
- 2021Unlearnable Examples: Making Personal Data Unexploitablecited by 188
- 2023Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injectioncited by 143
- 2023A Survey of Text Watermarking in the Era of Large Language Modelscited by 102
- 2023Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Modelscited by 100
- 2023REMARK-LLM: A Robust and Efficient Watermarking Framework for Generative Large Language Modelscited by 64
- 2025Is Chain-of-Thought Reasoning of LLMs a Mirage? A Data Distribution Lenscited by 42
- 2022Transferable Unlearnable Examplescited by 41
- 2022Unlearnable Clusters: Towards Label-agnostic Unlearnable Examplescited by 35
- 2022Robust Unlearnable Examples: Protecting Data Against Adversarial Learningcited by 34
- 2024Multimodal Unlearnable Examples: Protecting Data against Multimodal Contrastive Learningcited by 21
- 2025Permissioned LLMs: Enforcing Access Control in Large Language Modelscited by 7
- 2024Towards Operationalizing Right to Data Protectioncited by 3
- 2024ExpShield: Safeguarding Web Text from Unauthorized Crawling and LLM Exploitationcited by 3
- 2026To See is Not to Learn: Protecting Multimodal Data from Unauthorized Fine-Tuning of Large Vision-Language Modelcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Models
- 2024Jailbreaking Large Language Models Through Alignment Vulnerabilities in Out-of-Distribution Settings
- 2026Operationalising the Right to be Forgotten in LLMs: A Lightweight Sequential Unlearning Framework for Privacy-Aligned Deployment in Politically Sensitive Environments
- 2024Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench
- 2026Towards Privacy-Preserving Large Language Model: Text-free Inference Through Alignment and Adaptation
- 2026Rendering Data Unlearnable by Exploiting LLM Alignment Mechanisms
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly
- 2024Fortifying Ethical Boundaries in AI: Advanced Strategies for Enhancing Security in Large Language Models