mlsanityData to 7 Oct 2026

Rendering Data Unlearnable by Exploiting LLM Alignment Mechanisms

arXiv 2601.03401 ↗First posted 6 Jan 2026cs.CLcited by 1

On the map: LLM alignment / RLHF / preference optimisation → LLM preference optimization methods

Abstract (arXiv)

Large language models (LLMs) are increasingly trained on massive, heterogeneous text corpora, raising serious concerns about the unauthorised use of proprietary or personal data during model training. In this work, we address the problem of data protection against unwanted model learning in a realistic black-box setting. We propose Disclaimer Injection, a novel data-level defence that renders text unlearnable to LLMs. Rather than relying on model-side controls or explicit data removal, our approach exploits the models' own alignment mechanisms: by injecting carefully designed alignment-triggering disclaimers to prevent effective learning. Through layer-wise analysis, we find that fine-tuning on such protected data induces persistent activation of alignment-related layers, causing alignment constraints to override task learning even on common inputs. Consequently, models trained on such data exhibit substantial and systematic performance degradation compared to standard fine-tuning. Our results identify alignment behaviour as a previously unexplored lever for data protection and, to our knowledge, present the first practical method for restricting data learnability at LLM scale without requiring access to or modification of the training pipeline.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in LLM preference optimization methods, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 31 of its 50 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

31 of 50 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Training language models to follow instructions with human feedback4 Mar

Other references · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2020Scaling Laws for Neural Language Modelscited by 6,411
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  6. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  7. 2017Deep reinforcement learning from human preferencescited by 3,846
  8. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  9. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  10. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  11. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  12. 2020Learning to summarize from human feedbackcited by 2,562
18 more
  1. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  2. 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 886
  3. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
  4. 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
  5. 2018Generating Natural Language Adversarial Examplescited by 422
  6. 2020BAE: BERT-based Adversarial Examples for Text Classificationcited by 316
  7. 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
  8. 2021Unlearnable Examples: Making Personal Data Unexploitablecited by 188
  9. 2018Seq2Sick: Evaluating the Robustness of Sequence-to-Sequence Models with Adversarial Examplescited by 93
  10. 2022Unlearnable Clusters: Towards Label-agnostic Unlearnable Examplescited by 35
  11. 2021Scaling Laws for Deep Learningcited by 25
  12. 2024LLMScan: Causal Scan for LLM Misbehavior Detectioncited by 13
  13. 2024Certified Robust Accuracy of Neural Networks Are Bounded due to Bayes Errorscited by 7
  14. 2025EVOREFUSE: Evolutionary Prompt Optimization for Evaluation and Mitigation of LLM Over-Refusal to Pseudo-Malicious Instructionscited by 6
  15. 2025Scrapers selectively respect robots.txt directives: evidence from a large-scale empirical studycited by 5
  16. 2022Revision for Concision: A Constrained Paraphrase Generation Taskcited by 4
  17. 2022Universal Evasion Attacks on Summarization Scoringcited by 2
  18. 2025De mythe van ge"informeerde toestemming: online privacybescherming kan beter [Informed Consent: We Can Do Better to Defend Privacy]cited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Alignment Defends LLMs from Property Inference Attacks
  2. 2025Align-then-Unlearn: Embedding Alignment for LLM Unlearning
  3. 2025Differentially Private Steering for Large Language Model Alignment
  4. 2026Beyond Shapley: An Influence-Based Data Auditing Pipeline for LLM Alignment and Evaluation
  5. 2024Robustifying Safety-Aligned Large Language Models through Clean Data Curation
  6. 2025Towards Efficient and Effective Alignment of Large Language Models
  7. 2023On the Safety of Open-Sourced Large Language Models: Does Alignment Really Prevent Them From Being Misused?
  8. 2026Safeguarding LLM Fine-tuning via Push-Pull Distributional Alignment