mlsanityData to 14 Oct 2026

Alignment Whack-a-Mole : Finetuning Activates Verbatim Recall of Copyrighted Books in Large Language Models

arXiv 2603.20957 ↗First posted 21 Mar 2026cs.CL cs.AI cs.CYcited by 6

On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks

Abstract (arXiv)

Frontier LLM companies have repeatedly assured courts and regulators that their models do not store copies of training data. They further rely on safety alignment strategies via RLHF, system prompts, and output filters to block verbatim regurgitation of copyrighted works, and have cited the efficacy of these measures in their legal defenses against copyright infringement claims. We show that finetuning bypasses these protections: by training models to expand plot summaries into full text, a task naturally suited for commercial writing assistants, we cause GPT-4o, Gemini-2.5-Pro, and DeepSeek-V3.1 to reproduce up to 85-90% of held-out copyrighted books, with single verbatim spans exceeding 460 words, using only semantic descriptions as prompts and no actual book text. This extraction generalizes across authors: finetuning exclusively on Haruki Murakami's novels unlocks verbatim recall of copyrighted books from over 30 unrelated authors. The effect is not specific to any training author or corpus: random author pairs and public-domain finetuning data produce comparable extraction, while finetuning on synthetic text yields near-zero extraction, indicating that finetuning on individual authors' works reactivates latent memorization from pretraining. Three models from different providers memorize the same books in the same regions (r ≥ 0.90), pointing to an industry-wide vulnerability. Our findings offer compelling evidence that model weights store copies of copyrighted works and that the security failures that manifest after finetuning on individual authors' works undermine a key premise of recent fair use rulings, where courts have conditioned favorable outcomes on the adequacy of measures preventing reproduction of protected expression.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 34 of its 62 references that are in the map. First posted on arXiv 21 Mar 2026.

Builds on

34 of 62 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!5 Oct

Other references · 33

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  5. 2020Extracting Training Data from Large Language Modelscited by 2,189
  6. 2022Quantifying Memorization Across Neural Language Modelscited by 763
  7. 2021Deduplicating Training Data Makes Language Models Bettercited by 714
  8. 2024DataComp-LM: In search of the next generation of training sets for language modelscited by 398
  9. 2023Detecting Pretraining Data from Large Language Modelscited by 387
  10. 2022Deduplicating Training Data Mitigates Privacy Risks in Language Modelscited by 314
  11. 2024Do Membership Inference Attacks Work on Large Language Models?cited by 195
  12. 2024Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokenscited by 153
21 more
  1. 2023Emergent and Predictable Memorization in Large Language Modelscited by 148
  2. 2023Foundation Models and Fair Usecited by 116
  3. 2023Talkin' 'Bout AI Generation: Copyright and the Generative-AI Supply Chaincited by 46
  4. 2024CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generationcited by 35
  5. 2024Alpaca against Vicuna: Using LLMs to Uncover Memorization of LLMscited by 33
  6. 2025Extracting memorized pieces of (copyrighted) books from open-weight language modelscited by 30
  7. 2024The Files are in the Computer: On Copyright, Memorization, and Generative AIcited by 21
  8. 2024Mixture of Parrots: Experts improve memorization more than reasoningcited by 21
  9. 2025Hubble: a Model Suite to Advance the Study of LLM Memorizationcited by 17
  10. 2026Extracting books from production language modelscited by 17
  11. 2024LLMs and Memorization: On Quality and Specificity of Copyright Compliancecited by 16
  12. 2024Verifiable by Design: Aligning Language Models to Quote from Pre-Training Datacited by 13
  13. 2026Replaying pre-training data improves fine-tuningcited by 13
  14. 2024The Mosaic Memory of Large Language Modelscited by 10
  15. 2025Privacy Ripple Effects from Adding or Removing Personal Information in Language Model Trainingcited by 10
  16. 2025Parameterized Synthetic Text Generation with SimpleStoriescited by 10
  17. 2026Can Good Writing Be Generative? Expert-Level AI Writing Emerges through Fine-Tuning on High-Quality Bookscited by 9
  18. 2025Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Modelscited by 8
  19. 2025Readers Prefer Outputs of AI Trained on Copyrighted Books over Expert Human Writerscited by 8
  20. 2026Privacy Collapse: Benign Fine-Tuning Can Break Contextual Privacy in Language Modelscited by 6
  21. 2024Training Foundation Models as Data Compression: On Information, Model Weights and Copyright Lawcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Probing Stylistic Appropriation using Large Language Models: An Evaluation Framework for Copyright Infringement under EU Law
  2. 2026CopyShield: A Cross-Level Benchmark of Copyright Defenses in LLMs
  3. 2024Avoiding Copyright Infringement via Large Language Model Unlearning
  4. 2025Obliviate: Efficient Unmemorization for Protecting Intellectual Property in Large Language Models
  5. 2025Bridging the Copyright Gap: Do Large Vision-Language Models Recognize and Respect Copyrighted Content?
  6. 2026On the Evidentiary Limits of Membership Inference for Copyright Auditing
  7. 2024Investigating the Feasibility of Mitigating Potential Copyright Infringement via Large Language Model Unlearning
  8. 2025RECAP: Reproducing Copyrighted Data from LLMs Training with an Agentic Pipeline