mlsanityData to 7 Oct 2026

Foundation Models and Fair Use

arXiv 2303.15715 ↗First posted 28 Mar 2023cs.CY cs.AI cs.LGcited by 112

Not on the map. Why?

Cited by 25 in LLM safety and security, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Existing foundation models are trained on copyrighted material. Deploying these models can pose both legal and ethical risks when data creators fail to receive appropriate attribution or compensation. In the United States and several other countries, copyrighted content may be used to build foundation models without incurring liability due to the fair use doctrine. However, there is a caveat: If the model produces output that is similar to copyrighted data, particularly in scenarios that affect the market of that data, fair use may no longer apply to the output of the model. In this work, we emphasize that fair use is not guaranteed, and additional work may be necessary to keep model development and deployment squarely in the realm of fair use. First, we survey the potential risks of developing and deploying foundation models based on copyrighted content. We review relevant U.S. case law, drawing parallels to existing and potential applications for generating text, source code, and visual art. Experiments confirm that popular foundation models can generate content considerably similar to copyrighted material. Second, we discuss technical mitigations that can help foundation models stay in line with fair use. We argue that more research is needed to align mitigation strategies with the current state of the law. Lastly, we suggest that the law and technical mitigations should co-evolve. For example, coupled with other policy mechanisms, the law could more explicitly consider safe harbors when strong technical tools are used to mitigate infringement harms. This co-evolution may help strike a balance between intellectual property and innovation, which speaks to the original goal of fair use. But we emphasize that the strategies we describe here are not a panacea and more work is needed to develop policies that address the potential harms of foundation models.

Key facts. Cited by 112 papers in the map (data through 7 Oct 2026). Builds on 68 of its 144 references that are in the map. First posted on arXiv 28 Mar 2023.

Builds on

68 of 144 references.

References · 68

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2023GPT-4 Technical Reportcited by 18,132
  6. 2022Training language models to follow instructions with human feedbackcited by 15,712
  7. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  8. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  9. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  10. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  11. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  12. 2017Deep reinforcement learning from human preferencescited by 3,846
38 more
  1. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  2. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  3. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  5. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  6. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  7. 2020Extracting Training Data from Large Language Modelscited by 2,144
  8. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  9. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  10. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  11. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  12. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
  13. 2019Machine Unlearningcited by 1,020
  14. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  15. 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
  16. 2022Quantifying Memorization Across Neural Language Modelscited by 755
  17. 2023Extracting Training Data from Diffusion Modelscited by 723
  18. 2021Deduplicating Training Data Makes Language Models Bettercited by 705
  19. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
  20. 2020What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimationcited by 492
  21. 2017Interpretation of Neural Networks is Fragilecited by 443
  22. 2020Artificial Intelligence, Values and Alignmentcited by 443
  23. 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
  24. 2021Large Language Models Can Be Strong Differentially Private Learnerscited by 405
  25. 2021Differentially Private Fine-tuning of Language Modelscited by 392
  26. 2022The Stack: 3 TB of permissively licensed source codecited by 354
  27. 2019The many Shapley values for model explanationcited by 341
  28. 2022Deduplicating Training Data Mitigates Privacy Risks in Language Modelscited by 309
  29. 2021Unsolved Problems in ML Safetycited by 291
  30. 2019Towards Efficient Data Valuation Based on the Shapley Valuecited by 279
  31. 2014RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Responsecited by 262
  32. 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 259
  33. 2020Influence Functions in Deep Learning Are Fragilecited by 247
  34. 2022Unlocking High-Accuracy Differentially Private Image Classification through Scalecited by 218
  35. 2022Predictability and Surprise in Large Generative Modelscited by 209
  36. 2022Datamodels: Predicting Predictions from Training Datacited by 186
  37. 2021Counterfactual Memorization in Neural Language Modelscited by 155
  38. 2017Collecting Telemetry Data Privatelycited by 147

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 26; 2024: 42; 2025: 30; 2026: 14.

112 papers.

Sort:

By area:

  1. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
  2. 2023StarCoder: may the source be with you!cited by 790
  3. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
  4. 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 394
  5. 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Modelscited by 251
  6. 2023In-Context Unlearning: Language Models as Few Shot Unlearnerscited by 214
  7. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
  8. 2023Can LLM-Generated Misinformation Be Detected?cited by 173
  9. 2023Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attackscited by 156
  10. 2023Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4cited by 123
  11. 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
  12. 2023On the Exploitability of Instruction Tuningcited by 110
38 more
  1. 2023Art and the science of generative AI: A deeper divecited by 93
  2. 2024Data Shapley in One Training Runcited by 76
  3. 2023The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AIcited by 73
  4. 2024Reliable, Adaptable, and Attributable Language Models with Retrievalcited by 73
  5. 2023SILO Language Models: Isolating Legal Risk In a Nonparametric Datastorecited by 71
  6. 2024On the Societal Impact of Open Foundation Modelscited by 64
  7. 2025Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignmentcited by 62
  8. 2023MultiLegalPile: A 689GB Multilingual Legal Corpuscited by 59
  9. 2024A Safe Harbor for AI Evaluation and Red Teamingcited by 46
  10. 2024Consent in Crisis: The Rapid Decline of the AI Data Commonscited by 45
  11. 2024Evaluating Copyright Takedown Methods for Language Modelscited by 42
  12. 2023SoK: Memorization in General-Purpose Large Language Modelscited by 36
  13. 2023Anticipatory Music Transformercited by 35
  14. 2024CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generationcited by 35
  15. 2023Spellburst: A Node-based Interface for Exploratory Creative Coding with Natural Language Promptscited by 30
  16. 2024Undesirable Memorization in Large Language Models: A Surveycited by 29
  17. 2024Mask-based Membership Inference Attacks for Retrieval-Augmented Generationcited by 29
  18. 2023Can Copyright be Reduced to Privacy?cited by 24
  19. 2024Fantastic Copyrighted Beasts and How (Not) to Generate Themcited by 23
  20. 2024Generative AI in EU Law: Liability, Privacy, Intellectual Property, and Cybersecuritycited by 21
  21. 2024Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuningcited by 21
  22. 2024An Economic Solution to Copyright Challenges of Generative AIcited by 18
  23. 2023ViP: A Differentially Private Foundation Model for Computer Visioncited by 17
  24. 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
  25. 2024Towards Fair RAG: On the Impact of Fair Ranking in Retrieval-Augmented Generationcited by 15
  26. 2025FlexOlmo: Open Language Models for Flexible Data Usecited by 14
  27. 2024LiCoEval: Evaluating LLMs on License Compliance in Code Generationcited by 13
  28. 2024Detecting Training Data of Large Language Models via Expectation Maximizationcited by 13
  29. 2024Acceptable Use Policies for Foundation Modelscited by 12
  30. 2024Replication in Visual Diffusion Models: A Survey and Outlookcited by 11
  31. 2025AI Safety Should Prioritize the Future of Workcited by 11
  32. 2023Reinforcement Learning for Generative AI: State of the Art, Opportunities and Open Research Challengescited by 10
  33. 2024Not All Similarities Are Created Equal: Leveraging Data-Driven Biases to Inform GenAI Copyright Disputescited by 10
  34. 2024JIGMARK: A Black-Box Approach for Enhancing Image Watermarks against Diffusion Model Editscited by 9
  35. 2024Statistical inference on black-box generative models in the data kernel perspective spacecited by 9
  36. 2025The Landscape of Memorization in LLMs: Mechanisms, Measurement, and Mitigationcited by 9
  37. 2023Shattering the Agent-Environment Interface for Fine-Tuning Inclusive Language Modelscited by 8
  38. 2024On Fairness of Low-Rank Adaptation of Large Modelscited by 8

50 most cited of 112 All 112 (JSON)