Foundation Models and Fair Use
Not on the map. Why?
Cited by 25 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Existing foundation models are trained on copyrighted material. Deploying these models can pose both legal and ethical risks when data creators fail to receive appropriate attribution or compensation. In the United States and several other countries, copyrighted content may be used to build foundation models without incurring liability due to the fair use doctrine. However, there is a caveat: If the model produces output that is similar to copyrighted data, particularly in scenarios that affect the market of that data, fair use may no longer apply to the output of the model. In this work, we emphasize that fair use is not guaranteed, and additional work may be necessary to keep model development and deployment squarely in the realm of fair use. First, we survey the potential risks of developing and deploying foundation models based on copyrighted content. We review relevant U.S. case law, drawing parallels to existing and potential applications for generating text, source code, and visual art. Experiments confirm that popular foundation models can generate content considerably similar to copyrighted material. Second, we discuss technical mitigations that can help foundation models stay in line with fair use. We argue that more research is needed to align mitigation strategies with the current state of the law. Lastly, we suggest that the law and technical mitigations should co-evolve. For example, coupled with other policy mechanisms, the law could more explicitly consider safe harbors when strong technical tools are used to mitigate infringement harms. This co-evolution may help strike a balance between intellectual property and innovation, which speaks to the original goal of fair use. But we emphasize that the strategies we describe here are not a panacea and more work is needed to develop policies that address the potential harms of foundation models.
Key facts. Cited by 112 papers in the map (data through 7 Oct 2026). Builds on 68 of its 144 references that are in the map. First posted on arXiv 28 Mar 2023.
Builds on
68 of 144 references.
References · 68
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2017Deep reinforcement learning from human preferencescited by 3,846
38 more
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2019Machine Unlearningcited by 1,020
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
- 2022Quantifying Memorization Across Neural Language Modelscited by 755
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2021Deduplicating Training Data Makes Language Models Bettercited by 705
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 617
- 2020What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimationcited by 492
- 2017Interpretation of Neural Networks is Fragilecited by 443
- 2020Artificial Intelligence, Values and Alignmentcited by 443
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2021Large Language Models Can Be Strong Differentially Private Learnerscited by 405
- 2021Differentially Private Fine-tuning of Language Modelscited by 392
- 2022The Stack: 3 TB of permissively licensed source codecited by 354
- 2019The many Shapley values for model explanationcited by 341
- 2022Deduplicating Training Data Mitigates Privacy Risks in Language Modelscited by 309
- 2021Unsolved Problems in ML Safetycited by 291
- 2019Towards Efficient Data Valuation Based on the Shapley Valuecited by 279
- 2014RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Responsecited by 262
- 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 259
- 2020Influence Functions in Deep Learning Are Fragilecited by 247
- 2022Unlocking High-Accuracy Differentially Private Image Classification through Scalecited by 218
- 2022Predictability and Surprise in Large Generative Modelscited by 209
- 2022Datamodels: Predicting Predictions from Training Datacited by 186
- 2021Counterfactual Memorization in Neural Language Modelscited by 155
- 2017Collecting Telemetry Data Privatelycited by 147
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2023: 26; 2024: 42; 2025: 30; 2026: 14.
112 papers.
Sort:
By area:
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
- 2023StarCoder: may the source be with you!cited by 790
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 394
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Modelscited by 251
- 2023In-Context Unlearning: Language Models as Few Shot Unlearnerscited by 214
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
- 2023Can LLM-Generated Misinformation Be Detected?cited by 173
- 2023Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attackscited by 156
- 2023Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4cited by 123
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
- 2023On the Exploitability of Instruction Tuningcited by 110
38 more
- 2023Art and the science of generative AI: A deeper divecited by 93
- 2024Data Shapley in One Training Runcited by 76
- 2023The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AIcited by 73
- 2024Reliable, Adaptable, and Attributable Language Models with Retrievalcited by 73
- 2023SILO Language Models: Isolating Legal Risk In a Nonparametric Datastorecited by 71
- 2024On the Societal Impact of Open Foundation Modelscited by 64
- 2025Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignmentcited by 62
- 2023MultiLegalPile: A 689GB Multilingual Legal Corpuscited by 59
- 2024A Safe Harbor for AI Evaluation and Red Teamingcited by 46
- 2024Consent in Crisis: The Rapid Decline of the AI Data Commonscited by 45
- 2024Evaluating Copyright Takedown Methods for Language Modelscited by 42
- 2023SoK: Memorization in General-Purpose Large Language Modelscited by 36
- 2023Anticipatory Music Transformercited by 35
- 2024CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generationcited by 35
- 2023Spellburst: A Node-based Interface for Exploratory Creative Coding with Natural Language Promptscited by 30
- 2024Undesirable Memorization in Large Language Models: A Surveycited by 29
- 2024Mask-based Membership Inference Attacks for Retrieval-Augmented Generationcited by 29
- 2023Can Copyright be Reduced to Privacy?cited by 24
- 2024Fantastic Copyrighted Beasts and How (Not) to Generate Themcited by 23
- 2024Generative AI in EU Law: Liability, Privacy, Intellectual Property, and Cybersecuritycited by 21
- 2024Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuningcited by 21
- 2024An Economic Solution to Copyright Challenges of Generative AIcited by 18
- 2023ViP: A Differentially Private Foundation Model for Computer Visioncited by 17
- 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
- 2024Towards Fair RAG: On the Impact of Fair Ranking in Retrieval-Augmented Generationcited by 15
- 2025FlexOlmo: Open Language Models for Flexible Data Usecited by 14
- 2024LiCoEval: Evaluating LLMs on License Compliance in Code Generationcited by 13
- 2024Detecting Training Data of Large Language Models via Expectation Maximizationcited by 13
- 2024Acceptable Use Policies for Foundation Modelscited by 12
- 2024Replication in Visual Diffusion Models: A Survey and Outlookcited by 11
- 2025AI Safety Should Prioritize the Future of Workcited by 11
- 2023Reinforcement Learning for Generative AI: State of the Art, Opportunities and Open Research Challengescited by 10
- 2024Not All Similarities Are Created Equal: Leveraging Data-Driven Biases to Inform GenAI Copyright Disputescited by 10
- 2024JIGMARK: A Black-Box Approach for Enhancing Image Watermarks against Diffusion Model Editscited by 9
- 2024Statistical inference on black-box generative models in the data kernel perspective spacecited by 9
- 2025The Landscape of Memorization in LLMs: Mechanisms, Measurement, and Mitigationcited by 9
- 2023Shattering the Agent-Environment Interface for Fine-Tuning Inclusive Language Modelscited by 8
- 2024On Fairness of Low-Rank Adaptation of Large Modelscited by 8
50 most cited of 112 All 112 (JSON)
- 2026Making LLMs Truly Forget: Deep Unlearning by Searching, Selecting, and Severing Knowledge Paths28 Sep 2026
- 2026Rethinking Data Quality for AI-Driven Systems: Evidence from Practitioner Interviews25 Sep 2026
- 2026CopyShield: A Cross-Level Benchmark of Copyright Defenses in LLMs1 Sep 2026
- 2026AI Native Games: A Survey and Roadmap1 Jul 2026
- 2026Market Design for AI: Beyond the Copyright Binary10 Jun 2026
- 2026Efficient and Scalable Provenance Tracking for LLM-Generated Code Snippets27 May 2026
- 2026A governance horizon for ethical-use constraints in open-weight AI models23 May 2026
- 2026The Economics of Model Collapse: Equilibrium, Welfare, and Optimal Provenance Subsidies in Synthetic Data Markets19 May 2026
- 2026Alignment Whack-a-Mole : Finetuning Activates Verbatim Recall of Copyrighted Books in Large Language Models21 Mar 2026
- 2026Permissive-Washing in the Open AI Supply Chain: A Large-Scale Audit of License Integrity9 Feb 2026
- 2026SAU: Sparsity-Aware Unlearning for LLMs via Gradient Masking and Importance Redistribution31 Jan 2026
- 2026GUDA: Counterfactual Group-wise Training Data Attribution for Diffusion Models via Unlearning30 Jan 2026
38 more
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2026On the Evidentiary Limits of Membership Inference for Copyright Auditing19 Jan 2026
- 2025LLMs, Reasoning and Plagiarism18 Dec 2025
- 2025WaterSearch: Exploring Seed Pooling for Improving the Quality-Detectability Trade-off in LLM Watermarking30 Nov 2025
- 2025Forget to Know, Remember to Use: Context-Aware Unlearning for Large Language Models20 Oct 2025
- 2025Auditing Information Disclosure During Large-Scale Gradient-Based Training via Gradient Uniqueness13 Oct 2025
- 2025Leave No TRACE: Black-box Detection of Copyrighted Dataset Usage in Large Language Models via Watermarking3 Oct 2025
- 2025The Surprising Effectiveness of Membership Inference with Simple N-Gram Coverage13 Aug 2025
- 2025Towards Evaluation for Real-World LLM Unlearning2 Aug 2025
- 2025Rethinking Memorization Measures and their Implications in Large Language Models20 Jul 2025
- 2025One-Point Contraction: Erasing Representational Separability toward Irreversible Deep Forgetting10 Jul 2025
- 2025FlexOlmo: Open Language Models for Flexible Data Use9 Jul 2025
- 2025The Landscape of Memorization in LLMs: Mechanisms, Measurement, and Mitigation8 Jul 2025
- 2025Tuning without Peeking: Provable Generalization Bounds and Robust LLM Post-Training2 Jul 2025
- 2025Blameless Users in a Clean Room: Defining Copyright Protection for Generative Models23 Jun 2025
- 2025Distinguishing Task-Specific and General-Purpose AI in Regulation19 Jun 2025
- 2025Quantifying Cross-Modality Memorization in Vision-Language Models5 Jun 2025
- 2025Discovering Forbidden Topics in Language Models23 May 2025
- 2025FoMoH: A clinically meaningful foundation model evaluation for structured electronic health records22 May 2025
- 2025More-than-Human Storytelling: Designing Longitudinal Narrative Engagements with Generative AI20 May 2025
- 2025Teaching Models to Understand (but not Generate) High-risk Data5 May 2025
- 2025ParaPO: Aligning Language Models to Reduce Verbatim Reproduction of Pre-training Data20 Apr 2025
- 2025AI Safety Should Prioritize the Future of Work16 Apr 2025
- 2025The KL3M Data Project: Copyright-Clean Training Resources for Large Language Models10 Apr 2025
- 2025Who Owns the Output? Bridging Law and Technology in LLMs Attribution29 Mar 2025
- 2025SUV: Scalable Large Language Model Copyright Compliance with Regularized Selective Unlearning29 Mar 2025
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar 2025
- 2025Guardians of Generation: Dynamic Inference-Time Copyright Shielding with Adaptive Guidance for AI Image Generation19 Mar 2025
- 2025Position: Ensuring mutual privacy is necessary for effective external evaluation of proprietary AI systems3 Mar 2025
- 2025Forecasting Open-Weight AI Model Growth on HuggingFace21 Feb 2025
- 2025Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignment6 Feb 2025
- 2025Al-Khwarizmi: Discovering Physical Laws with Foundation Models3 Feb 2025
- 2024Copyright-Protected Language Generation via Adaptive Model Fusion9 Dec 2024
- 2024Negative Token Merging: Image-based Adversarial Feature Guidance2 Dec 2024
- 2024Provable unlearning in topic modeling and downstream tasks19 Nov 2024
- 2024Developer Perspectives on Licensing and Copyright Issues Arising from Generative AI for Software Development16 Nov 2024
- 2024Beyond the Safety Bundle: Auditing the Helpful and Harmless Dataset12 Nov 2024
- 2024Mask-based Membership Inference Attacks for Retrieval-Augmented Generation26 Oct 2024
50 newest of 112 All 112 (JSON)
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Modelscited by 251
- 2023In-Context Unlearning: Language Models as Few Shot Unlearnerscited by 214
- 2023Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4cited by 123
- 2023On the Exploitability of Instruction Tuningcited by 110
- 2024A Safe Harbor for AI Evaluation and Red Teamingcited by 46
- 2024Detecting Training Data of Large Language Models via Expectation Maximizationcited by 13
- 2025The Landscape of Memorization in LLMs: Mechanisms, Measurement, and Mitigationcited by 9
- 2025The Surprising Effectiveness of Membership Inference with Simple N-Gram Coveragecited by 7
- 2025Leave No TRACE: Black-box Detection of Copyrighted Dataset Usage in Large Language Models via Watermarkingcited by 5
- 2024Provable unlearning in topic modeling and downstream taskscited by 4
- 2024Protecting Copyrighted Material with Unique Identifiers in Large Language Model Trainingcited by 2
- 2025Towards Evaluation for Real-World LLM Unlearningcited by 2
12 most cited of 18 All 18 (JSON)
- 2026SAU: Sparsity-Aware Unlearning for LLMs via Gradient Masking and Importance Redistribution31 Jan 2026
- 2026On the Evidentiary Limits of Membership Inference for Copyright Auditing19 Jan 2026
- 2025WaterSearch: Exploring Seed Pooling for Improving the Quality-Detectability Trade-off in LLM Watermarking30 Nov 2025
- 2025Forget to Know, Remember to Use: Context-Aware Unlearning for Large Language Models20 Oct 2025
- 2025Leave No TRACE: Black-box Detection of Copyrighted Dataset Usage in Large Language Models via Watermarking3 Oct 2025
- 2025The Surprising Effectiveness of Membership Inference with Simple N-Gram Coverage13 Aug 2025
- 2025Towards Evaluation for Real-World LLM Unlearning2 Aug 2025
- 2025One-Point Contraction: Erasing Representational Separability toward Irreversible Deep Forgetting10 Jul 2025
- 2025The Landscape of Memorization in LLMs: Mechanisms, Measurement, and Mitigation8 Jul 2025
- 2025Tuning without Peeking: Provable Generalization Bounds and Robust LLM Post-Training2 Jul 2025
- 2024Provable unlearning in topic modeling and downstream tasks19 Nov 2024
- 2024Detecting Training Data of Large Language Models via Expectation Maximization10 Oct 2024
12 newest of 18 All 18 (JSON)
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
- 2025ParaPO: Aligning Language Models to Reduce Verbatim Reproduction of Pre-training Datacited by 6
- 2026Alignment Whack-a-Mole : Finetuning Activates Verbatim Recall of Copyrighted Books in Large Language Modelscited by 6
- 2025SUV: Scalable Large Language Model Copyright Compliance with Regularized Selective Unlearningcited by 4
- 2026CopyShield: A Cross-Level Benchmark of Copyright Defenses in LLMscited by 0
- 2026CopyShield: A Cross-Level Benchmark of Copyright Defenses in LLMs1 Sep 2026
- 2026Alignment Whack-a-Mole : Finetuning Activates Verbatim Recall of Copyrighted Books in Large Language Models21 Mar 2026
- 2025ParaPO: Aligning Language Models to Reduce Verbatim Reproduction of Pre-training Data20 Apr 2025
- 2025SUV: Scalable Large Language Model Copyright Compliance with Regularized Selective Unlearning29 Mar 2025
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!5 Oct 2023
- 2024Replication in Visual Diffusion Models: A Survey and Outlookcited by 11
- 2024JIGMARK: A Black-Box Approach for Enhancing Image Watermarks against Diffusion Model Editscited by 9
- 2023Hey That's Mine Imperceptible Watermarks are Preserved in Diffusion Generated Outputscited by 3
- 2024Negative Token Merging: Image-based Adversarial Feature Guidancecited by 3
- 2026GUDA: Counterfactual Group-wise Training Data Attribution for Diffusion Models via Unlearningcited by 0
- 2026GUDA: Counterfactual Group-wise Training Data Attribution for Diffusion Models via Unlearning30 Jan 2026
- 2024Negative Token Merging: Image-based Adversarial Feature Guidance2 Dec 2024
- 2024Replication in Visual Diffusion Models: A Survey and Outlook7 Jul 2024
- 2024JIGMARK: A Black-Box Approach for Enhancing Image Watermarks against Diffusion Model Edits6 Jun 2024
- 2023Hey That's Mine Imperceptible Watermarks are Preserved in Diffusion Generated Outputs22 Aug 2023
- 2025FlexOlmo: Open Language Models for Flexible Data Usecited by 14
- 2025FlexOlmo: Open Language Models for Flexible Data Use9 Jul 2025
- 2023StarCoder: may the source be with you!cited by 790
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 394
- 2023Can LLM-Generated Misinformation Be Detected?cited by 173
- 2023Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attackscited by 156
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
- 2023Art and the science of generative AI: A deeper divecited by 93
- 2024Data Shapley in One Training Runcited by 76
- 2023The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AIcited by 73
- 2023SILO Language Models: Isolating Legal Risk In a Nonparametric Datastorecited by 71
- 2024On the Societal Impact of Open Foundation Modelscited by 64
- 2025Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignmentcited by 62
12 most cited of 73 All 73 (JSON)
- 2026Rethinking Data Quality for AI-Driven Systems: Evidence from Practitioner Interviews25 Sep 2026
- 2026AI Native Games: A Survey and Roadmap1 Jul 2026
- 2026Market Design for AI: Beyond the Copyright Binary10 Jun 2026
- 2026Efficient and Scalable Provenance Tracking for LLM-Generated Code Snippets27 May 2026
- 2026A governance horizon for ethical-use constraints in open-weight AI models23 May 2026
- 2026Permissive-Washing in the Open AI Supply Chain: A Large-Scale Audit of License Integrity9 Feb 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2025Auditing Information Disclosure During Large-Scale Gradient-Based Training via Gradient Uniqueness13 Oct 2025
- 2025Blameless Users in a Clean Room: Defining Copyright Protection for Generative Models23 Jun 2025
- 2025Distinguishing Task-Specific and General-Purpose AI in Regulation19 Jun 2025
- 2025Discovering Forbidden Topics in Language Models23 May 2025
- 2025FoMoH: A clinically meaningful foundation model evaluation for structured electronic health records22 May 2025
12 newest of 73 All 73 (JSON)