mlsanityData to 7 Oct 2026

Regulating ChatGPT and other Large Generative AI Models

arXiv 2302.02337 ↗First posted 5 Feb 2023cs.CY cs.AIcited by 102

Not on the map. Why?

Abstract (arXiv)

Large generative AI models (LGAIMs), such as ChatGPT, GPT-4 or Stable Diffusion, are rapidly transforming the way we communicate, illustrate, and create. However, AI regulation, in the EU and beyond, has primarily focused on conventional AI models, not LGAIMs. This paper will situate these new generative models in the current debate on trustworthy AI regulation, and ask how the law can be tailored to their capabilities. After laying technical foundations, the legal part of the paper proceeds in four steps, covering (1) direct regulation, (2) data protection, (3) content moderation, and (4) policy proposals. It suggests a novel terminology to capture the AI value chain in LGAIM settings by differentiating between LGAIM developers, deployers, professional and non-professional users, as well as recipients of LGAIM output. We tailor regulatory duties to these different actors along the value chain and suggest strategies to ensure that LGAIMs are trustworthy and deployed for the benefit of society at large. Rules in the AI Act and other direct regulation must match the specificities of pre-trained models. The paper argues for three layers of obligations concerning LGAIMs (minimum standards for all LGAIMs; high-risk obligations for high-risk use cases; collaborations along the AI value chain). In general, regulation should focus on concrete high-risk applications, and not the pre-trained model itself, and should include (i) obligations regarding transparency and (ii) risk management. Non-discrimination provisions (iii) may, however, apply to LGAIM developers. Lastly, (iv) the core of the DSA content moderation rules should be expanded to cover LGAIMs. This includes notice and action mechanisms, and trusted flaggers. In all areas, regulators and lawmakers need to act fast to keep track with the dynamics of ChatGPT et al.

Key facts. Cited by 102 papers in the map (data through 7 Oct 2026). Builds on 44 of its 176 references that are in the map. First posted on arXiv 5 Feb 2023.

Builds on

44 of 176 references.

References · 44

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2022Training language models to follow instructions with human feedbackcited by 15,712
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  8. 2022Generative Adversarial Networkscited by 5,603
  9. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  10. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  11. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  12. 2022Training Compute-Optimal Large Language Modelscited by 2,927
32 more
  1. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  2. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  3. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  4. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
  5. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
  6. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
  7. 2023Extracting Training Data from Diffusion Modelscited by 723
  8. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
  9. 2023A Watermark for Large Language Modelscited by 667
  10. 2021Carbon Emissions and Large Neural Network Trainingcited by 561
  11. 2019Defending Against Neural Fake Newscited by 553
  12. 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
  13. 2019Release Strategies and the Social Impacts of Language Modelscited by 505
  14. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
  15. 2022Predictability and Surprise in Large Generative Modelscited by 209
  16. 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
  17. 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 159
  18. 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 157
  19. 2021Demystifying the Draft EU Artificial Intelligence Actcited by 82
  20. 2020Why Fairness Cannot Be Automated: Bridging the Gap Between EU Non-Discrimination Law and AIcited by 81
  21. 2022Cramming: Training a Language Model on a Single GPU in One Daycited by 81
  22. 2021What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformerscited by 75
  23. 2018Algorithms that Remember: Model Inversion Attacks and Data Protection Lawcited by 52
  24. 2021The Threat of Offensive AI to Organizationscited by 37
  25. 2022Dislocated Accountabilities in the AI Supply Chain: Modularity and Developers' Notions of Responsibilitycited by 33
  26. 2022The Ethical Need for Watermarks in Machine-Generated Languagecited by 30
  27. 2023AtMan: Understanding Transformer Predictions Through Memory Efficient Attention Manipulationcited by 30
  28. 2022The European AI Liability Directives -- Critique of a Half-Hearted Approach and Lessons for the Futurecited by 12
  29. 2013Artificial Intelligence Framework for Simulating Clinical Decision-Making: A Markov Decision Process Approachcited by 8
  30. 2018Privacy Issues and Data Protection in Big Data: A Case Study Analysis under GDPRcited by 6
  31. 2022The Theory of Artificial Immutability: Protecting Algorithmic Groups Under Anti-Discrimination Lawcited by 4
  32. 2022Regulating Gatekeeper AI and Data: Transparency, Access, and Fairness under the DMA, the GDPR, and beyondcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 33; 2024: 38; 2025: 20; 2026: 11.

102 papers.

Sort:

By area:

  1. 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 434
  2. 2023On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspectivecited by 208
  3. 2023Can LLM-Generated Misinformation Be Detected?cited by 173
  4. 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 152
  5. 2023Auditing large language models: a three-layered approachcited by 135
  6. 2023Large language models in healthcare and medical domain: A reviewcited by 126
  7. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  8. 2024Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Surveycited by 86
  9. 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
  10. 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
  11. 2023A Survey on Detection of LLMs-Generated Contentcited by 70
  12. 2024CBR-RAG: Case-Based Reasoning for Retrieval Augmented Generation in LLMs for Legal Question Answeringcited by 70
38 more
  1. 2023Beyond the Safeguards: Exploring the Security Risks of ChatGPTcited by 36
  2. 2024Targeted Vaccine: Safety Alignment for Large Language Models against Harmful Fine-Tuning via Layer-wise Perturbationcited by 35
  3. 2025Adversarial Attacks on Robotic Vision Language Action Modelscited by 31
  4. 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Modelscited by 30
  5. 2023Large Language Models Can Infer Psychological Dispositions of Social Media Userscited by 28
  6. 2025We Should Identify and Mitigate Third-Party Safety Risks in MCP-Powered Agent Systemscited by 27
  7. 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
  8. 2023The Dark Side of ChatGPT: Legal and Ethical Challenges from Stochastic Parrots and Hallucinationcited by 23
  9. 2023Embarrassingly Simple Text Watermarkscited by 23
  10. 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Surveycited by 23
  11. 2023WatME: Towards Lossless Watermarking Through Lexical Redundancycited by 22
  12. 2025Benign Samples Matter! Fine-tuning On Outlier Benign Samples Severely Breaks Safetycited by 22
  13. 2024Generative AI in EU Law: Liability, Privacy, Intellectual Property, and Cybersecuritycited by 21
  14. 2024CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technologycited by 21
  15. 2023To ChatGPT, or not to ChatGPT: That is the question!cited by 20
  16. 2024How well do LLMs cite relevant medical references? An evaluation framework and analysescited by 20
  17. 2023Safety and Fairness for Content Moderation in Generative Modelscited by 15
  18. 2023Friend or Foe? Exploring the Implications of Large Language Models on the Science Systemcited by 15
  19. 2024Position: Towards Bidirectional Human-AI Alignmentcited by 15
  20. 2024Near to Mid-term Risks and Opportunities of Open-Source Generative AIcited by 13
  21. 2024Generative AI Literacy: Twelve Defining Competenciescited by 13
  22. 2023A Security Risk Taxonomy for Prompt-Based Interaction With Large Language Modelscited by 12
  23. 2023Autonomous Agents in Software Development: A Vision Papercited by 12
  24. 2024Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensicscited by 12
  25. 2025A General Framework to Enhance Fine-tuning-based LLM Unlearningcited by 12
  26. 2024Risks and Opportunities of Open-Source Generative AIcited by 11
  27. 2023Distinguishing Human Generated Text From ChatGPT Generated Text Using Machine Learningcited by 10
  28. 2024What is it for a Machine Learning Model to Have a Capability?cited by 10
  29. 2025Single-pass Detection of Jailbreaking Input in Large Language Modelscited by 10
  30. 2025Transferable Adversarial Attacks on Black-Box Vision-Language Modelscited by 10
  31. 2025Self-Destructive Language Modelcited by 10
  32. 2023Moderating Model Marketplaces: Platform Governance Puzzles for AI Intermediariescited by 9
  33. 2025SoK: Machine Unlearning for Large Language Modelscited by 9
  34. 2023Waiting, Banning, and Embracing: An Empirical Analysis of Adapting Policies for Generative AI in Higher Educationcited by 7
  35. 2023Cooperative AI via Decentralized Commitment Devicescited by 7
  36. 2024Large Language Models "Ad Referendum": How Good Are They at Machine Translation in the Legal Domain?cited by 7
  37. 2024A Survey on Human-AI Collaboration with Large Foundation Modelscited by 7
  38. 2024ChatGPT Role-play Dataset: Analysis of User Motives and Model Naturalnesscited by 7

50 most cited of 102 All 102 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024AI Safety in Generative AI Large Language Models: A Survey
  2. 2025Who Owns the Output? Bridging Law and Technology in LLMs Attribution
  3. 2025Let's have a chat with the EU AI Act
  4. 2024Informed AI Regulation: Comparing the Ethical Frameworks of Leading LLM Chatbots Using an Ethics-Based Audit to Assess Moral Reasoning and Normative Values
  5. 2025Do LLMs trust AI regulation? Emerging behaviour of game-theoretic LLM agents
  6. 2023On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook
  7. 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?
  8. 2026The Global Landscape of Environmental AI Regulation: From the Cost of Reasoning to a Right to Green AI