Regulating ChatGPT and other Large Generative AI Models
Not on the map. Why?
Abstract (arXiv)
Large generative AI models (LGAIMs), such as ChatGPT, GPT-4 or Stable Diffusion, are rapidly transforming the way we communicate, illustrate, and create. However, AI regulation, in the EU and beyond, has primarily focused on conventional AI models, not LGAIMs. This paper will situate these new generative models in the current debate on trustworthy AI regulation, and ask how the law can be tailored to their capabilities. After laying technical foundations, the legal part of the paper proceeds in four steps, covering (1) direct regulation, (2) data protection, (3) content moderation, and (4) policy proposals. It suggests a novel terminology to capture the AI value chain in LGAIM settings by differentiating between LGAIM developers, deployers, professional and non-professional users, as well as recipients of LGAIM output. We tailor regulatory duties to these different actors along the value chain and suggest strategies to ensure that LGAIMs are trustworthy and deployed for the benefit of society at large. Rules in the AI Act and other direct regulation must match the specificities of pre-trained models. The paper argues for three layers of obligations concerning LGAIMs (minimum standards for all LGAIMs; high-risk obligations for high-risk use cases; collaborations along the AI value chain). In general, regulation should focus on concrete high-risk applications, and not the pre-trained model itself, and should include (i) obligations regarding transparency and (ii) risk management. Non-discrimination provisions (iii) may, however, apply to LGAIM developers. Lastly, (iv) the core of the DSA content moderation rules should be expanded to cover LGAIMs. This includes notice and action mechanisms, and trusted flaggers. In all areas, regulators and lawmakers need to act fast to keep track with the dynamics of ChatGPT et al.
Key facts. Cited by 102 papers in the map (data through 7 Oct 2026). Builds on 44 of its 176 references that are in the map. First posted on arXiv 5 Feb 2023.
Builds on
44 of 176 references.
References · 44
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2022Generative Adversarial Networkscited by 5,603
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
32 more
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2023A Watermark for Large Language Modelscited by 667
- 2021Carbon Emissions and Large Neural Network Trainingcited by 561
- 2019Defending Against Neural Fake Newscited by 553
- 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
- 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 485
- 2022Predictability and Surprise in Large Generative Modelscited by 209
- 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
- 2018The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigationcited by 159
- 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 157
- 2021Demystifying the Draft EU Artificial Intelligence Actcited by 82
- 2020Why Fairness Cannot Be Automated: Bridging the Gap Between EU Non-Discrimination Law and AIcited by 81
- 2022Cramming: Training a Language Model on a Single GPU in One Daycited by 81
- 2021What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformerscited by 75
- 2018Algorithms that Remember: Model Inversion Attacks and Data Protection Lawcited by 52
- 2021The Threat of Offensive AI to Organizationscited by 37
- 2022Dislocated Accountabilities in the AI Supply Chain: Modularity and Developers' Notions of Responsibilitycited by 33
- 2022The Ethical Need for Watermarks in Machine-Generated Languagecited by 30
- 2023AtMan: Understanding Transformer Predictions Through Memory Efficient Attention Manipulationcited by 30
- 2022The European AI Liability Directives -- Critique of a Half-Hearted Approach and Lessons for the Futurecited by 12
- 2013Artificial Intelligence Framework for Simulating Clinical Decision-Making: A Markov Decision Process Approachcited by 8
- 2018Privacy Issues and Data Protection in Big Data: A Case Study Analysis under GDPRcited by 6
- 2022The Theory of Artificial Immutability: Protecting Algorithmic Groups Under Anti-Discrimination Lawcited by 4
- 2022Regulating Gatekeeper AI and Data: Transparency, Access, and Fairness under the DMA, the GDPR, and beyondcited by 4
Built on by
Citing papers per year: 2023: 33; 2024: 38; 2025: 20; 2026: 11.
102 papers.
Sort:
By area:
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 434
- 2023On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspectivecited by 208
- 2023Can LLM-Generated Misinformation Be Detected?cited by 173
- 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 152
- 2023Auditing large language models: a three-layered approachcited by 135
- 2023Large language models in healthcare and medical domain: A reviewcited by 126
- 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
- 2024Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Surveycited by 86
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
- 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
- 2023A Survey on Detection of LLMs-Generated Contentcited by 70
- 2024CBR-RAG: Case-Based Reasoning for Retrieval Augmented Generation in LLMs for Legal Question Answeringcited by 70
38 more
- 2023Beyond the Safeguards: Exploring the Security Risks of ChatGPTcited by 36
- 2024Targeted Vaccine: Safety Alignment for Large Language Models against Harmful Fine-Tuning via Layer-wise Perturbationcited by 35
- 2025Adversarial Attacks on Robotic Vision Language Action Modelscited by 31
- 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Modelscited by 30
- 2023Large Language Models Can Infer Psychological Dispositions of Social Media Userscited by 28
- 2025We Should Identify and Mitigate Third-Party Safety Risks in MCP-Powered Agent Systemscited by 27
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
- 2023The Dark Side of ChatGPT: Legal and Ethical Challenges from Stochastic Parrots and Hallucinationcited by 23
- 2023Embarrassingly Simple Text Watermarkscited by 23
- 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Surveycited by 23
- 2023WatME: Towards Lossless Watermarking Through Lexical Redundancycited by 22
- 2025Benign Samples Matter! Fine-tuning On Outlier Benign Samples Severely Breaks Safetycited by 22
- 2024Generative AI in EU Law: Liability, Privacy, Intellectual Property, and Cybersecuritycited by 21
- 2024CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technologycited by 21
- 2023To ChatGPT, or not to ChatGPT: That is the question!cited by 20
- 2024How well do LLMs cite relevant medical references? An evaluation framework and analysescited by 20
- 2023Safety and Fairness for Content Moderation in Generative Modelscited by 15
- 2023Friend or Foe? Exploring the Implications of Large Language Models on the Science Systemcited by 15
- 2024Position: Towards Bidirectional Human-AI Alignmentcited by 15
- 2024Near to Mid-term Risks and Opportunities of Open-Source Generative AIcited by 13
- 2024Generative AI Literacy: Twelve Defining Competenciescited by 13
- 2023A Security Risk Taxonomy for Prompt-Based Interaction With Large Language Modelscited by 12
- 2023Autonomous Agents in Software Development: A Vision Papercited by 12
- 2024Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensicscited by 12
- 2025A General Framework to Enhance Fine-tuning-based LLM Unlearningcited by 12
- 2024Risks and Opportunities of Open-Source Generative AIcited by 11
- 2023Distinguishing Human Generated Text From ChatGPT Generated Text Using Machine Learningcited by 10
- 2024What is it for a Machine Learning Model to Have a Capability?cited by 10
- 2025Single-pass Detection of Jailbreaking Input in Large Language Modelscited by 10
- 2025Transferable Adversarial Attacks on Black-Box Vision-Language Modelscited by 10
- 2025Self-Destructive Language Modelcited by 10
- 2023Moderating Model Marketplaces: Platform Governance Puzzles for AI Intermediariescited by 9
- 2025SoK: Machine Unlearning for Large Language Modelscited by 9
- 2023Waiting, Banning, and Embracing: An Empirical Analysis of Adapting Policies for Generative AI in Higher Educationcited by 7
- 2023Cooperative AI via Decentralized Commitment Devicescited by 7
- 2024Large Language Models "Ad Referendum": How Good Are They at Machine Translation in the Legal Domain?cited by 7
- 2024A Survey on Human-AI Collaboration with Large Foundation Modelscited by 7
- 2024ChatGPT Role-play Dataset: Analysis of User Motives and Model Naturalnesscited by 7
50 most cited of 102 All 102 (JSON)
- 2026Large language models in medical time series analysis7 Sep 2026
- 2026LAAF: A Layered Accountability Architecture Framework for LLM Applications27 Aug 2026
- 2026"AI Watermarking": Bridging Policy Discourse and Technical Capabilities25 May 2026
- 2026Verifiable Provenance and Watermarking for Generative AI: An Evidentiary Framework for International Operational Law and Domestic Courts20 May 2026
- 2026Automating Categorization of Scientific Texts with In-Context Learning and Prompt-Chaining in Large Language Models25 Apr 2026
- 2026AI of the People, by the People, for the People: A Social Choice Approach to Collective Control of Artificial Intelligence14 Apr 2026
- 2026Trust-Aware Routing for Distributed Generative AI Inference at the Edge30 Mar 2026
- 2026Invisible Safety Threat: Malicious Finetuning for LLM via Steganography9 Mar 2026
- 2026Self-Service or Not? How to Guide Practitioners in Classifying AI Systems Under the EU AI Act10 Feb 2026
- 2026TrojanPraise: Jailbreak LLMs via Benign Fine-Tuning18 Jan 2026
- 2026Computational Compliance for AI Regulation: Blueprint for a New Research Domain8 Jan 2026
- 2025BeautyGuard: Designing a Multi-Agent Roundtable System for Proactive Beauty Tech Compliance through Stakeholder Collaboration16 Nov 2025
38 more
- 2025Communication Bias in Large Language Models: A Regulatory Perspective25 Sep 2025
- 2025We Should Identify and Mitigate Third-Party Safety Risks in MCP-Powered Agent Systems16 Jun 2025
- 2025SoK: Machine Unlearning for Large Language Models10 Jun 2025
- 2025Normative Conflicts and Shallow AI Alignment5 Jun 2025
- 2025Adversarial Attacks on Robotic Vision Language Action Models3 Jun 2025
- 2025Position: EU AI Act's Research Exemptions Can Break the Publication Norms of Major AI Conferences3 Jun 2025
- 2025Self-Destructive Language Model18 May 2025
- 2025Benign Samples Matter! Fine-tuning On Outlier Benign Samples Severely Breaks Safety11 May 2025
- 2025Transferable Adversarial Attacks on Black-Box Vision-Language Models2 May 2025
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap27 Mar 2025
- 2025LookAhead Tuning: Safer Language Models via Partial Answer Previews24 Mar 2025
- 2025FedGAI: Federated Style Learning with Cloud-Edge Collaboration for Generative AI in Fashion Design16 Mar 2025
- 2025A Closer Look at Adversarial Suffix Learning for Jailbreaking LLMs: Augmented Adversarial Trigger Learning16 Mar 2025
- 2025Machine Learners Should Acknowledge the Legal Implications of Large Language Models as Personal Data3 Mar 2025
- 2025A General Framework to Enhance Fine-tuning-based LLM Unlearning25 Feb 2025
- 2025Single-pass Detection of Jailbreaking Input in Large Language Models21 Feb 2025
- 2025On the Effectiveness of Large Language Models in Automating Categorization of Scientific Texts8 Feb 2025
- 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Models29 Jan 2025
- 2025Regulating Multifunctionality26 Jan 2025
- 2024Generative AI Literacy: Twelve Defining Competencies29 Nov 2024
- 2024From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap28 Oct 2024
- 2024Self-correction is Not An Innate Capability in Language Models27 Oct 2024
- 2024Targeted Vaccine: Safety Alignment for Large Language Models against Harmful Fine-Tuning via Layer-wise Perturbation13 Oct 2024
- 2024Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Survey26 Sep 2024
- 2024Democratising Artificial Intelligence for Pandemic Preparedness and Global Governance in Latin American and Caribbean Countries21 Sep 2024
- 2024AI Horizon Scanning, White Paper p3395, IEEE-SA. Part I: Areas of Attention13 Sep 2024
- 2024Is Generative AI the Next Tactical Cyber Weapon For Threat Actors? Unforeseen Implications of AI Generated Cyber Attacks23 Aug 2024
- 2024AccessShare: Co-designing Data Access and Sharing with Blind People27 Jul 2024
- 2024Thorns and Algorithms: Navigating Generative AI Challenges Inspired by Giraffes and Acacias16 Jul 2024
- 2024Identifying the Source of Generation for Large Language Models5 Jul 2024
- 2024Memorizing Documents with Guidance in Large Language Models23 Jun 2024
- 2024Trustworthy Artificial Intelligence in the Context of Metrology14 Jun 2024
- 2024Position: Towards Bidirectional Human-AI Alignment13 Jun 2024
- 2024Global AI Governance in Healthcare: A Cross-Jurisdictional Regulatory Analysis12 Jun 2024
- 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey8 Jun 2024
- 2024Experimenting with Multi-Agent Software Development: Towards a Unified Platform8 Jun 2024
- 2024RU-AI: A Large Multimodal Dataset for Machine-Generated Content Detection7 Jun 2024
- 2024The Battle of LLMs: A Comparative Study in Conversational QA Tasks28 May 2024
50 newest of 102 All 102 (JSON)
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 434
- 2023Embarrassingly Simple Text Watermarkscited by 23
- 2025Benign Samples Matter! Fine-tuning On Outlier Benign Samples Severely Breaks Safetycited by 22
- 2024Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensicscited by 12
- 2025A General Framework to Enhance Fine-tuning-based LLM Unlearningcited by 12
- 2025Self-Destructive Language Modelcited by 10
- 2025SoK: Machine Unlearning for Large Language Modelscited by 9
- 2026TrojanPraise: Jailbreak LLMs via Benign Fine-Tuningcited by 1
- 2026Verifiable Provenance and Watermarking for Generative AI: An Evidentiary Framework for International Operational Law and Domestic Courtscited by 1
- 2025A Closer Look at Adversarial Suffix Learning for Jailbreaking LLMs: Augmented Adversarial Trigger Learningcited by 0
- 2026"AI Watermarking": Bridging Policy Discourse and Technical Capabilitiescited by 0
- 2026"AI Watermarking": Bridging Policy Discourse and Technical Capabilities25 May 2026
- 2026Verifiable Provenance and Watermarking for Generative AI: An Evidentiary Framework for International Operational Law and Domestic Courts20 May 2026
- 2026TrojanPraise: Jailbreak LLMs via Benign Fine-Tuning18 Jan 2026
- 2025SoK: Machine Unlearning for Large Language Models10 Jun 2025
- 2025Self-Destructive Language Model18 May 2025
- 2025Benign Samples Matter! Fine-tuning On Outlier Benign Samples Severely Breaks Safety11 May 2025
- 2025A Closer Look at Adversarial Suffix Learning for Jailbreaking LLMs: Augmented Adversarial Trigger Learning16 Mar 2025
- 2025A General Framework to Enhance Fine-tuning-based LLM Unlearning25 Feb 2025
- 2024Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensics27 Apr 2024
- 2023Embarrassingly Simple Text Watermarks13 Oct 2023
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks5 Oct 2023
- 2024Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Surveycited by 86
- 2024Targeted Vaccine: Safety Alignment for Large Language Models against Harmful Fine-Tuning via Layer-wise Perturbationcited by 35
- 2024Position: Towards Bidirectional Human-AI Alignmentcited by 15
- 2025Single-pass Detection of Jailbreaking Input in Large Language Modelscited by 10
- 2025LookAhead Tuning: Safer Language Models via Partial Answer Previewscited by 7
- 2025Normative Conflicts and Shallow AI Alignmentcited by 4
- 2026Invisible Safety Threat: Malicious Finetuning for LLM via Steganographycited by 2
- 2026Invisible Safety Threat: Malicious Finetuning for LLM via Steganography9 Mar 2026
- 2025Normative Conflicts and Shallow AI Alignment5 Jun 2025
- 2025LookAhead Tuning: Safer Language Models via Partial Answer Previews24 Mar 2025
- 2025Single-pass Detection of Jailbreaking Input in Large Language Models21 Feb 2025
- 2024Targeted Vaccine: Safety Alignment for Large Language Models against Harmful Fine-Tuning via Layer-wise Perturbation13 Oct 2024
- 2024Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Survey26 Sep 2024
- 2024Position: Towards Bidirectional Human-AI Alignment13 Jun 2024
- 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Modelscited by 30
- 2025We Should Identify and Mitigate Third-Party Safety Risks in MCP-Powered Agent Systemscited by 27
- 2024CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technologycited by 21
- 2023Autonomous Agents in Software Development: A Vision Papercited by 12
- 2024Experimenting with Multi-Agent Software Development: Towards a Unified Platformcited by 6
- 2025BeautyGuard: Designing a Multi-Agent Roundtable System for Proactive Beauty Tech Compliance through Stakeholder Collaborationcited by 0
- 2025BeautyGuard: Designing a Multi-Agent Roundtable System for Proactive Beauty Tech Compliance through Stakeholder Collaboration16 Nov 2025
- 2025We Should Identify and Mitigate Third-Party Safety Risks in MCP-Powered Agent Systems16 Jun 2025
- 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Models29 Jan 2025
- 2024Experimenting with Multi-Agent Software Development: Towards a Unified Platform8 Jun 2024
- 2024CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technology2 Feb 2024
- 2023Autonomous Agents in Software Development: A Vision Paper30 Nov 2023
- 2025Adversarial Attacks on Robotic Vision Language Action Modelscited by 31
- 2023On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspectivecited by 208
- 2023Can LLM-Generated Misinformation Be Detected?cited by 173
- 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 152
- 2023Auditing large language models: a three-layered approachcited by 135
- 2023Large language models in healthcare and medical domain: A reviewcited by 126
- 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
- 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
- 2023A Survey on Detection of LLMs-Generated Contentcited by 70
- 2023Beyond the Safeguards: Exploring the Security Risks of ChatGPTcited by 36
- 2023Large Language Models Can Infer Psychological Dispositions of Social Media Userscited by 28
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
12 most cited of 74 All 74 (JSON)
- 2026Large language models in medical time series analysis7 Sep 2026
- 2026LAAF: A Layered Accountability Architecture Framework for LLM Applications27 Aug 2026
- 2026Automating Categorization of Scientific Texts with In-Context Learning and Prompt-Chaining in Large Language Models25 Apr 2026
- 2026AI of the People, by the People, for the People: A Social Choice Approach to Collective Control of Artificial Intelligence14 Apr 2026
- 2026Trust-Aware Routing for Distributed Generative AI Inference at the Edge30 Mar 2026
- 2026Self-Service or Not? How to Guide Practitioners in Classifying AI Systems Under the EU AI Act10 Feb 2026
- 2026Computational Compliance for AI Regulation: Blueprint for a New Research Domain8 Jan 2026
- 2025Communication Bias in Large Language Models: A Regulatory Perspective25 Sep 2025
- 2025Position: EU AI Act's Research Exemptions Can Break the Publication Norms of Major AI Conferences3 Jun 2025
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap27 Mar 2025
- 2025FedGAI: Federated Style Learning with Cloud-Edge Collaboration for Generative AI in Fashion Design16 Mar 2025
- 2025Machine Learners Should Acknowledge the Legal Implications of Large Language Models as Personal Data3 Mar 2025
12 newest of 74 All 74 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024AI Safety in Generative AI Large Language Models: A Survey
- 2025Who Owns the Output? Bridging Law and Technology in LLMs Attribution
- 2025Let's have a chat with the EU AI Act
- 2024Informed AI Regulation: Comparing the Ethical Frameworks of Leading LLM Chatbots Using an Ethics-Based Audit to Assess Moral Reasoning and Normative Values
- 2025Do LLMs trust AI regulation? Emerging behaviour of game-theoretic LLM agents
- 2023On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook
- 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?
- 2026The Global Landscape of Environmental AI Regulation: From the Cost of Reasoning to a Right to Green AI