mlsanityData to 14 Oct 2026

Distinguishing Task-Specific and General-Purpose AI in Regulation

arXiv 2506.17347 ↗First posted 19 Jun 2025cs.CY cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Over the past decade, policymakers have developed a set of regulatory tools to ensure AI development aligns with key societal goals. Many of these tools were initially developed in response to concerns with task-specific AI and therefore encode certain assumptions about the nature of AI systems and the utility of certain regulatory approaches. With the advent of general-purpose AI (GPAI), however, some of these assumptions no longer hold, even as policymakers attempt to maintain a single regulatory target that covers both types of AI. In this paper, we identify four distinct aspects of GPAI that call for meaningfully different policy responses. These are the generality and adaptability of GPAI that make it a poor regulatory target, the difficulty of designing effective evaluations, new legal concerns that change the ecosystem of stakeholders and sources of expertise, and the distributed structure of the GPAI value chain. In light of these distinctions, policymakers will need to evaluate where the past decade of policy work remains relevant and where new policies, designed to address the unique risks posed by GPAI, are necessary. We outline three recommendations for policymakers to more effectively identify regulatory targets and leverage constraints across the broader ecosystem to govern GPAI.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 35 of its 171 references that are in the map. First posted on arXiv 19 Jun 2025.

Builds on

35 of 171 references.

References · 35

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  4. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
  5. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 1,006
  6. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
  7. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 876
  8. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  9. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 349
  10. 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 327
  11. 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
  12. 2023An Overview of Catastrophic AI Riskscited by 222
23 more
  1. 2021What Will it Take to Fix Benchmarking in Natural Language Understanding?cited by 203
  2. 2022Do Users Write More Insecure Code with AI Assistants?cited by 192
  3. 2022Compute Trends Across Three Eras of Machine Learningcited by 163
  4. 2023Foundation Models and Fair Usecited by 116
  5. 2022The Fallacy of AI Functionalitycited by 88
  6. 2024Inadequacies of Large Language Model Benchmarks in the Era of Generative Artificial Intelligencecited by 68
  7. 2023Rethinking Model Evaluation as Narrowing the Socio-Technical Gapcited by 56
  8. 2023Talkin' 'Bout AI Generation: Copyright and the Generative-AI Supply Chaincited by 46
  9. 2023Artificial intelligence and biological misuse: Differentiating risks of language models and biological design toolscited by 45
  10. 2023Benchmarks for Automated Commonsense Reasoning: A Surveycited by 40
  11. 2023Understanding accountability in algorithmic supply chainscited by 40
  12. 2024Computing Power and the Governance of Artificial Intelligencecited by 40
  13. 2022Dislocated Accountabilities in the AI Supply Chain: Modularity and Developers' Notions of Responsibilitycited by 33
  14. 2023Ecosystem Graphs: The Social Footprint of Foundation Modelscited by 32
  15. 2023It Takes Two to Tango: Navigating Conceptualizations of NLP Tasks and Measurements of Performancecited by 26
  16. 2023Will releasing the weights of future large language models grant widespread access to pandemic agents?cited by 26
  17. 2025Copilot Arena: A Platform for Code LLM Evaluation in the Wildcited by 26
  18. 2024Evaluating Generative AI Systems is a Social Science Measurement Challengecited by 23
  19. 2024People are poorly equipped to detect AI-powered voice clonescited by 13
  20. 2021An Artificial Intelligence Life Cycle: From Conception to Productioncited by 11
  21. 2024The Reality of AI and Bioriskcited by 8
  22. 2025Red Teaming AI Policy: A Taxonomy of Avoision and the EU AI Actcited by 6
  23. 2025The Malicious Technical Ecosystem: Exposing Limitations in Technical Governance of AI-Generated Non-Consensual Intimate Images of Adultscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.