mlsanityData to 14 Oct 2026

Regulation and NLP (RegNLP): Taming Large Language Models

arXiv 2310.05553 ↗First posted 9 Oct 2023cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

The scientific innovation in Natural Language Processing (NLP) and more broadly in artificial intelligence (AI) is at its fastest pace to date. As large language models (LLMs) unleash a new era of automation, important debates emerge regarding the benefits and risks of their development, deployment and use. Currently, these debates have been dominated by often polarized narratives mainly led by the AI Safety and AI Ethics movements. This polarization, often amplified by social media, is swaying political agendas on AI regulation and governance and posing issues of regulatory capture. Capture occurs when the regulator advances the interests of the industry it is supposed to regulate, or of special interest groups rather than pursuing the general public interest. Meanwhile in NLP research, attention has been increasingly paid to the discussion of regulating risks and harms. This often happens without systematic methodologies or sufficient rooting in the disciplines that inspire an extended scope of NLP research, jeopardizing the scientific integrity of these endeavors. Regulation studies are a rich source of knowledge on how to systematically deal with risk and uncertainty, as well as with scientific evidence, to evaluate and compare regulatory options. This resource has largely remained untapped so far. In this paper, we argue how NLP research on these topics can benefit from proximity to regulatory studies and adjacent fields. We do so by discussing basic tenets of regulation, and risk and uncertainty, and by highlighting the shortcomings of current NLP discussions dealing with risk assessment. Finally, we advocate for the development of a new multidisciplinary research space on regulation and NLP (RegNLP), focused on connecting scientific knowledge to regulatory processes based on systematic methodologies.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 24 of its 85 references that are in the map. First posted on arXiv 9 Oct 2023.

Builds on

24 of 85 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2017Deep reinforcement learning from human preferencescited by 3,912
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  6. 2020Learning to summarize from human feedbackcited by 2,588
  7. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
  8. 2023PaLM 2 Technical Reportcited by 1,162
  9. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 956
  10. 2019Green AIcited by 627
  11. 2020Artificial Intelligence, Values and Alignmentcited by 448
  12. 2018Scalable agent alignment via reward modeling: a research directioncited by 447
12 more
  1. 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 327
  2. 2019Tackling Climate Change with Machine Learningcited by 265
  3. 2023An Overview of Catastrophic AI Riskscited by 222
  4. 2022Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attackscited by 175
  5. 2022Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Biascited by 43
  6. 2020The Grey Hoodie Project: Big Tobacco, Big Tech, and the threat on academic integritycited by 38
  7. 2023Assessing Language Model Deployment with Risk Cardscited by 30
  8. 2023The Elephant in the Room: Analyzing the Presence of Big Tech in Natural Language Processing Researchcited by 27
  9. 2021On the Ethical Limits of Natural Language Processing on Legal Textcited by 26
  10. 2021Hard Choices in Artificial Intelligencecited by 26
  11. 2022Four Years of FAccT: A Reflexive, Mixed-Methods Analysis of Research Contributions, Shortcomings, and Future Prospectscited by 14
  12. 2023Examining risks of racial biases in NLP tools for child protective servicescited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 3.

5 papers.