mlsanityData to 7 Oct 2026

Towards Responsible Governance of Biological Design Tools

arXiv 2311.15936 ↗First posted 27 Nov 2023cs.CY cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Recent advancements in generative machine learning have enabled rapid progress in biological design tools (BDTs) such as protein structure and sequence prediction models. The unprecedented predictive accuracy and novel design capabilities of BDTs present new and significant dual-use risks. For example, their predictive accuracy allows biological agents, whether vaccines or pathogens, to be developed more quickly, while the design capabilities could be used to discover drugs or evade DNA screening techniques. Similar to other dual-use AI systems, BDTs present a wicked problem: how can regulators uphold public safety without stifling innovation? We highlight how current regulatory proposals that are primarily tailored toward large language models may be less effective for BDTs, which require fewer computational resources to train and are often developed in an open-source manner. We propose a range of measures to mitigate the risk that BDTs are misused, across the areas of responsible development, risk assessment, transparency, access management, cybersecurity, and investing in resilience. Implementing such measures will require close coordination between developers and governments.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 17 of its 57 references that are in the map. First posted on arXiv 27 Nov 2023.

Builds on

17 of 57 references.

References · 17

  1. 2020Scaling Laws for Neural Language Modelscited by 6,411
  2. 2022Emergent Abilities of Large Language Modelscited by 2,483
  3. 2018Model Cards for Model Reportingcited by 1,068
  4. 2022Red-Teaming the Stable Diffusion Safety Filtercited by 257
  5. 2022Predictability and Surprise in Large Generative Modelscited by 209
  6. 2023Model evaluation for extreme riskscited by 167
  7. 2019Thieves on Sesame Street! Model Extraction of BERT-based APIscited by 136
  8. 2023Frontier AI Regulation: Managing Emerging Risks to Public Safetycited by 95
  9. 2023The Gradient of Generative AI Release: Methods and Considerationscited by 63
  10. 2023Artificial intelligence and biological misuse: Differentiating risks of language models and biological design toolscited by 43
  11. 2022Structured access: an emerging paradigm for safe AI deploymentcited by 40
  12. 2023Can large language models democratize access to dual-use biotechnology?cited by 33
5 more
  1. 2023Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectivescited by 31
  2. 2023Towards best practices in AGI safety and governance: A survey of expert opinioncited by 27
  3. 2023Will releasing the weights of future large language models grant widespread access to pandemic agents?cited by 25
  4. 2023What does it take to catch a Chinchilla? Verifying Rules on Large-Scale Neural Network Training via Compute Monitoringcited by 20
  5. 2023Censoring chemical data to mitigate dual use riskcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 1; 2026: 2.

5 papers.