Contemporary AI foundation models increase biological weapons risk
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of artificial intelligence has raised concerns about its potential to facilitate biological weapons development. We argue existing safety assessments of contemporary foundation AI models underestimate this risk, largely due to flawed assumptions and inadequate evaluation methods. First, assessments mistakenly assume biological weapons development requires tacit knowledge, or skills gained through hands-on experience that cannot be easily verbalized. Second, they rely on imperfect benchmarks that overlook how AI can uplift both nonexperts and already-skilled individuals. To challenge the tacit knowledge assumption, we examine cases where individuals without formal expertise, including a 2011 Norwegian ultranationalist who synthesized explosives, successfully carried out complex technical tasks. We also review efforts to document pathogen construction processes, highlighting how such tasks can be conveyed in text. We identify "elements of success" for biological weapons development that large language models can describe in words, including steps such as acquiring materials and performing technical procedures. Applying this framework, we find that advanced AI models Llama 3.1 405B, ChatGPT-4o, and Claude 3.5 Sonnet can accurately guide users through the recovery of live poliovirus from commercially obtained synthetic DNA, challenging recent claims that current models pose minimal biosecurity risk. We advocate for improved benchmarks, while acknowledging the window for meaningful implementation may have already closed.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Jun 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025Dimensional Characterization and Pathway Modeling for Catastrophic AI Riskscited by 1
- 2026Trojan-Speak: Bypassing Constitutional Classifiers with No Jailbreak Tax via Adversarial Finetuningcited by 1
- 2025Sequence-based protein-protein interaction prediction and its applications in drug discoverycited by 0
- 2026Harmonizing AI Safety Thresholdscited by 0
- 2026Artificial intelligence and biosecurity: capabilities, threat pathways, and defense-in-depth governancecited by 0
- 2026Artificial intelligence and biosecurity: capabilities, threat pathways, and defense-in-depth governance14 Sep 2026
- 2026Harmonizing AI Safety Thresholds17 Jul 2026
- 2026Trojan-Speak: Bypassing Constitutional Classifiers with No Jailbreak Tax via Adversarial Finetuning30 Mar 2026
- 2025Dimensional Characterization and Pathway Modeling for Catastrophic AI Risks8 Aug 2025
- 2025Sequence-based protein-protein interaction prediction and its applications in drug discovery26 Jul 2025