Biosecurity-Aware AI: Agentic Risk Auditing of Soft Prompt Attacks on ESM-Based Variant Predictors
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Genomic Foundation Models (GFMs), such as Evolutionary Scale Modeling (ESM), have demonstrated remarkable success in variant effect prediction. However, their security and robustness under adversarial manipulation remain largely unexplored. To address this gap, we introduce the Secure Agentic Genomic Evaluator (SAGE), an agentic framework for auditing the adversarial vulnerabilities of GFMs. SAGE functions through an interpretable and automated risk auditing loop. It injects soft prompt perturbations, monitors model behavior across training checkpoints, computes risk metrics such as AUROC and AUPR, and generates structured reports with large language model-based narrative explanations. This agentic process enables continuous evaluation of embedding-space robustness without modifying the underlying model. Using SAGE, we find that even state-of-the-art GFMs like ESM2 are sensitive to targeted soft prompt attacks, resulting in measurable performance degradation. These findings reveal critical and previously hidden vulnerabilities in genomic foundation models, showing the importance of agentic risk auditing in securing biomedical applications such as clinical variant interpretation.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 6 of its 19 references that are in the map. First posted on arXiv 19 Dec 2025.
Builds on
6 of 19 references.
References · 6
- 2014Adam: A Method for Stochastic Optimizationcited by 37,093
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,502
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,156
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,371
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,229
- 2024FIMBA: Evaluating the Robustness of AI in Genomics via Feature Importance Adversarial Attackscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026NAAMSE: Framework for Evolutionary Security Evaluation of Agents
- 2025GenoArmory: A Unified Evaluation Framework for Adversarial Attacks on Genomic Foundation Models
- 2026EvoRiskBench: An Evolving Benchmark for Runtime Security Risks in Workspace Agents
- 2026ABC-Bench: An Agentic Bio-Capabilities Benchmark for Biosecurity
- 2026An Early Warning of Emerging Biosecurity Risks in Frontier LLMs
- 2024SAGE-RT: Synthetic Alignment data Generation for Safety Evaluation and Red Teaming
- 2026A Blind Spot in Alignment: Quantifying Biosecurity Risks in Large Language Models
- 2026Toward Reliable, Safe, and Secure LLMs for Scientific Applications