Screening of Biosecurity Features in Metagenomic Data with Evo 2 Probes
Not on the map. Why?
Abstract (arXiv)
Genomic foundation models such as Evo 2 learn rich sequence representations, but their value for biosecurity screening is largely unexplored. We ask how much biosecurity-relevant signal is linearly accessible in these representations by training minimal linear and attention probes on frozen Evo 2 layer-26 activations, without fine-tuning the underlying model. Across held-out metagenomic test sets, the probes detect antimicrobial resistance (AMR) with strong discrimination: a linear probe reaches a region-level ROC-AUC of 0.888 (mean-pool), rising to 0.977 with a single-head attention probe. The probes resolve finer-grained AMR drug-class subcategories and separate them from unrelated functional genes, providing additional evidence that the learned signal is not explained solely by generic functional-gene status. Bacterial virulence is also decodable, though more weakly (region-level ROC-AUC 0.833). The AMR probe retains comparable ranking performance on simulated short reads without retraining, enabling evaluation before assembly in settings where assembly is computationally costly or unreliable. It achieves a read-level ROC-AUC of 0.898 (mean-pool), comparable to the mean-pooled full-region result. Within SynGenome, AMR-associated prompt labels are only weakly recoverable from Evo 1.5-generated sequences; these prompt-derived labels do not establish the function of the generated response sequences. A complementary sparse-autoencoder analysis recovers interpretable resistance-associated features but proves less consistent than the supervised probes. Together, these results position lightweight embedding-based probes as a fast, inexpensive first-pass detection layer for metagenomic biosurveillance and map both strengths and current limits of the approach. This work was conducted as part of the AIxBio Hackathon 2026 hosted by BlueDot Impact, Apart Research, and Cambridge Biosecurity Hub.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 25 references that are in the map. First posted on arXiv 15 Jul 2026.
Builds on
4 of 25 references.
References · 4
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2025Are Sparse Autoencoders Useful? A Case Study in Sparse Probingcited by 115
- 2025Detecting High-Stakes Interactions with Activation Probescited by 53
- 2025METAGENE-1: Metagenomic Foundation Model for Pandemic Monitoringcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025BIOGEN: Evidence-Grounded Multi-Agent Reasoning Framework for Transcriptomic Interpretation in Antimicrobial Resistance
- 2025Predicting and generating antibiotics against future pathogens with ApexOracle
- 2026A Blind Spot in Alignment: Quantifying Biosecurity Risks in Large Language Models
- 2025Optimizing Gene-Based Testing for Antibiotic Resistance Prediction
- 2026BioSecBench-Surveillance: A Verifiable Benchmark for AI Agents in Pathogen Genomic Surveillance
- 2026MicroFuse: Protein-to-Genome Expert Fusion for Microbial Operon Reasoning
- 2026An Early Warning of Emerging Biosecurity Risks in Frontier LLMs
- 2026GGBound: A Genome-Grounded Agent for Microbial Life-Boundary Prediction