AntigenLM: Structure-Aware DNA Language Modeling for Influenza
Not on the map. Why?
Abstract (arXiv)
Language models have advanced sequence analysis, yet DNA foundation models often lag behind task-specific methods for unclear reasons. We present AntigenLM, a generative DNA language model pretrained on influenza genomes with intact, aligned functional units. This structure-aware pretraining enables AntigenLM to capture evolutionary constraints and generalize across tasks. Fine-tuned on time-series hemagglutinin (HA) and neuraminidase (NA) sequences, AntigenLM accurately forecasts future antigenic variants across regions and subtypes, including those unseen during training, outperforming phylogenetic and evolution-based models. It also achieves near-perfect subtype classification. Ablation studies show that disrupting genomic structure through fragmentation or shuffling severely degrades performance, revealing the importance of preserving functional-unit integrity in DNA language modeling. AntigenLM thus provides both a powerful framework for antigen evolution prediction and a general principle for building biologically grounded DNA foundation models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 51 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
6 of 51 references.
References · 6
- 2017Attention Is All You Needcited by 59,932
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
- 2023HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolutioncited by 187
- 2024Genomic Language Models: Opportunities and Challengescited by 20
- 2024VQDNA: Unleashing the Power of Vector Quantization for Multi-Species Genomic Sequence Modelingcited by 14
Built on by
Not cited yet.