Transformer-Based Active Learning for Data-Efficient Vaccine Epitope Selection in PRRS
Not on the map. Why?
Abstract (arXiv)
High-fidelity molecular docking simulations can produce biologically relevant estimates of epitope-receptor binding affinity but are computationally expensive and therefore limit the number of candidates that can be screened for vaccine design. In this work, we evaluate machine learning (ML) approaches where variants of active learning are used to classify instances of high binding affinity between 9-mer epitopes and a well-conserved swine leukocyte antigen (SLA) receptor in the context of Porcine Reproductive and Respiratory Syndrome (PRRS). We use an internally generated dataset of 80 epitope-SLA docking affinities, each requiring more than 48 hours of high-performance computing (HPC). Multiple model families (linear, MLP, CNN, and a small transformer) are trained under strict low-data conditions within a pool-based active learning loop. In each case, optimal model configurations are identified by conducting large-scale hyperparameter optimization over the combined space of model architecture, training configuration, acquisition policy, and ensemble decision rules. To mitigate the effects of data subsample selection, each candidate configuration is evaluated by averaging performance over many randomized and balanced training and validation data subsets. Across experiments, transformer-based sequence models consistently emerged as the best-performing architecture, with active incremental learning yielding significant improvement over a baseline random sample acquisition strategy. Under moderate training data availability (N=30), the optimized ML-model configuration outperforms a standard baseline trained on twice the amount of data. Under higher training data availability (N=60), the same configuration achieves a peak accuracy of 86.8%, consistent with an upper bound of 85% classification accuracy based on two independent estimates of conformational noise.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 24 references that are in the map. First posted on arXiv 27 Jun 2026.
Builds on
8 of 24 references.
References · 8
- 2017Attention Is All You Needcited by 60,361
- 2021Activation Functions in Deep Learning: A Comprehensive Survey and Benchmarkcited by 155
- 2023Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performancecited by 147
- 2017Dataset Augmentation in Feature Spacecited by 124
- 2022A Comprehensive Survey of Regression Based Loss Functions for Time Series Forecastingcited by 33
- 2024Learning with Confidence: Training Better Classifiers from Soft Labelscited by 6
- 2019On the Dimensionality of Embeddings for Sparse Features and Datacited by 3
- 2021Bayesian Uncertainty and Expected Gradient Length -- Regression: Two Sides Of The Same Coin?cited by 3
Built on by
Not cited yet.