EVA: Towards a universal model of the immune system
Not on the map. Why?
Abstract (arXiv)
The effective application of foundation models to translational research in immune-mediated diseases requires multimodal patient-level representations that can capture complex phenotypes emerging from multicellular interactions. Yet most current biological foundation models focus only on single-cell resolution and are evaluated on technical metrics often disconnected from actual drug development tasks and challenges. Here, we introduce EVA, the first cross-species, multimodal foundation model of immunology and inflammation, a therapeutic area where shared pathogenic mechanisms create unique opportunities for transfer learning. EVA harmonizes transcriptomics data across species, platforms, and resolutions, and integrates histology data to produce rich, unified patient representations. We establish clear scaling laws, demonstrating that increasing model size and compute translates to improvements in both pretraining and downstream tasks performance. We introduce a comprehensive evaluation suite of 39 tasks spanning the drug development pipeline: zero-shot target efficacy and gene function prediction for discovery, cross-species or cross-diseases molecular perturbations for preclinical development, and patient stratification with treatment response prediction or disease activity prediction for clinical trials applications. We benchmark EVA against several state-of-the-art biological foundation models and baselines on these tasks, and demonstrate state-of-the-art results on each task category. Using mechanistic interpretability, we further identify biological meaningful features, revealing intertwined representations across species and technologies. We release an open version of EVA for transcriptomics to accelerate research on immune-mediated diseases.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 73 references that are in the map. First posted on arXiv 10 Feb 2026.
Builds on
25 of 73 references.
References · 25
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2020Supervised Contrastive Learningcited by 2,803
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2022Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learningcited by 553
- 2020Captum: A unified and generic model interpretability library for PyTorchcited by 542
- 2024Scaling and evaluating sparse autoencoderscited by 530
- 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 246
13 more
- 2023HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolutioncited by 187
- 2022CRAFT: Concept Recursive Activation FacTorization for Explainabilitycited by 177
- 2023DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genomecited by 139
- 2022Should You Mask 15% in Masked Language Modeling?cited by 117
- 2023Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Predictioncited by 92
- 2025Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Modelscited by 67
- 2024Hibou: A Family of Foundational Vision Transformers for Pathologycited by 52
- 2023COCKATIEL: COntinuous Concept ranKed ATtribution with Interpretable ELements for explaining neural net classifiers on NLP taskscited by 16
- 2023Dynamic Masking Rate Schedules for MLM Pretrainingcited by 11
- 2022Reliable Measures of Spread in High Dimensional Latent Spacescited by 5
- 2024Can sparse autoencoders make sense of gene expression latent variable models?cited by 3
- 2024Going Beyond H&E and Oncology: How Do Histopathology Foundation Models Perform for Multi-stain IHC and Immunology?cited by 3
- 2025Discovering Interpretable Biological Concepts in Single-cell RNA-seq Foundation Modelscited by 2
Built on by
Not cited yet.