AI-powered virtual tissues from spatial proteomics for clinical diagnostics and biomedical discovery
Not on the map. Why?
Abstract (arXiv)
Spatial proteomics technologies have transformed our understanding of complex tissue architecture in cancer but present unique challenges for computational analysis. Each study uses a different marker panel and protocol, and most methods are tailored to single cohorts, which limits knowledge transfer and robust biomarker discovery. Here we present Virtual Tissues (VirTues), a general-purpose foundation model for spatial proteomics that learns marker-aware, multi-scale representations of proteins, cells, niches and tissues directly from multiplex imaging data. From a single pretrained backbone, VirTues supports marker reconstruction, cell typing and niche annotation, spatial biomarker discovery, and patient stratification, including zero-shot annotation across heterogeneous panels and datasets. In triple-negative breast cancer, VirTues-derived biomarkers predict anti-PD-L1 chemo-immunotherapy response and stratify disease-free survival in an independent cohort, outperforming state-of-the-art biomarkers derived from the same datasets and current clinical stratification schemes.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 26 of its 114 references that are in the map. First posted on arXiv 10 Jan 2025.
Builds on
26 of 114 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
14 more
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2018Computational Optimal Transportcited by 765
- 2022MultiMAE: Multi-modal Multi-task Masked Autoencoderscited by 287
- 2023A Cookbook of Self-Supervised Learningcited by 248
- 2020Machine Learning in Python: Main developments and technology trends in data science, machine learning, and artificial intelligencecited by 81
- 2024Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biologycited by 52
- 2024Transcriptomics-guided Slide Representation Learning in Computational Pathologycited by 50
- 2024How to Build the Virtual Cell with Artificial Intelligence: Priorities and Opportunitiescited by 50
- 2023RxRx1: A Dataset for Evaluating Experimental Batch Correction Methodscited by 45
- 2023Channel Vision Transformers: An Image Is Worth 1 x 16 x 16 Wordscited by 33
- 2024ViTally Consistent: Scaling Biological Representation Learning for Cell Microscopycited by 13
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised Learningcited by 33
- 2026Computational Pathology in the Era of Emerging Foundation and Agentic AI -- International Expert Perspectives on Clinical Integration and Translational Readinesscited by 1
- 2026ImmuVis: Hyperconvolutional Foundation Model for Imaging Mass Cytometrycited by 0
- 2026Linking spatial biology and clinical histology via Haikucited by 0
- 2026Building artificial intelligence virtual tissue (AIVT) for tissue state representation, feature prediction, and dynamic simulationcited by 0
- 2026Building artificial intelligence virtual tissue (AIVT) for tissue state representation, feature prediction, and dynamic simulation29 Jun 2026
- 2026Linking spatial biology and clinical histology via Haiku30 Apr 2026
- 2026Computational Pathology in the Era of Emerging Foundation and Agentic AI -- International Expert Perspectives on Clinical Integration and Translational Readiness6 Mar 2026
- 2026ImmuVis: Hyperconvolutional Foundation Model for Imaging Mass Cytometry4 Feb 2026
- 2025Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised Learning18 May 2025