mlsanityData to 7 Oct 2026

AI-powered virtual tissues from spatial proteomics for clinical diagnostics and biomedical discovery

arXiv 2501.06039 ↗First posted 10 Jan 2025q-bio.QM cs.AI cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Spatial proteomics technologies have transformed our understanding of complex tissue architecture in cancer but present unique challenges for computational analysis. Each study uses a different marker panel and protocol, and most methods are tailored to single cohorts, which limits knowledge transfer and robust biomarker discovery. Here we present Virtual Tissues (VirTues), a general-purpose foundation model for spatial proteomics that learns marker-aware, multi-scale representations of proteins, cells, niches and tissues directly from multiplex imaging data. From a single pretrained backbone, VirTues supports marker reconstruction, cell typing and niche annotation, spatial biomarker discovery, and patient stratification, including zero-shot annotation across heterogeneous panels and datasets. In triple-negative breast cancer, VirTues-derived biomarkers predict anti-PD-L1 chemo-immunotherapy response and stratify disease-free survival in an independent cohort, outperforming state-of-the-art biomarkers derived from the same datasets and current clinical stratification schemes.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 26 of its 114 references that are in the map. First posted on arXiv 10 Jan 2025.

Builds on

26 of 114 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  5. 2020Language Models are Few-Shot Learnerscited by 32,199
  6. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  7. 2023GPT-4 Technical Reportcited by 18,132
  8. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  9. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  10. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  11. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  12. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
14 more
  1. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  2. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
  3. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  4. 2020On Layer Normalization in the Transformer Architecturecited by 906
  5. 2018Computational Optimal Transportcited by 765
  6. 2022MultiMAE: Multi-modal Multi-task Masked Autoencoderscited by 287
  7. 2023A Cookbook of Self-Supervised Learningcited by 248
  8. 2020Machine Learning in Python: Main developments and technology trends in data science, machine learning, and artificial intelligencecited by 81
  9. 2024Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biologycited by 52
  10. 2024Transcriptomics-guided Slide Representation Learning in Computational Pathologycited by 50
  11. 2024How to Build the Virtual Cell with Artificial Intelligence: Priorities and Opportunitiescited by 50
  12. 2023RxRx1: A Dataset for Evaluating Experimental Batch Correction Methodscited by 45
  13. 2023Channel Vision Transformers: An Image Is Worth 1 x 16 x 16 Wordscited by 33
  14. 2024ViTally Consistent: Scaling Biological Representation Learning for Cell Microscopycited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.