MAD: Microenvironment-Aware Distillation -- A Pretraining Strategy for Virtual Spatial Omics from Microscopy
Not on the map. Why?
Abstract (arXiv)
Bridging microscopy and omics would allow us to read molecular states from images-at single-cell resolution and tissue scale-without the cost and throughput limits of omics technologies. Self-supervised pretraining offers a scalable approach with minimal labels, yet how to encode single-cell identity within tissue environments-and the extent of biological information such models can capture-remains an open question. Here, we introduce MAD (microenvironment-aware distillation), a pretraining strategy that learns cell-centric embeddings by jointly self-distilling the morphology view and the microenvironment view of the same indexed cell into a unified embedding space. Across diverse tissues and imaging modalities, MAD achieves state-of-the-art prediction performance on downstream tasks including cell subtyping, transcriptomic prediction, and bioinformatic inference. MAD even outperforms foundation models with a similar number of model parameters that have been trained on substantially larger datasets. These results demonstrate that MAD's dual-view joint self-distillation effectively captures the complexity and diversity of cells within tissues. Together, this establishes MAD as a general tool for representation learning in microscopy, enabling virtual spatial omics and biological insights from vast microscopy datasets.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 66 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
10 of 66 references.
References · 10
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2025DINOv3cited by 1,297
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 156
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 104
- 2024Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biologycited by 52
- 2024Towards Large-Scale Training of Pathology Foundation Modelscited by 19
- 2023VOLTA: an Environment-Aware Contrastive Cell Representation Learning for Histopathologycited by 6
Built on by
Not cited yet.