mlsanityData to 7 Oct 2026

MAD: Microenvironment-Aware Distillation -- A Pretraining Strategy for Virtual Spatial Omics from Microscopy

arXiv 2603.13401 ↗First posted 11 Mar 2026cs.CV cs.AI physics.opticscited by 0

Not on the map. Why?

Abstract (arXiv)

Bridging microscopy and omics would allow us to read molecular states from images-at single-cell resolution and tissue scale-without the cost and throughput limits of omics technologies. Self-supervised pretraining offers a scalable approach with minimal labels, yet how to encode single-cell identity within tissue environments-and the extent of biological information such models can capture-remains an open question. Here, we introduce MAD (microenvironment-aware distillation), a pretraining strategy that learns cell-centric embeddings by jointly self-distilling the morphology view and the microenvironment view of the same indexed cell into a unified embedding space. Across diverse tissues and imaging modalities, MAD achieves state-of-the-art prediction performance on downstream tasks including cell subtyping, transcriptomic prediction, and bioinformatic inference. MAD even outperforms foundation models with a similar number of model parameters that have been trained on substantially larger datasets. These results demonstrate that MAD's dual-view joint self-distillation effectively captures the complexity and diversity of cells within tissues. Together, this establishes MAD as a general tool for representation learning in microscopy, enabling virtual spatial omics and biological insights from vast microscopy datasets.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 66 references that are in the map. First posted on arXiv 11 Mar 2026.

Builds on

10 of 66 references.

References · 10

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2025DINOv3cited by 1,297
  6. 2024Multimodal Whole Slide Foundation Model for Pathologycited by 156
  7. 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 104
  8. 2024Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biologycited by 52
  9. 2024Towards Large-Scale Training of Pathology Foundation Modelscited by 19
  10. 2023VOLTA: an Environment-Aware Contrastive Cell Representation Learning for Histopathologycited by 6

Built on by

Not cited yet.