mlsanityData to 14 Oct 2026

MINT: Molecularly Informed Training with Spatial Transcriptomics Supervision for Pathology Foundation Models

arXiv 2603.07895 ↗First posted 9 Mar 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Pathology foundation models learn morphological representations through self-supervised pretraining on large-scale whole-slide images, yet they do not explicitly capture the underlying molecular state of the tissue. Spatial transcriptomics technologies bridge this gap by measuring gene expression in situ, offering a natural cross-modal supervisory signal. We propose MINT (Molecularly Informed Training), a fine-tuning framework that incorporates spatial transcriptomics supervision into pretrained pathology Vision Transformers. MINT appends a learnable ST token to the ViT input to encode transcriptomic information separately from the morphological CLS token, preventing catastrophic forgetting through DINO self-distillation and explicit feature anchoring to the frozen pretrained encoder. Gene expression regression at both spot-level (Visium) and patch-level (Xenium) resolutions provides complementary supervision across spatial scales. Trained on 577 publicly available HEST samples, MINT achieves the best overall performance on both HEST-Bench for gene expression prediction (mean Pearson r = 0.440) and EVA for general pathology tasks (0.803), demonstrating that spatial transcriptomics supervision complements morphology-centric self-supervised pretraining.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 26 references that are in the map. First posted on arXiv 9 Mar 2026.

Builds on

10 of 26 references.

References · 10

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  4. 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 161
  5. 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 107
  6. 2023Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learningcited by 79
  7. 2024Phikon-v2, A large and public feature extractor for biomarker predictioncited by 74
  8. 2024Hibou: A Family of Foundational Vision Transformers for Pathologycited by 57
  9. 2025Distilling foundation models for robust and efficient models in digital pathologycited by 36
  10. 2025Training state-of-the-art pathology foundation models with orders of magnitude less datacited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Towards Unified Molecule-Enhanced Pathology Image Representation Learning via Integrating Spatial Transcriptomics
  2. 2025MVHybrid: Improving Spatial Transcriptomics Prediction with Hybrid State Space-Vision Transformer Backbone in Pathology Vision Foundation Models
  3. 2026Adapting a Pre-trained Single-Cell Foundation Model to Spatial Gene Expression Generation from Histology Images
  4. 2025Diffusion Generative Modeling for Spatially Resolved Gene Expression Inference from Histology Images
  5. 2026Program-space Diffusion for Morphology-to-Transcriptomics Prediction
  6. 2026Concept-based explanation of gene expression prediction from H&E images
  7. 2025Teaching pathology foundation models to accurately predict gene expression with parameter efficient knowledge transfer
  8. 2024RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency