MINT: Molecularly Informed Training with Spatial Transcriptomics Supervision for Pathology Foundation Models
Not on the map. Why?
Abstract (arXiv)
Pathology foundation models learn morphological representations through self-supervised pretraining on large-scale whole-slide images, yet they do not explicitly capture the underlying molecular state of the tissue. Spatial transcriptomics technologies bridge this gap by measuring gene expression in situ, offering a natural cross-modal supervisory signal. We propose MINT (Molecularly Informed Training), a fine-tuning framework that incorporates spatial transcriptomics supervision into pretrained pathology Vision Transformers. MINT appends a learnable ST token to the ViT input to encode transcriptomic information separately from the morphological CLS token, preventing catastrophic forgetting through DINO self-distillation and explicit feature anchoring to the frozen pretrained encoder. Gene expression regression at both spot-level (Visium) and patch-level (Xenium) resolutions provides complementary supervision across spatial scales. Trained on 577 publicly available HEST samples, MINT achieves the best overall performance on both HEST-Bench for gene expression prediction (mean Pearson r = 0.440) and EVA for general pathology tasks (0.803), demonstrating that spatial transcriptomics supervision complements morphology-centric self-supervised pretraining.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 26 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
10 of 26 references.
References · 10
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 161
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 107
- 2023Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learningcited by 79
- 2024Phikon-v2, A large and public feature extractor for biomarker predictioncited by 74
- 2024Hibou: A Family of Foundational Vision Transformers for Pathologycited by 57
- 2025Distilling foundation models for robust and efficient models in digital pathologycited by 36
- 2025Training state-of-the-art pathology foundation models with orders of magnitude less datacited by 21
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Towards Unified Molecule-Enhanced Pathology Image Representation Learning via Integrating Spatial Transcriptomics
- 2025MVHybrid: Improving Spatial Transcriptomics Prediction with Hybrid State Space-Vision Transformer Backbone in Pathology Vision Foundation Models
- 2026Adapting a Pre-trained Single-Cell Foundation Model to Spatial Gene Expression Generation from Histology Images
- 2025Diffusion Generative Modeling for Spatially Resolved Gene Expression Inference from Histology Images
- 2026Program-space Diffusion for Morphology-to-Transcriptomics Prediction
- 2026Concept-based explanation of gene expression prediction from H&E images
- 2025Teaching pathology foundation models to accurately predict gene expression with parameter efficient knowledge transfer
- 2024RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency