mlsanityData to 14 Oct 2026

SPATIA: Multimodal Generation and Prediction of Spatial Cell Phenotypes

arXiv 2507.04704 ↗First posted 7 Jul 2025q-bio.QM cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Understanding how cellular morphology, gene expression, and spatial context jointly shape tissue function is a central challenge in biology. Image-based spatial transcriptomics technologies now provide high-resolution measurements of cell images and gene expression profiles, but existing methods typically analyze these modalities in isolation or at limited resolution. We address the problem by introducing SPATIA, a multi-level generative and predictive model that learns unified, spatially aware representations by fusing morphology, gene expression, and spatial context from the cell to the tissue level. SPATIA also incorporates a spatially conditioned generative framework with confidence-aware OT reweighting and morphology-profile alignment for modeling target-state morphology distributions. Specifically, we propose a confidence-aware flow matching objective that reweights weak optimal-transport pairs based on uncertainty. We further apply morphology-profile alignment to encourage biologically meaningful image generation, enabling the modeling of microenvironment-dependent phenotypic transitions. We assembled a multi-scale dataset consisting of 25.9 million cell-gene pairs across 17 tissues. We benchmark SPATIA against 18 models across 12 tasks, spanning categories such as phenotype generation, annotation, clustering, gene imputation, and cross-modal prediction. SPATIA achieves improved performance over state-of-the-art models, improving generative fidelity by 8% and predictive accuracy by up to 3%.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 77 references that are in the map. First posted on arXiv 7 Jul 2025.

Builds on

21 of 77 references.

References · 21

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  5. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
  6. 2018Demystifying MMD GANscited by 1,293
  7. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  8. 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
  9. 2024Multimodal Whole Slide Foundation Model for Pathologycited by 162
  10. 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 134
  11. 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 107
  12. 2024Hibou: A Family of Foundational Vision Transformers for Pathologycited by 57
9 more
  1. 2025Diffusion Generative Modeling for Spatially Resolved Gene Expression Inference from Histology Imagescited by 37
  2. 2024Multimodal contrastive learning for spatial gene expression prediction using histology imagescited by 30
  3. 2024STimage-1K4M: A histopathology image-gene expression dataset for spatial transcriptomicscited by 23
  4. 2025CellFlux: Simulating Cellular Morphology Changes via Flow Matchingcited by 20
  5. 2025Scalable Generation of Spatial Transcriptomics from Histology Images via Whole-Slide Flow Matchingcited by 19
  6. 2023xTrimoGene: An Efficient and Scalable Representation Learner for Single-Cell RNA-Seq Datacited by 12
  7. 2024ST-Align: A Multimodal Foundation Model for Image-Gene Alignment in Spatial Transcriptomicscited by 12
  8. 2023scHyena: Foundation Model for Full-Length Single-Cell RNA-Seq Analysis in Braincited by 7
  9. 2024scInterpreter: Training Large Language Models to Interpret scRNA-seq Data for Cell Type Annotationcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Program-space Diffusion for Morphology-to-Transcriptomics Prediction
  2. 2026Adapting a Pre-trained Single-Cell Foundation Model to Spatial Gene Expression Generation from Histology Images
  3. 2025Modeling Microenvironment Trajectories on Spatial Transcriptomics with NicheFlow
  4. 2025GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flow
  5. 2026Correlation-Guided Flow Matching with Annealed Masking for Spatial Transcriptomics Generation
  6. 2026Concept-based explanation of gene expression prediction from H&E images
  7. 2026Cross-Modal Knowledge Distillation from Spatial Transcriptomics to Histology
  8. 2026MINT: Molecularly Informed Training with Spatial Transcriptomics Supervision for Pathology Foundation Models