SPATIA: Multimodal Generation and Prediction of Spatial Cell Phenotypes
Not on the map. Why?
Abstract (arXiv)
Understanding how cellular morphology, gene expression, and spatial context jointly shape tissue function is a central challenge in biology. Image-based spatial transcriptomics technologies now provide high-resolution measurements of cell images and gene expression profiles, but existing methods typically analyze these modalities in isolation or at limited resolution. We address the problem by introducing SPATIA, a multi-level generative and predictive model that learns unified, spatially aware representations by fusing morphology, gene expression, and spatial context from the cell to the tissue level. SPATIA also incorporates a spatially conditioned generative framework with confidence-aware OT reweighting and morphology-profile alignment for modeling target-state morphology distributions. Specifically, we propose a confidence-aware flow matching objective that reweights weak optimal-transport pairs based on uncertainty. We further apply morphology-profile alignment to encourage biologically meaningful image generation, enabling the modeling of microenvironment-dependent phenotypic transitions. We assembled a multi-scale dataset consisting of 25.9 million cell-gene pairs across 17 tissues. We benchmark SPATIA against 18 models across 12 tasks, spanning categories such as phenotype generation, annotation, clustering, gene imputation, and cross-modal prediction. SPATIA achieves improved performance over state-of-the-art models, improving generative fidelity by 8% and predictive accuracy by up to 3%.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 77 references that are in the map. First posted on arXiv 7 Jul 2025.
Builds on
21 of 77 references.
References · 21
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2018Demystifying MMD GANscited by 1,293
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 162
- 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 134
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 107
- 2024Hibou: A Family of Foundational Vision Transformers for Pathologycited by 57
9 more
- 2025Diffusion Generative Modeling for Spatially Resolved Gene Expression Inference from Histology Imagescited by 37
- 2024Multimodal contrastive learning for spatial gene expression prediction using histology imagescited by 30
- 2024STimage-1K4M: A histopathology image-gene expression dataset for spatial transcriptomicscited by 23
- 2025CellFlux: Simulating Cellular Morphology Changes via Flow Matchingcited by 20
- 2025Scalable Generation of Spatial Transcriptomics from Histology Images via Whole-Slide Flow Matchingcited by 19
- 2023xTrimoGene: An Efficient and Scalable Representation Learner for Single-Cell RNA-Seq Datacited by 12
- 2024ST-Align: A Multimodal Foundation Model for Image-Gene Alignment in Spatial Transcriptomicscited by 12
- 2023scHyena: Foundation Model for Full-Length Single-Cell RNA-Seq Analysis in Braincited by 7
- 2024scInterpreter: Training Large Language Models to Interpret scRNA-seq Data for Cell Type Annotationcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Program-space Diffusion for Morphology-to-Transcriptomics Prediction
- 2026Adapting a Pre-trained Single-Cell Foundation Model to Spatial Gene Expression Generation from Histology Images
- 2025Modeling Microenvironment Trajectories on Spatial Transcriptomics with NicheFlow
- 2025GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flow
- 2026Correlation-Guided Flow Matching with Annealed Masking for Spatial Transcriptomics Generation
- 2026Concept-based explanation of gene expression prediction from H&E images
- 2026Cross-Modal Knowledge Distillation from Spatial Transcriptomics to Histology
- 2026MINT: Molecularly Informed Training with Spatial Transcriptomics Supervision for Pathology Foundation Models