Diffusion Generative Modeling for Spatially Resolved Gene Expression Inference from Histology Images
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Spatial Transcriptomics (ST) allows a high-resolution measurement of RNA sequence abundance by systematically connecting cell morphology depicted in Hematoxylin and Eosin (H&E) stained histology images to spatially resolved gene expressions. ST is a time-consuming, expensive yet powerful experimental technique that provides new opportunities to understand cancer mechanisms at a fine-grained molecular level, which is critical for uncovering new approaches for disease diagnosis and treatments. Here, we present Stem (SpaTially resolved gene Expression inference with diffusion Model), a novel computational tool that leverages a conditional diffusion generative model to enable in silico gene expression inference from H&E stained images. Through better capturing the inherent stochasticity and heterogeneity in ST data, Stem achieves state-of-the-art performance on spatial gene expression prediction and generates biologically meaningful gene profiles for new H&E stained images at test time. We evaluate the proposed algorithm on datasets with various tissue sources and sequencing platforms, where it demonstrates clear improvement over existing approaches. Stem generates high-fidelity gene expression predictions that share similar gene variation levels as ground truth data, suggesting that our method preserves the underlying biological heterogeneity. Our proposed pipeline opens up the possibility of analyzing existing, easily accessible H&E stained histology images from a genomics point of view without physically performing gene expression profiling and empowers potential biological discovery from H&E stained histology images.
Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 31 of its 50 references that are in the map. First posted on arXiv 26 Jan 2025.
Builds on
31 of 50 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2022Video Diffusion Modelscited by 2,305
19 more
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,274
- 2022AudioGen: Textually Guided Audio Generationcited by 295
- 2023SE(3) diffusion model with application to protein backbone generationcited by 219
- 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 161
- 2020Self supervised contrastive learning for digital histopathologycited by 146
- 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 116
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 107
- 2023Virchow: A Million-Slide Digital Pathology Foundation Modelcited by 90
- 2023Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learningcited by 79
- 2024Accurate Spatial Gene Expression Prediction by integrating Multi-resolution featurescited by 52
- 2022Exemplar Guided Deep Neural Network for Spatial Transcriptomics Analysis of Gene Expression Predictioncited by 39
- 2023Accurate transition state generation with an object-aware equivariant elementary reaction diffusion modelcited by 30
- 2024Multimodal contrastive learning for spatial gene expression prediction using histology imagescited by 30
- 2024scDiffusion: conditional generation of high-quality single-cell data using diffusion modelcited by 24
- 2024Trivialized Momentum Facilitates Diffusion Generative Modeling on Lie Groupscited by 19
- 2024M2ORT: Many-To-One Regression Transformer for Spatial Transcriptomics Prediction from Histopathology Imagescited by 8
- 2024Quantum State Generation with Structure-Preserving Diffusion Modelcited by 8
- 2023Extraction and Recovery of Spatio-Temporal Structure in Latent Dynamics Alignment with Diffusion Modelscited by 7
Built on by
Citing papers per year: 2025: 18; 2026: 19.
37 papers.
Sort:
By area:
- 2025Diffuse Everything: Multimodal Diffusion Models on Arbitrary State Spacescited by 21
- 2025MDNS: Masked Diffusion Neural Sampler via Stochastic Optimal Controlcited by 21
- 2025Enhancing Reasoning for Diffusion LLMs via Distribution Matching Policy Optimizationcited by 20
- 2025Scalable Generation of Spatial Transcriptomics from Histology Images via Whole-Slide Flow Matchingcited by 19
- 2025TR2-D2: Tree Search Guided Trajectory-Aware Fine-Tuning for Discrete Diffusioncited by 14
- 2025Modeling Microenvironment Trajectories on Spatial Transcriptomics with NicheFlowcited by 7
- 2025Content Generation Models in Computational Pathology: A Comprehensive Survey on Methods, Applications, and Challengescited by 5
- 2025Img2ST-Net: Efficient High-Resolution Spatial Omics Prediction from Whole Slide Histology Images via Fully Convolutional Image-to-Image Learningcited by 5
- 2026HistoPrism: Unlocking Functional Pathway Analysis from Pan-Cancer Histology via Gene Expression Predictioncited by 5
- 2025GenAR: Next-Scale Autoregressive Generation for Spatial Gene Expression Predictioncited by 3
- 2026Adapting a Pre-trained Single-Cell Foundation Model to Spatial Gene Expression Generation from Histology Imagescited by 3
- 2025GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flowcited by 2
25 more
- 2025Controllable diffusion-based generation for multi-channel biological datacited by 1
- 2025Gene-DML: Dual-Pathway Multi-Level Discrimination for Gene Expression Prediction from Histopathology Imagescited by 1
- 2025MVHybrid: Improving Spatial Transcriptomics Prediction with Hybrid State Space-Vision Transformer Backbone in Pathology Vision Foundation Modelscited by 1
- 2025Latent Gene Diffusion for Spatial Transcriptomics Completioncited by 1
- 2026DUET: Dual-Paradigm Adaptive Expert Triage with Single-cell Inductive Prior for Spatial Transcriptomics Predictioncited by 1
- 2026HiST: A Hierarchical Sparse Transformer for Cross-Modal Spatial Transcriptomics Modelingcited by 1
- 2025SPATIA: Multimodal Generation and Prediction of Spatial Cell Phenotypescited by 0
- 2025Integrating Pathology Foundation Models and Spatial Transcriptomics for Cellular Decomposition from Histology Imagescited by 0
- 20253D-Guided Scalable Flow Matching for Generating Volumetric Tissue Spatial Transcriptomics from Serial Histologycited by 0
- 2025HyperST: Hierarchical Hyperbolic Learning for Spatial Transcriptomics Predictioncited by 0
- 2026MoLF: Mixture-of-Latent-Flow for Pan-Cancer Spatial Gene Expression Prediction from Histologycited by 0
- 2026RNA-FM: Flow-Matching Generative Model for Genome-wide RNA-Seq Predictioncited by 0
- 2026FLAG: Foundation model representation with Latent diffusion Alignment via Graph for spatial gene expression predictioncited by 0
- 2026DriftST: One-Step Generative Inference of Spatial Transcriptomics from H&E Histologycited by 0
- 2026HistoGPA: A Context-Conditioned Gene-Prior Attention Framework for Histology-Based Spatial Gene Expression Predictioncited by 0
- 2026Gene Ontology-Guided Hierarchical Spatial Gene Expression Prediction from Histopathology Imagescited by 0
- 2026Program-space Diffusion for Morphology-to-Transcriptomics Predictioncited by 0
- 2026Disentangled Shared Representations Improve Morpho-Transcriptomic Integrationcited by 0
- 2026Path2ST: Hierarchical Cell-Tissue Grounded Cross-Modal Translation for Spatial Transcriptomicscited by 0
- 2026PaSTel: Anchoring Histology in Spatial Transcriptomics via Multi-Scale Hierarchical Bio-Prior Contrastive Pretrainingcited by 0
- 2026STP-BENCH: A Unified Systematic Benchmark for Virtual Spatial Transcriptomics from Histopathology Imagescited by 0
- 2026Correlation-Guided Flow Matching with Annealed Masking for Spatial Transcriptomics Generationcited by 0
- 2026Preserving DEG Rankings for Gene Discovery in Histology-Based Spatial Gene Expression Predictioncited by 0
- 2026Towards Scalable Context-Aware Single-Cell Spatial Transcriptomics Prediction from Histology Imagescited by 0
- 2026MIST: Multi-Scale Spatial Context for Gene Expression Prediction from Histologycited by 0
- 2026MIST: Multi-Scale Spatial Context for Gene Expression Prediction from Histology13 Oct 2026
- 2026Towards Scalable Context-Aware Single-Cell Spatial Transcriptomics Prediction from Histology Images29 Sep 2026
- 2026Preserving DEG Rankings for Gene Discovery in Histology-Based Spatial Gene Expression Prediction27 Sep 2026
- 2026STP-BENCH: A Unified Systematic Benchmark for Virtual Spatial Transcriptomics from Histopathology Images5 Sep 2026
- 2026Correlation-Guided Flow Matching with Annealed Masking for Spatial Transcriptomics Generation28 Aug 2026
- 2026PaSTel: Anchoring Histology in Spatial Transcriptomics via Multi-Scale Hierarchical Bio-Prior Contrastive Pretraining14 Aug 2026
- 2026Disentangled Shared Representations Improve Morpho-Transcriptomic Integration14 Aug 2026
- 2026Program-space Diffusion for Morphology-to-Transcriptomics Prediction14 Aug 2026
- 2026Path2ST: Hierarchical Cell-Tissue Grounded Cross-Modal Translation for Spatial Transcriptomics11 Aug 2026
- 2026Gene Ontology-Guided Hierarchical Spatial Gene Expression Prediction from Histopathology Images1 Aug 2026
- 2026HistoGPA: A Context-Conditioned Gene-Prior Attention Framework for Histology-Based Spatial Gene Expression Prediction27 Jul 2026
- 2026DriftST: One-Step Generative Inference of Spatial Transcriptomics from H&E Histology6 Jul 2026
25 more
- 2026HiST: A Hierarchical Sparse Transformer for Cross-Modal Spatial Transcriptomics Modeling12 Jun 2026
- 2026FLAG: Foundation model representation with Latent diffusion Alignment via Graph for spatial gene expression prediction18 May 2026
- 2026DUET: Dual-Paradigm Adaptive Expert Triage with Single-cell Inductive Prior for Spatial Transcriptomics Prediction13 May 2026
- 2026RNA-FM: Flow-Matching Generative Model for Genome-wide RNA-Seq Prediction12 May 2026
- 2026Adapting a Pre-trained Single-Cell Foundation Model to Spatial Gene Expression Generation from Histology Images20 Mar 2026
- 2026MoLF: Mixture-of-Latent-Flow for Pan-Cancer Spatial Gene Expression Prediction from Histology2 Feb 2026
- 2026HistoPrism: Unlocking Functional Pathway Analysis from Pan-Cancer Histology via Gene Expression Prediction29 Jan 2026
- 2025HyperST: Hierarchical Hyperbolic Learning for Spatial Transcriptomics Prediction27 Nov 2025
- 20253D-Guided Scalable Flow Matching for Generating Volumetric Tissue Spatial Transcriptomics from Serial Histology18 Nov 2025
- 2025Modeling Microenvironment Trajectories on Spatial Transcriptomics with NicheFlow2 Nov 2025
- 2025GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flow31 Oct 2025
- 2025Enhancing Reasoning for Diffusion LLMs via Distribution Matching Policy Optimization9 Oct 2025
- 2025GenAR: Next-Scale Autoregressive Generation for Spatial Gene Expression Prediction5 Oct 2025
- 2025TR2-D2: Tree Search Guided Trajectory-Aware Fine-Tuning for Discrete Diffusion29 Sep 2025
- 2025Latent Gene Diffusion for Spatial Transcriptomics Completion2 Sep 2025
- 2025Img2ST-Net: Efficient High-Resolution Spatial Omics Prediction from Whole Slide Histology Images via Fully Convolutional Image-to-Image Learning20 Aug 2025
- 2025MDNS: Masked Diffusion Neural Sampler via Stochastic Optimal Control14 Aug 2025
- 2025MVHybrid: Improving Spatial Transcriptomics Prediction with Hybrid State Space-Vision Transformer Backbone in Pathology Vision Foundation Models1 Aug 2025
- 2025Gene-DML: Dual-Pathway Multi-Level Discrimination for Gene Expression Prediction from Histopathology Images19 Jul 2025
- 2025Integrating Pathology Foundation Models and Spatial Transcriptomics for Cellular Decomposition from Histology Images9 Jul 2025
- 2025SPATIA: Multimodal Generation and Prediction of Spatial Cell Phenotypes7 Jul 2025
- 2025Controllable diffusion-based generation for multi-channel biological data24 Jun 2025
- 2025Diffuse Everything: Multimodal Diffusion Models on Arbitrary State Spaces9 Jun 2025
- 2025Scalable Generation of Spatial Transcriptomics from Histology Images via Whole-Slide Flow Matching25 May 2025
- 2025Content Generation Models in Computational Pathology: A Comprehensive Survey on Methods, Applications, and Challenges16 May 2025
- 2025Diffuse Everything: Multimodal Diffusion Models on Arbitrary State Spacescited by 21
- 2025MDNS: Masked Diffusion Neural Sampler via Stochastic Optimal Controlcited by 21
- 2025Scalable Generation of Spatial Transcriptomics from Histology Images via Whole-Slide Flow Matchingcited by 19
- 2025TR2-D2: Tree Search Guided Trajectory-Aware Fine-Tuning for Discrete Diffusioncited by 14
- 2025GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flowcited by 2
- 2025Controllable diffusion-based generation for multi-channel biological datacited by 1
- 20253D-Guided Scalable Flow Matching for Generating Volumetric Tissue Spatial Transcriptomics from Serial Histologycited by 0
- 2026RNA-FM: Flow-Matching Generative Model for Genome-wide RNA-Seq Predictioncited by 0
- 2026FLAG: Foundation model representation with Latent diffusion Alignment via Graph for spatial gene expression predictioncited by 0
- 2026Correlation-Guided Flow Matching with Annealed Masking for Spatial Transcriptomics Generationcited by 0
- 2026Correlation-Guided Flow Matching with Annealed Masking for Spatial Transcriptomics Generation28 Aug 2026
- 2026FLAG: Foundation model representation with Latent diffusion Alignment via Graph for spatial gene expression prediction18 May 2026
- 2026RNA-FM: Flow-Matching Generative Model for Genome-wide RNA-Seq Prediction12 May 2026
- 20253D-Guided Scalable Flow Matching for Generating Volumetric Tissue Spatial Transcriptomics from Serial Histology18 Nov 2025
- 2025GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flow31 Oct 2025
- 2025TR2-D2: Tree Search Guided Trajectory-Aware Fine-Tuning for Discrete Diffusion29 Sep 2025
- 2025MDNS: Masked Diffusion Neural Sampler via Stochastic Optimal Control14 Aug 2025
- 2025Controllable diffusion-based generation for multi-channel biological data24 Jun 2025
- 2025Diffuse Everything: Multimodal Diffusion Models on Arbitrary State Spaces9 Jun 2025
- 2025Scalable Generation of Spatial Transcriptomics from Histology Images via Whole-Slide Flow Matching25 May 2025
- 2025Modeling Microenvironment Trajectories on Spatial Transcriptomics with NicheFlowcited by 7
- 2025Content Generation Models in Computational Pathology: A Comprehensive Survey on Methods, Applications, and Challengescited by 5
- 2025Img2ST-Net: Efficient High-Resolution Spatial Omics Prediction from Whole Slide Histology Images via Fully Convolutional Image-to-Image Learningcited by 5
- 2026HistoPrism: Unlocking Functional Pathway Analysis from Pan-Cancer Histology via Gene Expression Predictioncited by 5
- 2025GenAR: Next-Scale Autoregressive Generation for Spatial Gene Expression Predictioncited by 3
- 2026Adapting a Pre-trained Single-Cell Foundation Model to Spatial Gene Expression Generation from Histology Imagescited by 3
- 2025Gene-DML: Dual-Pathway Multi-Level Discrimination for Gene Expression Prediction from Histopathology Imagescited by 1
- 2025MVHybrid: Improving Spatial Transcriptomics Prediction with Hybrid State Space-Vision Transformer Backbone in Pathology Vision Foundation Modelscited by 1
- 2025Latent Gene Diffusion for Spatial Transcriptomics Completioncited by 1
- 2026DUET: Dual-Paradigm Adaptive Expert Triage with Single-cell Inductive Prior for Spatial Transcriptomics Predictioncited by 1
- 2026HiST: A Hierarchical Sparse Transformer for Cross-Modal Spatial Transcriptomics Modelingcited by 1
- 2025SPATIA: Multimodal Generation and Prediction of Spatial Cell Phenotypescited by 0
12 most cited of 25 All 25 (JSON)
- 2026MIST: Multi-Scale Spatial Context for Gene Expression Prediction from Histology13 Oct 2026
- 2026Towards Scalable Context-Aware Single-Cell Spatial Transcriptomics Prediction from Histology Images29 Sep 2026
- 2026Preserving DEG Rankings for Gene Discovery in Histology-Based Spatial Gene Expression Prediction27 Sep 2026
- 2026STP-BENCH: A Unified Systematic Benchmark for Virtual Spatial Transcriptomics from Histopathology Images5 Sep 2026
- 2026PaSTel: Anchoring Histology in Spatial Transcriptomics via Multi-Scale Hierarchical Bio-Prior Contrastive Pretraining14 Aug 2026
- 2026Disentangled Shared Representations Improve Morpho-Transcriptomic Integration14 Aug 2026
- 2026Program-space Diffusion for Morphology-to-Transcriptomics Prediction14 Aug 2026
- 2026Path2ST: Hierarchical Cell-Tissue Grounded Cross-Modal Translation for Spatial Transcriptomics11 Aug 2026
- 2026Gene Ontology-Guided Hierarchical Spatial Gene Expression Prediction from Histopathology Images1 Aug 2026
- 2026HistoGPA: A Context-Conditioned Gene-Prior Attention Framework for Histology-Based Spatial Gene Expression Prediction27 Jul 2026
- 2026DriftST: One-Step Generative Inference of Spatial Transcriptomics from H&E Histology6 Jul 2026
- 2026HiST: A Hierarchical Sparse Transformer for Cross-Modal Spatial Transcriptomics Modeling12 Jun 2026
12 newest of 25 All 25 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Cross-modal Diffusion Modelling for Super-resolved Spatial Transcriptomics
- 2026Concept-based explanation of gene expression prediction from H&E images
- 2026MINT: Molecularly Informed Training with Spatial Transcriptomics Supervision for Pathology Foundation Models
- 2025C3-Diff: Super-resolving Spatial Transcriptomics via Cross-modal Cross-content Contrastive Diffusion Modelling
- 2026Cross-Modal Knowledge Distillation from Spatial Transcriptomics to Histology
- 2024SpaDiT: Diffusion Transformer for Spatial Gene Expression Prediction using scRNA-seq
- 2024RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency
- 2026A Generative Foundation Model for Multimodal Histopathology