mlsanityData to 14 Oct 2026

Diffusion Generative Modeling for Spatially Resolved Gene Expression Inference from Histology Images

arXiv 2501.15598 ↗First posted 26 Jan 2025cs.CV cs.AI cs.LGcited by 37

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Spatial Transcriptomics (ST) allows a high-resolution measurement of RNA sequence abundance by systematically connecting cell morphology depicted in Hematoxylin and Eosin (H&E) stained histology images to spatially resolved gene expressions. ST is a time-consuming, expensive yet powerful experimental technique that provides new opportunities to understand cancer mechanisms at a fine-grained molecular level, which is critical for uncovering new approaches for disease diagnosis and treatments. Here, we present Stem (SpaTially resolved gene Expression inference with diffusion Model), a novel computational tool that leverages a conditional diffusion generative model to enable in silico gene expression inference from H&E stained images. Through better capturing the inherent stochasticity and heterogeneity in ST data, Stem achieves state-of-the-art performance on spatial gene expression prediction and generates biologically meaningful gene profiles for new H&E stained images at test time. We evaluate the proposed algorithm on datasets with various tissue sources and sequencing platforms, where it demonstrates clear improvement over existing approaches. Stem generates high-fidelity gene expression predictions that share similar gene variation levels as ground truth data, suggesting that our method preserves the underlying biological heterogeneity. Our proposed pipeline opens up the possibility of analyzing existing, easily accessible H&E stained histology images from a genomics point of view without physically performing gene expression profiling and empowers potential biological discovery from H&E stained histology images.

Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 31 of its 50 references that are in the map. First posted on arXiv 26 Jan 2025.

Builds on

31 of 50 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2022Scalable Diffusion Models with Transformerscited by 6,054
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  11. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  12. 2022Video Diffusion Modelscited by 2,305
19 more
  1. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  2. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,274
  3. 2022AudioGen: Textually Guided Audio Generationcited by 295
  4. 2023SE(3) diffusion model with application to protein backbone generationcited by 219
  5. 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 161
  6. 2020Self supervised contrastive learning for digital histopathologycited by 146
  7. 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 116
  8. 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 107
  9. 2023Virchow: A Million-Slide Digital Pathology Foundation Modelcited by 90
  10. 2023Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learningcited by 79
  11. 2024Accurate Spatial Gene Expression Prediction by integrating Multi-resolution featurescited by 52
  12. 2022Exemplar Guided Deep Neural Network for Spatial Transcriptomics Analysis of Gene Expression Predictioncited by 39
  13. 2023Accurate transition state generation with an object-aware equivariant elementary reaction diffusion modelcited by 30
  14. 2024Multimodal contrastive learning for spatial gene expression prediction using histology imagescited by 30
  15. 2024scDiffusion: conditional generation of high-quality single-cell data using diffusion modelcited by 24
  16. 2024Trivialized Momentum Facilitates Diffusion Generative Modeling on Lie Groupscited by 19
  17. 2024M2ORT: Many-To-One Regression Transformer for Spatial Transcriptomics Prediction from Histopathology Imagescited by 8
  18. 2024Quantum State Generation with Structure-Preserving Diffusion Modelcited by 8
  19. 2023Extraction and Recovery of Spatio-Temporal Structure in Latent Dynamics Alignment with Diffusion Modelscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 18; 2026: 19.

37 papers.

Sort:

By area:

  1. 2025Diffuse Everything: Multimodal Diffusion Models on Arbitrary State Spacescited by 21
  2. 2025MDNS: Masked Diffusion Neural Sampler via Stochastic Optimal Controlcited by 21
  3. 2025Enhancing Reasoning for Diffusion LLMs via Distribution Matching Policy Optimizationcited by 20
  4. 2025Scalable Generation of Spatial Transcriptomics from Histology Images via Whole-Slide Flow Matchingcited by 19
  5. 2025TR2-D2: Tree Search Guided Trajectory-Aware Fine-Tuning for Discrete Diffusioncited by 14
  6. 2025Modeling Microenvironment Trajectories on Spatial Transcriptomics with NicheFlowcited by 7
  7. 2025Content Generation Models in Computational Pathology: A Comprehensive Survey on Methods, Applications, and Challengescited by 5
  8. 2025Img2ST-Net: Efficient High-Resolution Spatial Omics Prediction from Whole Slide Histology Images via Fully Convolutional Image-to-Image Learningcited by 5
  9. 2026HistoPrism: Unlocking Functional Pathway Analysis from Pan-Cancer Histology via Gene Expression Predictioncited by 5
  10. 2025GenAR: Next-Scale Autoregressive Generation for Spatial Gene Expression Predictioncited by 3
  11. 2026Adapting a Pre-trained Single-Cell Foundation Model to Spatial Gene Expression Generation from Histology Imagescited by 3
  12. 2025GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flowcited by 2
25 more
  1. 2025Controllable diffusion-based generation for multi-channel biological datacited by 1
  2. 2025Gene-DML: Dual-Pathway Multi-Level Discrimination for Gene Expression Prediction from Histopathology Imagescited by 1
  3. 2025MVHybrid: Improving Spatial Transcriptomics Prediction with Hybrid State Space-Vision Transformer Backbone in Pathology Vision Foundation Modelscited by 1
  4. 2025Latent Gene Diffusion for Spatial Transcriptomics Completioncited by 1
  5. 2026DUET: Dual-Paradigm Adaptive Expert Triage with Single-cell Inductive Prior for Spatial Transcriptomics Predictioncited by 1
  6. 2026HiST: A Hierarchical Sparse Transformer for Cross-Modal Spatial Transcriptomics Modelingcited by 1
  7. 2025SPATIA: Multimodal Generation and Prediction of Spatial Cell Phenotypescited by 0
  8. 2025Integrating Pathology Foundation Models and Spatial Transcriptomics for Cellular Decomposition from Histology Imagescited by 0
  9. 20253D-Guided Scalable Flow Matching for Generating Volumetric Tissue Spatial Transcriptomics from Serial Histologycited by 0
  10. 2025HyperST: Hierarchical Hyperbolic Learning for Spatial Transcriptomics Predictioncited by 0
  11. 2026MoLF: Mixture-of-Latent-Flow for Pan-Cancer Spatial Gene Expression Prediction from Histologycited by 0
  12. 2026RNA-FM: Flow-Matching Generative Model for Genome-wide RNA-Seq Predictioncited by 0
  13. 2026FLAG: Foundation model representation with Latent diffusion Alignment via Graph for spatial gene expression predictioncited by 0
  14. 2026DriftST: One-Step Generative Inference of Spatial Transcriptomics from H&E Histologycited by 0
  15. 2026HistoGPA: A Context-Conditioned Gene-Prior Attention Framework for Histology-Based Spatial Gene Expression Predictioncited by 0
  16. 2026Gene Ontology-Guided Hierarchical Spatial Gene Expression Prediction from Histopathology Imagescited by 0
  17. 2026Program-space Diffusion for Morphology-to-Transcriptomics Predictioncited by 0
  18. 2026Disentangled Shared Representations Improve Morpho-Transcriptomic Integrationcited by 0
  19. 2026Path2ST: Hierarchical Cell-Tissue Grounded Cross-Modal Translation for Spatial Transcriptomicscited by 0
  20. 2026PaSTel: Anchoring Histology in Spatial Transcriptomics via Multi-Scale Hierarchical Bio-Prior Contrastive Pretrainingcited by 0
  21. 2026STP-BENCH: A Unified Systematic Benchmark for Virtual Spatial Transcriptomics from Histopathology Imagescited by 0
  22. 2026Correlation-Guided Flow Matching with Annealed Masking for Spatial Transcriptomics Generationcited by 0
  23. 2026Preserving DEG Rankings for Gene Discovery in Histology-Based Spatial Gene Expression Predictioncited by 0
  24. 2026Towards Scalable Context-Aware Single-Cell Spatial Transcriptomics Prediction from Histology Imagescited by 0
  25. 2026MIST: Multi-Scale Spatial Context for Gene Expression Prediction from Histologycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Cross-modal Diffusion Modelling for Super-resolved Spatial Transcriptomics
  2. 2026Concept-based explanation of gene expression prediction from H&E images
  3. 2026MINT: Molecularly Informed Training with Spatial Transcriptomics Supervision for Pathology Foundation Models
  4. 2025C3-Diff: Super-resolving Spatial Transcriptomics via Cross-modal Cross-content Contrastive Diffusion Modelling
  5. 2026Cross-Modal Knowledge Distillation from Spatial Transcriptomics to Histology
  6. 2024SpaDiT: Diffusion Transformer for Spatial Gene Expression Prediction using scRNA-seq
  7. 2024RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency
  8. 2026A Generative Foundation Model for Multimodal Histopathology