mlsanityData to 14 Oct 2026

Towards Scalable Context-Aware Single-Cell Spatial Transcriptomics Prediction from Histology Images

arXiv 2609.36429 ↗First posted 29 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Predicting gene expression from H&E-stained histology images offers a scalable alternative to costly spatial transcriptomics, yet most existing methods operate at the spot level, where signals from multiple cells are aggregated and critical cellular heterogeneity is obscured. Extending this paradigm to single-cell resolution is non-trivial. Naively applying pathology foundation models faces a scale mismatch: their patch-level representations mix multiple cells, whereas per-cell cropping or resizing distorts morphology and removes local context. Conversely, segmentation-based models without strong pretrained visual encoders often lack the morphological representation capacity needed for accurate molecular prediction and inherit errors from imperfect cell boundary masks. Here, we present CELLO, an efficient end-to-end framework that performs a single pathology foundation model forward pass per image and uses grid sampling to extract location-specific features for all cells simultaneously. We further introduce a distance-decay cross-attention module that refines each cell representation using spatially biased local morphological context. Using 52 public Xenium-H&E pairs from HEST-1k that span 12 organs and approximately 10 million cells, CELLO improves the average predictive accuracy over the evaluated baselines while reducing the mean whole-slide inference time compared to DeepSpot2Cell, a 14.0x speed-up on average that excludes upstream cell segmentation. Our work establishes a scalable foundation for single-cell gene expression prediction from H&E images.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 43 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

15 of 43 references.

References · 15

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2015Spatial Transformer Networkscited by 1,429
  4. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  5. 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 161
  6. 2023Artificial Intelligence for Digital and Computational Pathologycited by 108
  7. 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 107
  8. 2023Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learningcited by 79
  9. 2024Accurate Spatial Gene Expression Prediction by integrating Multi-resolution featurescited by 52
  10. 2022Exemplar Guided Deep Neural Network for Spatial Transcriptomics Analysis of Gene Expression Predictioncited by 39
  11. 2025Diffusion Generative Modeling for Spatially Resolved Gene Expression Inference from Histology Imagescited by 37
  12. 2024Multimodal contrastive learning for spatial gene expression prediction using histology imagescited by 30
3 more
  1. 2025Scalable Generation of Spatial Transcriptomics from Histology Images via Whole-Slide Flow Matchingcited by 19
  2. 2024M2ORT: Many-To-One Regression Transformer for Spatial Transcriptomics Prediction from Histopathology Imagescited by 8
  3. 2025SToFM: a Multi-scale Foundation Model for Spatial Transcriptomicscited by 8

Built on by

Not cited yet.