What makes for good morphology representations for spatial omics?
Not on the map. Why?
Abstract (arXiv)
Spatial omics has transformed our understanding of tissue architecture by preserving spatial context of gene expression patterns. Simultaneously, advances in imaging AI have enabled extraction of morphological features describing the tissue. The intersection of spatial omics and imaging AI presents opportunities for a more holistic understanding. In this review we introduce a framework for categorizing spatial omics-morphology combination methods, focusing on how morphological features can be translated or integrated into spatial omics analyses. By translation we mean finding morphological features that spatially correlate with gene expression patterns with the purpose of predicting gene expression. Such features can be used to generate super-resolution gene expression maps or infer genetic information from clinical H&E-stained samples. By integration we mean finding morphological features that spatially complement gene expression patterns with the purpose of enriching information. Such features can be used to define spatial domains, especially where gene expression has preceded morphological changes and where morphology remains after gene expression. We discuss learning strategies and directions for further development of the field.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 88 references that are in the map. First posted on arXiv 30 Jul 2024.
Builds on
25 of 88 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2016Deep Variational Information Bottleneckcited by 915
- 2020What Makes for Good Views for Contrastive Learning?cited by 843
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 357
- 2020Self supervised contrastive learning for digital histopathologycited by 146
13 more
- 2023Artificial Intelligence for Digital and Computational Pathologycited by 106
- 2023Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learningcited by 77
- 2023Self-Supervised Multimodal Learning: A Surveycited by 58
- 2024Accurate Spatial Gene Expression Prediction by integrating Multi-resolution featurescited by 52
- 2021Efficient-CapsNet: Capsule Network with Self-Attention Routingcited by 41
- 2020Predicting molecular phenotypes from histopathology images: a transcriptome-wide expression-morphology analysis in breast cancercited by 21
- 2023SEPAL: Spatial Gene Expression Prediction from Local Graphscited by 13
- 2023hist2RNA: An efficient deep learning architecture to predict gene expression from breast cancer histopathology imagescited by 10
- 2021Transcriptome-wide prediction of prostate cancer gene expression from histopathology images using co-expression based convolutional neural networkscited by 9
- 2024M2ORT: Many-To-One Regression Transformer for Spatial Transcriptomics Prediction from Histopathology Imagescited by 7
- 2023Breast Cancer Histopathology Image based Gene Expression Prediction using Spatial Transcriptomics data and Deep Learningcited by 5
- 2022Emerging Artificial Intelligence Applications in Spatial Transcriptomics Analysiscited by 2
- 2023Transcriptome-supervised classification of tissue morphology using deep learningcited by 1
Built on by
Not cited yet.