mlsanityData to 14 Oct 2026

Disentangled Shared Representations Improve Morpho-Transcriptomic Integration

arXiv 2608.14355 ↗First posted 14 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Spatial transcriptomics (ST) enables the simultaneous profiling of gene expression and tissue morphology, creating an opportunity to learn multimodal representations capturing shared morpho-transcriptomic structure. However, standard multimodal models often compress modalities into a common latent space without explicitly separating shared and modality-specific sources of variation, which may limit downstream utility. We investigate whether explicit disentanglement of shared and private latent components improves multimodal representation learning for paired Hematoxylin & Eosin (H&E) and ST data. We compare VAE-based and contrastive approaches, each in standard and disentangled variants, across two cancer cohorts under matched experimental conditions. Representations are evaluated using cross-modal reconstruction, downstream probing and cross-modal probe transfer. The experiments suggest two main trends. First, contrastive objectives yield higher downstream probing performance than VAE-based models. Second, disentangled variants improve the selected reconstruction and probing metrics, although the gains depend on the model family, task, direction, and disentanglement strength. Overall, our results suggest that explicitly factorizing shared and modality-specific information can improve multimodal representation learning for spatial transcriptomics and provides a useful evaluation framework for future foundation models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 22 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

8 of 22 references.

References · 8

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
  3. 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 178
  4. 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 107
  5. 2023Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learningcited by 79
  6. 2025Diffusion Generative Modeling for Spatially Resolved Gene Expression Inference from Histology Imagescited by 37
  7. 2024An Information Criterion for Controlled Disentanglement of Multimodal Datacited by 14
  8. 2024Disentangling shared and private latent factors in multimodal Variational Autoencoderscited by 3

Built on by

Not cited yet.