mlsanityData to 13 Oct 2026

C3-Diff: Super-resolving Spatial Transcriptomics via Cross-modal Cross-content Contrastive Diffusion Modelling

arXiv 2511.05571 ↗First posted 4 Nov 2025cs.CV cs.AIcited by 0

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

The rapid advancement of spatial transcriptomics (ST), i.e., spatial gene expressions, has made it possible to measure gene expression within original tissue, enabling us to discover molecular mechanisms. However, current ST platforms frequently suffer from low resolution, limiting the in-depth understanding of spatial gene expression. Super-resolution approaches promise to enhance ST maps by integrating histology images with gene expressions of profiled tissue spots. However, it remains a challenge to model the interactions between histology images and gene expressions for effective ST enhancement. This study presents a cross-modal cross-content contrastive diffusion framework, called C3-Diff, for ST enhancement with histology images as guidance. In C3-Diff, we firstly analyze the deficiency of traditional contrastive learning paradigm, which is then refined to extract both modal-invariant and content-invariant features of ST maps and histology images. Further, to overcome the problem of low sequencing sensitivity in ST maps, we perform nosing-based information augmentation on the surface of feature unit hypersphere. Finally, we propose a dynamic cross-modal imputation-based training strategy to mitigate ST data scarcity. We tested C3-Diff by benchmarking its performance on four public datasets, where it achieves significant improvements over competing methods. Moreover, we evaluate C3-Diff on downstream tasks of cell type localization, gene expression correlation and single-cell-level gene expression prediction, promoting AI-enhanced biotechnology for biomedical research and clinical applications. Codes are available at https://github.com/XiaofeiWang2018/C3-Diff.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 13 of its 40 references that are in the map. First posted on arXiv 4 Nov 2025.

Builds on

13 of 40 references.

References · 13

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
  4. 2016Densely Connected Convolutional Networkscited by 6,707
  5. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,522
  6. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,429
  7. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,397
  8. 2022Diffusion Models in Vision: A Surveycited by 1,012
  9. 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 792
  10. 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 247
  11. 2023Contrastive Conditional Latent Diffusion for Audio-visual Segmentationcited by 30
  12. 2023A Multi-Modal Contrastive Diffusion Model for Therapeutic Peptide Generationcited by 10
1 more
  1. 2021Representation learning for maximization of MI, nonlinear ICA and nonlinear subspaces with robust density ratio estimationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Cross-modal Diffusion Modelling for Super-resolved Spatial Transcriptomics
  2. 2025Diffusion Generative Modeling for Spatially Resolved Gene Expression Inference from Histology Images
  3. 2025SIGMMA: Hierarchical Graph-Based Multi-Scale Multi-modal Contrastive Alignment of Histopathology Image and Spatial Transcriptome
  4. 2024stMCDI: Masked Conditional Diffusion Model with Graph Neural Network for Spatial Transcriptomics Data Imputation
  5. 2025Scalable Generation of Spatial Transcriptomics from Histology Images via Whole-Slide Flow Matching
  6. 2026Adapting a Pre-trained Single-Cell Foundation Model to Spatial Gene Expression Generation from Histology Images
  7. 2025GeneFlow: Translation of Single-cell Gene Expression to Histopathological Images via Rectified Flow
  8. 2026Concept-based explanation of gene expression prediction from H&E images