Path2ST: Hierarchical Cell-Tissue Grounded Cross-Modal Translation for Spatial Transcriptomics
Not on the map. Why?
Abstract (arXiv)
Predicting spatial gene expression from hematoxylin and eosin (H&E)-stained images offers a cost-effective alternative to spatial transcriptomics (ST). However, existing methods treat H&E images as generic visual inputs and ignore their intrinsic biological hierarchy, where spatially organized cell types collectively form functional tissue microenvironments that govern local gene expression programs. To bridge this gap, we formulate H&E-to-ST prediction as a cross-modal semantic translation task and propose Path2ST, a hierarchically grounded autoregressive framework featuring three key components: (i) a Hierarchical Cell-Tissue Conditioning mechanism that fuses explicit and implicit cellular features with tissue-level semantic representations to construct hierarchical conditioning signals; (ii) a Scale-Adaptive Autoregressive Generation process over a hierarchical semantic vocabulary, enabling coarse-to-fine, biologically consistent expression synthesis; and (iii) SpectraLoss, a full-spectrum objective that jointly enforces ordinal fidelity, models transcriptional bursts, and aligns semantic structures with cell types. Extensive experiments on three datasets demonstrate state-of-the-art performance, validating that Path2ST generates highly accurate and spatially coherent transcriptomic profiles. The related code is released at https://github.com/RuochenLiu23/Path2ST.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 46 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
10 of 46 references.
References · 10
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2023Spatially Resolved Gene Expression Prediction from H&E Histology Images via Bi-modal Contrastive Learningcited by 77
- 2024Accurate Spatial Gene Expression Prediction by integrating Multi-resolution featurescited by 52
- 2025Diffusion Generative Modeling for Spatially Resolved Gene Expression Inference from Histology Imagescited by 35
- 2024M2OST: Many-to-one Regression for Predicting Spatial Transcriptomics from Digital Pathology Imagescited by 13
- 2025Spatially Gene Expression Prediction using Dual-Scale Contrastive Learningcited by 7
- 2025PH2ST:ST-Prompt Guided Histological Hypergraph Learning for Spatial Gene Expression Predictioncited by 3
- 2025GenAR: Next-Scale Autoregressive Generation for Spatial Gene Expression Predictioncited by 3
Built on by
Not cited yet.