Language as the Interface: Foundation-Model Contrastive Learning Links Transcriptomes and Electrophysiology
Not on the map. Why?
Abstract (arXiv)
Integrating transcriptomic and electrophysiological data is essential for building multimodal foundation models for neuroscience. Patch-seq provides paired measurements of gene expression and intrinsic electrophysiology from the same neuron, establishing a basis for training cross-modal models. Here we introduce LangPatch, a foundation-model-based contrastive learning framework that uses paired Patch-seq data to align pretrained GenePT representations with electrophysiological phenotypes through a language-based interface. Gene descriptions and verbalized electrophysiological profiles are embedded by the same frozen text encoder. A context adapter and projection modules connect the modalities through paired contrastive learning. Across mouse visual, mouse motor, and human cortical cohorts, LangPatch achieves the highest mean transcriptome-to-electrophysiology prediction correlation among the evaluated foundation-model and representation-learning methods. It also improves held-out cross-modal alignment in the two mouse cohorts (FOSCTTM 0.107/0.135 vs. 0.208/0.222 for JAMIE, an existing cross-modal Patch-seq imputation method). It predicts transcriptomic family, type, cortical layer, and marker-gene expression from electrophysiology, exceeding other baselines on most endpoints. More importantly, the method transfers across brain areas and species: a model trained on mouse visual cortex predicts electrophysiology in motor cortex with approximately 70% correlation retention and in human cortex with 47% (58% on acute-slice recordings). Together, these results demonstrate alignment between molecular and functional representations of neurons, providing a building block for multimodal foundation models in neuroscience.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 43 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
13 of 43 references.
References · 13
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,026
- 2022Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classificationcited by 362
- 2022TabLLM: Few-shot Classification of Tabular Data with Large Language Modelscited by 277
- 2022Learnable latent embeddings for joint behavioral and neural analysiscited by 117
- 2024Benchmarking Transcriptomics Foundation Models for Perturbation Analysis : one PCA still rules them allcited by 19
- 2026OmniMouse: Scaling properties of multi-modal, multi-task Brain Models on 150B Neural Tokenscited by 4
- 2019A coupled autoencoder approach for multi-modal analysis of cell typescited by 2
Built on by
Not cited yet.