Intervention-Aware Multiscale Representation Learning from Imaging Phenomics and Perturbation Transcriptomics
Not on the map. Why?
Abstract (arXiv)
Microscopy-based phenotypic profiling is scalable for drug discovery but lacks the mechanistic depth of transcriptomics, which remains costly and scarce. Existing multimodal approaches either use images to support other modalities or naively align representations by sample identity, ignoring cell-type and dose variations in weakly paired data-limiting generalization to unseen interventions. In this paper, we introduce an intervention-aware distillation framework that leverages perturbational transcriptomics to guide image representation learning. A transcriptome-conditioned teacher integrates gene expression and intervention metadata to produce soft distributions over a chemistry-aware codebook organized by drug similarity. The teacher employs a fine-tuned single-cell foundation model to encode cell-type context and disentangle dose effects. An image-only student learns to predict these distributions from microscopy alone, distilling mechanistic knowledge while operating independently at test time. This design emphasizes intervention semantics rather than identity alignment and explicitly handles dose and cell-type mismatches. We provide theoretical guarantees showing that transcriptomic guidance tightens the risk bound for image-based prediction. On Cell Painting and RxRx datasets paired with L1000, our method significantly improves one-shot transfer to unseen interventions and drug-target gene discovery compared to self-supervised and alignment baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 34 references that are in the map. First posted on arXiv 19 Apr 2026.
Builds on
13 of 34 references.
References · 13
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2024Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biologycited by 52
- 2024How to Build the Virtual Cell with Artificial Intelligence: Priorities and Opportunitiescited by 50
- 2025CellFlux: Simulating Cellular Morphology Changes via Flow Matchingcited by 19
- 2024ViTally Consistent: Scaling Biological Representation Learning for Cell Microscopycited by 13
- 2025RxRx3-core: Benchmarking drug-target interactions in High-Content Microscopycited by 10
- 2024Learning Molecular Representation in a Cellcited by 8
- 2023Removing Biases from Molecular Representations via Information Maximizationcited by 6
- 2024How Molecules Impact Cells: Unlocking Contrastive PhenoMolecular Retrievalcited by 6
Built on by
Not cited yet.