How Molecules Impact Cells: Unlocking Contrastive PhenoMolecular Retrieval
Not on the map. Why?
Abstract (arXiv)
Predicting molecular impact on cellular function is a core challenge in therapeutic design. Phenomic experiments, designed to capture cellular morphology, utilize microscopy based techniques and demonstrate a high throughput solution for uncovering molecular impact on the cell. In this work, we learn a joint latent space between molecular structures and microscopy phenomic experiments, aligning paired samples with contrastive learning. Specifically, we study the problem ofContrastive PhenoMolecular Retrieval, which consists of zero-shot molecular structure identification conditioned on phenomic experiments. We assess challenges in multi-modal learning of phenomics and molecular modalities such as experimental batch effect, inactive molecule perturbations, and encoding perturbation concentration. We demonstrate improved multi-modal learner retrieval through (1) a uni-modal pre-trained phenomics model, (2) a novel inter sample similarity aware loss, and (3) models conditioned on a representation of molecular concentration. Following this recipe, we propose MolPhenix, a molecular phenomics model. MolPhenix leverages a pre-trained phenomics model to demonstrate significant performance gains across perturbation concentrations, molecular scaffolds, and activity thresholds. In particular, we demonstrate an 8.1x improvement in zero shot molecular retrieval of active molecules over the previous state-of-the-art, reaching 77.33% in top-1% accuracy. These results open the door for machine learning to be applied in virtual phenomics screening, which can significantly benefit drug discovery applications.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 24 of its 61 references that are in the map. First posted on arXiv 10 Sep 2024.
Builds on
24 of 61 references.
References · 24
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 690
- 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 572
12 more
- 2019On Variational Bounds of Mutual Informationcited by 550
- 2020Hopfield Networks is All You Needcited by 461
- 2022Masked Autoencoders As Spatiotemporal Learnerscited by 428
- 2022Pre-training via Denoising for Molecular Property Predictioncited by 124
- 2021CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIPcited by 88
- 2024Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biologycited by 52
- 2023RxRx1: A Dataset for Evaluating Experimental Batch Correction Methodscited by 45
- 2022How to Understand Masked Autoencoderscited by 37
- 2022Is Self-Supervised Learning More Robust Than Supervised Learning?cited by 17
- 2023CWCL: Cross-Modal Transfer with Continuously Weighted Contrastive Losscited by 12
- 2023Molecule-Morphology Contrastive Pretraining for Transferable Molecular Representationcited by 8
- 2023GPS++: Reviving the Art of Message Passing for Molecular Property Predictioncited by 5
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025CellCLIP -- Learning Perturbation Effects in Cell Painting via Text-Guided Contrastive Learningcited by 6
- 2025Integrating chemical structures as treatments improves representations of microscopy images for morphological profilingcited by 2
- 2025A Cross Modal Knowledge Distillation & Data Augmentation Recipe for Improving Transcriptomics Representations through Morphological Featurescited by 2
- 2026Intervention-Aware Multiscale Representation Learning from Imaging Phenomics and Perturbation Transcriptomicscited by 0
- 2026Conditional Neural Optimal Transport for Predicting Cellular Phenotypes from Molecular Structurecited by 0
- 2026MorphoCLIP: Text-Supervised Contrastive Learning for Perturbation Matching in Cell Painting Imagescited by 0
- 2026MorphoCLIP: Text-Supervised Contrastive Learning for Perturbation Matching in Cell Painting Images24 Aug 2026
- 2026Conditional Neural Optimal Transport for Predicting Cellular Phenotypes from Molecular Structure14 Aug 2026
- 2026Intervention-Aware Multiscale Representation Learning from Imaging Phenomics and Perturbation Transcriptomics19 Apr 2026
- 2025A Cross Modal Knowledge Distillation & Data Augmentation Recipe for Improving Transcriptomics Representations through Morphological Features27 May 2025
- 2025CellCLIP -- Learning Perturbation Effects in Cell Painting via Text-Guided Contrastive Learning16 May 2025
- 2025Integrating chemical structures as treatments improves representations of microscopy images for morphological profiling13 Apr 2025