Contrastive Learning of Single-Cell Phenotypic Representations for Treatment Classification
Not on the map. Why?
Abstract (arXiv)
Learning robust representations to discriminate cell phenotypes based on microscopy images is important for drug discovery. Drug development efforts typically analyse thousands of cell images to screen for potential treatments. Early works focus on creating hand-engineered features from these images or learn such features with deep neural networks in a fully or weakly-supervised framework. Both require prior knowledge or labelled datasets. Therefore, subsequent works propose unsupervised approaches based on generative models to learn these representations. Recently, representations learned with self-supervised contrastive loss-based methods have yielded state-of-the-art results on various imaging tasks compared to earlier unsupervised approaches. In this work, we leverage a contrastive learning framework to learn appropriate representations from single-cell fluorescent microscopy images for the task of Mechanism-of-Action classification. The proposed work is evaluated on the annotated BBBC021 dataset, and we obtain state-of-the-art results in NSC, NCSB and drop metrics for an unsupervised approach. We observe an improvement of 10% in NCSB accuracy and 11% in NSC-NSCB drop over the previously best unsupervised method. Moreover, the performance of our unsupervised approach ties with the best supervised approach. Additionally, we observe that our framework performs well even without post-processing, unlike earlier methods. With this, we conclude that one can learn robust cell representations with contrastive learning.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 22 of its 37 references that are in the map. First posted on arXiv 30 Mar 2021.
Builds on
22 of 37 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
- 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 636
- 2016Adversarial Feature Learningcited by 350
- 2021Big Self-Supervised Models Advance Medical Image Classificationcited by 320
- 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
10 more
- 2019Large Scale Adversarial Representation Learningcited by 238
- 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 170
- 2016Correlation Alignment for Unsupervised Domain Adaptationcited by 146
- 2020SAM: Self-supervised Learning of Pixel-wise Anatomical Embeddings in Radiological Imagescited by 66
- 2021MedAug: Contrastive learning leveraging patient metadata improves representations for chest X-ray interpretationcited by 52
- 2015Classifying and Segmenting Microscopy Images Using Convolutional Multiple Instance Learningcited by 38
- 2020PGL: Prior-Guided Local Self-supervised Learning for 3D Medical Image Segmentationcited by 36
- 2021COVID-19 Prognosis via Self-Supervised Representation Learning and Multi-Image Predictioncited by 36
- 2017Correcting Nuisance Variation using Wasserstein Distancecited by 1
- 2020Latent Feature Representation via Unsupervised Learning for Pattern Discovery in Massive Electron Microscopy Image Volumescited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 5; 2024: 0; 2025: 1; 2026: 1.
12 papers.
- 2023RxRx1: A Dataset for Evaluating Experimental Batch Correction Methodscited by 45
- 2022Self-Supervised Learning of Phenotypic Representations from Cell Images with Weak Labelscited by 9
- 2022Metadata-guided Consistency Learning for High Content Imagescited by 8
- 2023No Free Lunch in Self Supervised Representation Learningcited by 7
- 2022Comparison of semi-supervised learning methods for High Content Screening quality controlcited by 3
- 2023Morphological Profiling for Drug Discovery in the Era of Deep Learningcited by 3
- 2021Anchoring to Exemplars for Training Mixture-of-Expert Cell Embeddingscited by 2
- 2023Mixed Models with Multiple Instance Learningcited by 2
- 2025Integrating chemical structures as treatments improves representations of microscopy images for morphological profilingcited by 2
- 2022Optimizing transformations for contrastive learning in a differentiable frameworkcited by 1
- 2026Elucidating the Design Space of Flow Matching for Cellular Microscopycited by 1
- 2023Self-supervised pseudo-colorizing of masked cellscited by 0
- 2026Elucidating the Design Space of Flow Matching for Cellular Microscopy25 Mar 2026
- 2025Integrating chemical structures as treatments improves representations of microscopy images for morphological profiling13 Apr 2025
- 2023Morphological Profiling for Drug Discovery in the Era of Deep Learning13 Dec 2023
- 2023Mixed Models with Multiple Instance Learning4 Nov 2023
- 2023No Free Lunch in Self Supervised Representation Learning23 Apr 2023
- 2023Self-supervised pseudo-colorizing of masked cells12 Feb 2023
- 2023RxRx1: A Dataset for Evaluating Experimental Batch Correction Methods13 Jan 2023
- 2022Metadata-guided Consistency Learning for High Content Images22 Dec 2022
- 2022Self-Supervised Learning of Phenotypic Representations from Cell Images with Weak Labels16 Sep 2022
- 2022Comparison of semi-supervised learning methods for High Content Screening quality control9 Aug 2022
- 2022Optimizing transformations for contrastive learning in a differentiable framework27 Jul 2022
- 2021Anchoring to Exemplars for Training Mixture-of-Expert Cell Embeddings6 Dec 2021