Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations: a COVID-19 case-study
Not on the map. Why?
Abstract (arXiv)
Computer-aided analysis of biological images typically requires extensive training on large-scale annotated datasets, which is not viable in many situations. In this paper we present GAN-DL, a Discriminator Learner based on the StyleGAN2 architecture, which we employ for self-supervised image representation learning in the case of fluorescent biological images. We show that Wasserstein Generative Adversarial Networks combined with linear Support Vector Machines enable high-throughput compound screening based on raw images. We demonstrate this by classifying active and inactive compounds tested for the inhibition of SARS-CoV-2 infection in VERO and HRCE cell lines. In contrast to previous methods, our deep learning based approach does not require any annotation besides the one that is normally collected during the sample preparation process. We test our technique on the RxRx19a Sars-CoV-2 image collection. The dataset consists of fluorescent images that were generated to assess the ability of regulatory-approved or in late-stage clinical trials compound to modulate the in vitro infection from SARS-CoV-2 in both VERO and HRCE cell lines. We show that our technique can be exploited not only for classification tasks, but also to effectively derive a dose response curve for the tested treatments, in a self-supervised manner. Lastly, we demonstrate its generalization capabilities by successfully addressing a zero-shot learning task, consisting in the categorization of four different cell types of the RxRx1 fluorescent images collection.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 20 of its 44 references that are in the map. First posted on arXiv 16 Jul 2021.
Builds on
20 of 44 references.
References · 20
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2019A Comprehensive Survey on Transfer Learningcited by 1,160
- 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
- 2018Which Training Methods for GANs do actually Converge?cited by 679
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
- 2020A Brief Review of Domain Adaptationcited by 288
- 2017On the regularization of Wasserstein GANscited by 65
- 2020Self-Supervised Nuclei Segmentation in Histopathological Images Using Attentioncited by 30
8 more
- 2019Self-Supervised Similarity Learning for Digital Pathologycited by 22
- 2020Extending and Analyzing Self-Supervised Learning Across Domainscited by 20
- 2020Divide-and-Rule: Self-Supervised Learning for Survival Analysis in Colorectal Cancercited by 17
- 2016MARTA GANs: Unsupervised Representation Learning for Remote Sensing Image Classificationcited by 16
- 2020Improving Image Autoencoder Embeddings with Perceptual Losscited by 13
- 2019Is Discriminator a Good Feature Extractor?cited by 4
- 2021DEEMD: Drug Efficacy Estimation against SARS-CoV-2 based on cell Morphology with Deep multiple instance learningcited by 4
- 2021W2WNet: a two-module probabilistic Convolutional Neural Network with embedded data cleansing functionalitycited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1.
2 papers.