mlsanityData to 14 Oct 2026

Self-supervised learning on gene expression data

arXiv 2507.13912 ↗First posted 18 Jul 2025cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Predicting phenotypes from gene expression data is a crucial task in biomedical research, enabling insights into disease mechanisms, drug responses, and personalized medicine. Traditional machine learning and deep learning rely on supervised learning, which requires large quantities of labeled data that are costly and time-consuming to obtain in the case of gene expression data. Self-supervised learning has recently emerged as a promising approach to overcome these limitations by extracting information directly from the structure of unlabeled data. In this study, we investigate the application of state-of-the-art self-supervised learning methods to bulk gene expression data for phenotype prediction. We selected three self-supervised methods, based on different approaches, to assess their ability to exploit the inherent structure of the data and to generate qualitative representations which can be used for downstream predictive tasks. By using several publicly available gene expression datasets, we demonstrate how the selected methods can effectively capture complex information and improve phenotype prediction accuracy. The results obtained show that self-supervised learning methods can outperform traditional supervised models besides offering significant advantage by reducing the dependency on annotated data. We provide a comprehensive analysis of the performance of each method by highlighting their strengths and limitations. We also provide recommendations for using these methods depending on the case under study. Finally, we outline future research directions to enhance the application of self-supervised learning in the field of gene expression data analysis. This study is the first work that deals with bulk RNA-Seq data and self-supervised learning.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 27 references that are in the map. First posted on arXiv 18 Jul 2025.

Builds on

14 of 27 references.

References · 14

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  4. 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 409
  5. 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 378
  6. 2021SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Trainingcited by 319
  7. 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 207
  8. 2021SCARF: Self-Supervised Contrastive Learning using Random Feature Corruptioncited by 156
  9. 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 148
  10. 2022LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Taskscited by 148
  11. 2022TransTab: Learning Transferable Tabular Transformers Across Tablescited by 132
  12. 2023STUNT: Few-shot Tabular Learning with Self-generated Tasks from Unlabeled Tablescited by 49
2 more
  1. 2024A Survey on Self-Supervised Learning for Non-Sequential Tabular Datacited by 15
  2. 2023Machine Learning Methods for Cancer Classification Using Gene Expression Data: A Reviewcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.