mlsanityData to 14 Oct 2026

scSSL-Bench: Benchmarking Self-Supervised Learning for Single-Cell Data

arXiv 2506.10031 ↗First posted 10 Jun 2025q-bio.QM cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Self-supervised learning (SSL) has proven to be a powerful approach for extracting biologically meaningful representations from single-cell data. To advance our understanding of SSL methods applied to single-cell data, we present scSSL-Bench, a comprehensive benchmark that evaluates nineteen SSL methods. Our evaluation spans nine datasets and focuses on three common downstream tasks: batch correction, cell type annotation, and missing modality prediction. Furthermore, we systematically assess various data augmentation strategies. Our analysis reveals task-specific trade-offs: the specialized single-cell frameworks, scVI, CLAIRE, and the finetuned scGPT excel at uni-modal batch correction, while generic SSL methods, such as VICReg and SimCLR, demonstrate superior performance in cell typing and multi-modal data integration. Random masking emerges as the most effective augmentation technique across all tasks, surpassing domain-specific augmentations. Notably, our results indicate the need for a specialized single-cell multi-modal data integration framework. scSSL-Bench provides a standardized evaluation platform and concrete recommendations for applying SSL to single-cell analysis, advancing the convergence of deep learning and single-cell genomics.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 67 references that are in the map. First posted on arXiv 10 Jun 2025.

Builds on

16 of 67 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  6. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  7. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
  8. 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 500
  9. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
  10. 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 378
  11. 2019Domain-Specific Batch Normalization for Unsupervised Domain Adaptationcited by 197
  12. 2022Self-Supervised Learning for Videos: A Surveycited by 85
4 more
  1. 2022Rethinking the Augmentation Module in Contrastive Learning: Learning Hierarchical Augmentation Invariance with Expanded Viewscited by 37
  2. 2024Investigating the Benefits of Projection Head for Representation Learningcited by 20
  3. 2024A Closer Look at Benchmarking Self-Supervised Pre-training with Image Classificationcited by 19
  4. 2022An Empirical Study on Disentanglement of Negative-free Contrastive Learningcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.