mlsanityData to 14 Oct 2026

Self-supervised Representation Learning for Cell Event Recognition through Time Arrow Prediction

arXiv 2411.03924 ↗First posted 6 Nov 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The spatio-temporal nature of live-cell microscopy data poses challenges in the analysis of cell states which is fundamental in bioimaging. Deep-learning based segmentation or tracking methods rely on large amount of high quality annotations to work effectively. In this work, we explore an alternative solution: using feature maps obtained from self-supervised representation learning (SSRL) on time arrow prediction (TAP) for the downstream supervised task of cell event recognition. We demonstrate through extensive experiments and analysis that this approach can achieve better performance with limited annotation compared to models trained from end to end using fully supervised approach. Our analysis also provides insight into applications of the SSRL using TAP in live-cell microscopy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 21 references that are in the map. First posted on arXiv 6 Nov 2024.

Builds on

14 of 21 references.

References · 14

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  5. 2017On Calibration of Modern Neural Networkscited by 4,960
  6. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  7. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
  8. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
  9. 2018Cell Detection with Star-convex Polygonscited by 183
  10. 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 148
  11. 2022Video Anomaly Detection by Solving Decoupled Spatio-Temporal Jigsaw Puzzlescited by 62
  12. 2019Star-convex Polyhedra for 3D Object Detection and Segmentation in Microscopycited by 45
2 more
  1. 2021Recur, Attend or Convolve? On Whether Temporal Modeling Matters for Cross-Domain Robustness in Action Recognitioncited by 7
  2. 2023Self-supervised dense representation learning for live-cell microscopy with time arrow predictioncited by 3

Built on by

Not cited yet.