mlsanityData to 14 Oct 2026

From augmented microscopy to the topological transformer: a new approach in cell image analysis for Alzheimer's research

arXiv 2108.01625 ↗First posted 3 Aug 2021eess.IV cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Cell image analysis is crucial in Alzheimer's research to detect the presence of Aβ protein inhibiting cell function. Deep learning speeds up the process by making only low-level data sufficient for fruitful inspection. We first found Unet is most suitable in augmented microscopy by comparing performance in multi-class semantics segmentation. We develop the augmented microscopy method to capture nuclei in a brightfield image and the transformer using Unet model to convert an input image into a sequence of topological information. The performance regarding Intersection-over-Union is consistent concerning the choice of image preprocessing and ground-truth generation. Training model with data of a specific cell type demonstrates transfer learning applies to some extent. The topological transformer aims to extract persistence silhouettes or landscape signatures containing geometric information of a given image of cells. This feature extraction facilitates studying an image as a collection of one-dimensional data, substantially reducing computational costs. Using the transformer, we attempt grouping cell images by their cell type relying solely on topological features. Performances of the transformers followed by SVM, XGBoost, LGBM, and simple convolutional neural network classifiers are inferior to the conventional image classification. However, since this research initiates a new perspective in biomedical research by combining deep learning and topology for image analysis, we speculate follow-up investigation will reinforce our genuine regime.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 67 references that are in the map. First posted on arXiv 3 Aug 2021.

Builds on

18 of 67 references.

References · 18

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  5. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  6. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
  7. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  8. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
  9. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  10. 2017An introduction to Topological Data Analysis: fundamental and practical aspects for data scientistscited by 172
  11. 2016A Primer on the Signature Method in Machine Learningcited by 104
  12. 2020Signatory: differentiable computations of the signature and logsignature transforms, on both CPU and GPUcited by 46
6 more
  1. 2013Stochastic Convergence of Persistence Landscapes and Silhouettescited by 43
  2. 2018Topological Approaches to Deep Learningcited by 29
  3. 2016Combining Fully Convolutional and Recurrent Neural Networks for 3D Biomedical Image Segmentationcited by 25
  4. 2018Persistence paths and signature features in topological data analysiscited by 17
  5. 2014Using persistent homology and dynamical distances to analyze protein bindingcited by 15
  6. 2018Topological Data Analysis of Task-Based fMRI Data from Experiments on Schizophreniacited by 10

Built on by

Not cited yet.