mlsanityData to 14 Oct 2026

Concurrent ischemic lesion age estimation and segmentation of CT brain using a Transformer-based network

arXiv 2306.12242 ↗First posted 21 Jun 2023eess.IV cs.CV cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

The cornerstone of stroke care is expedient management that varies depending on the time since stroke onset. Consequently, clinical decision making is centered on accurate knowledge of timing and often requires a radiologist to interpret Computed Tomography (CT) of the brain to confirm the occurrence and age of an event. These tasks are particularly challenging due to the subtle expression of acute ischemic lesions and the dynamic nature of their appearance. Automation efforts have not yet applied deep learning to estimate lesion age and treated these two tasks independently, so, have overlooked their inherent complementary relationship. To leverage this, we propose a novel end-to-end multi-task transformer-based network optimized for concurrent segmentation and age estimation of cerebral ischemic lesions. By utilizing gated positional self-attention and CT-specific data augmentation, the proposed method can capture long-range spatial dependencies while maintaining its ability to be trained from scratch under low-data regimes commonly found in medical imaging. Furthermore, to better combine multiple predictions, we incorporate uncertainty by utilizing quantile loss to facilitate estimating a probability density function of lesion age. The effectiveness of our model is then extensively evaluated on a clinical dataset consisting of 776 CT images from two medical centers. Experimental results demonstrate that our method obtains promising performance, with an area under the curve (AUC) of 0.933 for classifying lesion ages <=4.5 hours compared to 0.858 using a conventional approach, and outperforms task-specific state-of-the-art algorithms.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 62 references that are in the map. First posted on arXiv 21 Jun 2023.

Builds on

24 of 62 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  6. 2020End-to-End Object Detection with Transformerscited by 7,414
  7. 2022A ConvNet for the 2020scited by 3,579
  8. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  9. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  10. 2016Pyramid Scene Parsing Networkcited by 2,479
  11. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  12. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
12 more
  1. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
  2. 2018Group Normalizationcited by 1,524
  3. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
  4. 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,209
  5. 2017A Survey on Multi-Task Learningcited by 840
  6. 2015Cyclical Learning Rates for Training Neural Networkscited by 629
  7. 2021ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biasescited by 484
  8. 2019On the Relationship between Self-Attention and Convolutional Layerscited by 300
  9. 2015Order Matters: Sequence to sequence for setscited by 237
  10. 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
  11. 2017Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Modelscited by 128
  12. 2021Reasonable Effectiveness of Random Weighting: A Litmus Test for Multi-Task Learningcited by 101

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.