mlsanityData to 13 Oct 2026

D-TrAttUnet: Dual-Decoder Transformer-Based Attention Unet Architecture for Binary and Multi-classes Covid-19 Infection Segmentation

arXiv 2303.15576 ↗First posted 27 Mar 2023eess.IV cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

In the last three years, the world has been facing a global crisis caused by Covid-19 pandemic. Medical imaging has been playing a crucial role in the fighting against this disease and saving the human lives. Indeed, CT-scans has proved their efficiency in diagnosing, detecting, and following-up the Covid-19 infection. In this paper, we propose a new Transformer-CNN based approach for Covid-19 infection segmentation from the CT slices. The proposed D-TrAttUnet architecture has an Encoder-Decoder structure, where compound Transformer-CNN encoder and Dual-Decoders are proposed. The Transformer-CNN encoder is built using Transformer layers, UpResBlocks, ResBlocks and max-pooling layers. The Dual-Decoder consists of two identical CNN decoders with attention gates. The two decoders are used to segment the infection and the lung regions simultaneously and the losses of the two tasks are joined. The proposed D-TrAttUnet architecture is evaluated for both Binary and Multi-classes Covid-19 infection segmentation. The experimental results prove the efficiency of the proposed approach to deal with the complexity of Covid-19 segmentation task from limited data. Furthermore, D-TrAttUnet architecture outperforms three baseline CNN segmentation architectures (Unet, AttUnet and Unet++) and three state-of-the-art architectures (AnamNet, SCOATNet and CopleNet), in both Binary and Mutli-classes segmentation tasks.

Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 23 of its 51 references that are in the map. First posted on arXiv 27 Mar 2023.

Builds on

23 of 51 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,106
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,223
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,111
  6. 2017Squeeze-and-Excitation Networkscited by 4,772
  7. 2020Training data-efficient image transformers & distillation through attentioncited by 4,574
  8. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,522
  9. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,429
  10. 2021Transformers in Vision: A Surveycited by 1,010
  11. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 957
  12. 2017Road Extraction by Deep Residual U-Netcited by 333
11 more
  1. 2021TransBTS: Multimodal Brain Tumor Segmentation Using Transformercited by 265
  2. 2022Transformers in Medical Imaging: A Surveycited by 245
  3. 2020Inf-Net: Automatic COVID-19 Lung Infection Segmentation from CT Imagescited by 184
  4. 2021TransMed: Transformers Advance Multi-modal Medical Image Classificationcited by 86
  5. 2021U-Net Transformer: Self and Cross Attention for Medical Image Segmentationcited by 81
  6. 2020Towards Data-Efficient Learning: A Benchmark for COVID-19 CT Lung and Infection Segmentationcited by 53
  7. 2020JCS: An Explainable COVID-19 Diagnosis System by Joint Classification and Segmentationcited by 52
  8. 2021FANet: A Feedback Attention Network for Improved Biomedical Image Segmentationcited by 36
  9. 2020A Weakly Supervised Consistency-based Learning Method for COVID-19 Segmentation in CT Imagescited by 24
  10. 2020An Uncertainty-aware Transfer Learning-based Framework for Covid-19 Diagnosiscited by 22
  11. 2021COTR: Convolution in Transformer Network for End to End Polyp Detectioncited by 19

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1.

2 papers.