Visual Transformer with Statistical Test for COVID-19 Classification
Not on the map. Why?
Abstract (arXiv)
With the massive damage in the world caused by Coronavirus Disease 2019 SARS-CoV-2 (COVID-19), many related research topics have been proposed in the past two years. The Chest Computed Tomography (CT) scans are the most valuable materials to diagnose the COVID-19 symptoms. However, most schemes for COVID-19 classification of Chest CT scan is based on a single-slice level, implying that the most critical CT slice should be selected from the original CT scan volume manually. We simultaneously propose 2-D and 3-D models to predict the COVID-19 of CT scan to tickle this issue. In our 2-D model, we introduce the Deep Wilcoxon signed-rank test (DWCC) to determine the importance of each slice of a CT scan to overcome the issue mentioned previously. Furthermore, a Convolutional CT scan-Aware Transformer (CCAT) is proposed to discover the context of the slices fully. The frame-level feature is extracted from each CT slice based on any backbone network and followed by feeding the features to our within-slice-Transformer (WST) to discover the context information in the pixel dimension. The proposed Between-Slice-Transformer (BST) is used to aggregate the extracted spatial-context features of every CT slice. A simple classifier is then used to judge whether the Spatio-temporal features are COVID-19 or non-COVID-19. The extensive experiments demonstrated that the proposed CCAT and DWCC significantly outperform the state-of-the-art methods.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 10 of its 22 references that are in the map. First posted on arXiv 12 Jul 2021.
Builds on
10 of 22 references.
References · 10
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Pay Attention to MLPscited by 367
- 2020COVID-CT-Dataset: A CT Scan Dataset about COVID-19cited by 93
- 2020Deep Transparent Prediction through Latent Representation Analysiscited by 72
- 2021MIA-COV19D: COVID-19 Detection through 3-D Chest CT Image Analysiscited by 72
- 2020JCS: An Explainable COVID-19 Diagnosis System by Joint Classification and Segmentationcited by 52
- 2020Weakly Supervised Deep Learning for COVID-19 Infection Detection and Classification from CT Imagescited by 26
- 2020Targeted Self Supervision for Classification on a Small COVID-19 CT Scan Datasetcited by 8
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 1; 2024: 1.
8 papers.
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2022EchoCoTr: Estimation of the Left Ventricular Ejection Fraction from Spatiotemporal Echocardiographycited by 16
- 2022A survey on attention mechanisms for medical applications: are we moving towards better algorithms?cited by 15
- 2021Deep Learning Based Automated COVID-19 Classification from Computed Tomography Imagescited by 2
- 2023COVID-19 Detection Using Slices Processing Techniques and a Modified Xception Classifier from Computed Tomography Imagescited by 2
- 2024Diff3Dformer: Leveraging Slice Sequence Diffusion for Enhanced 3D CT Classification with Transformer Networkscited by 2
- 2021CAE-Transformer: Transformer-based Model to Predict Invasiveness of Lung Adenocarcinoma Subsolid Nodules from Non-thin Section 3D CT Scanscited by 1
- 2022Adaptive GLCM sampling for transformer-based COVID-19 detection on CTcited by 0
- 2024Diff3Dformer: Leveraging Slice Sequence Diffusion for Enhanced 3D CT Classification with Transformer Networks24 Jun 2024
- 2023COVID-19 Detection Using Slices Processing Techniques and a Modified Xception Classifier from Computed Tomography Images10 Dec 2023
- 2022EchoCoTr: Estimation of the Left Ventricular Ejection Fraction from Spatiotemporal Echocardiography9 Sep 2022
- 2022Adaptive GLCM sampling for transformer-based COVID-19 detection on CT4 Jul 2022
- 2022A survey on attention mechanisms for medical applications: are we moving towards better algorithms?26 Apr 2022
- 2022Transformers in Medical Imaging: A Survey24 Jan 2022
- 2021Deep Learning Based Automated COVID-19 Classification from Computed Tomography Images22 Nov 2021
- 2021CAE-Transformer: Transformer-based Model to Predict Invasiveness of Lung Adenocarcinoma Subsolid Nodules from Non-thin Section 3D CT Scans17 Oct 2021