Efficient and Accurate Pneumonia Detection Using a Novel Multi-Scale Transformer Approach
Not on the map. Why?
Abstract (arXiv)
Pneumonia, a prevalent respiratory infection, remains a leading cause of morbidity and mortality worldwide, particularly among vulnerable populations. Chest X-rays serve as a primary tool for pneumonia detection; however, variations in imaging conditions and subtle visual indicators complicate consistent interpretation. Automated tools can enhance traditional methods by improving diagnostic reliability and supporting clinical decision-making. In this study, we propose a novel multi-scale transformer approach for pneumonia detection that integrates lung segmentation and classification into a unified framework. Our method introduces a lightweight transformer-enhanced TransUNet for precise lung segmentation, achieving a Dice score of 95.68% on the "Chest X-ray Masks and Labels" dataset with fewer parameters than traditional transformers. For classification, we employ pre-trained ResNet models (ResNet-50 and ResNet-101) to extract multi-scale feature maps, which are then processed through a modified transformer module to enhance pneumonia detection. This integration of multi-scale feature extraction and lightweight transformer modules ensures robust performance, making our method suitable for resource-constrained clinical environments. Our approach achieves 93.75% accuracy on the "Kermany" dataset and 96.04% accuracy on the "Cohen" dataset, outperforming existing methods while maintaining computational efficiency. This work demonstrates the potential of multi-scale transformer architectures to improve pneumonia diagnosis, offering a scalable and accurate solution to global healthcare challenges. https://github.com/amirrezafateh/Multi-Scale-Transformer-Pneumonia
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 28 of its 116 references that are in the map. First posted on arXiv 8 Aug 2024.
Builds on
28 of 116 references.
References · 28
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
- 2015Recent Advances in Convolutional Neural Networkscited by 360
- 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 331
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 319
- 2020DoubleU-Net: A Deep Convolutional Neural Network for Medical Image Segmentationcited by 125
- 2020COVID-19 Image Data Collectioncited by 100
16 more
- 2021TransMed: Transformers Advance Multi-modal Medical Image Classificationcited by 85
- 2019Bi-Directional ConvLSTM U-Net with Densley Connected Convolutionscited by 82
- 2020CA-Net: Comprehensive Attention Convolutional Neural Networks for Explainable Medical Image Segmentationcited by 79
- 2024On Large Visual Language Models for Medical Imaging Analysis: An Empirical Studycited by 28
- 2021Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantificationcited by 21
- 2020Deep Learning for Automatic Pneumonia Detectioncited by 20
- 2021Self-supervised deep convolutional neural network for chest X-ray classificationcited by 16
- 2020Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection using Chest X-raycited by 15
- 2023Pneumonia Detection on chest X-ray images Using Ensemble of Deep Convolutional Neural Networkscited by 9
- 2018Towards Robust Lung Segmentation in Chest Radiographs with Deep Learningcited by 3
- 2020Intra-model Variability in COVID-19 Classification Using Chest X-ray Imagescited by 3
- 2021Automatic Head Overcoat Thickness Measure with NASNet-Large-Decoder Netcited by 3
- 2024A Novel Approach to Chest X-ray Lung Segmentation Using U-net and Modified Convolutional Block Attention Modulecited by 3
- 2023Employing similarity to highlight differences: On the impact of anatomical assumptions in chest X-ray registration methodscited by 2
- 2023Exploring Self-Supervised Representation Learning For Low-Resource Medical Image Analysiscited by 2
- 2024A novel method to enhance pneumonia detection via a model-level ensembling of CNN and vision transformercited by 1
Built on by
Citing papers per year: 2024: 3; 2025: 2.
5 papers.
- 2025BRISC: Annotated Dataset for Brain Tumor Segmentation and Classificationcited by 14
- 2024MSDNet: Multi-Scale Decoder for Few-Shot Semantic Segmentation via Transformer-Guided Prototypingcited by 5
- 2024Enhancing Few-Shot Image Classification through Learnable Multi-Scale Embedding and Attention Mechanismscited by 4
- 2024FusionLungNet: Multi-scale Fusion Convolution with Refinement Network for Lung CT Image Segmentationcited by 2
- 2025Weakly Supervised Pneumonia Localization from Chest X-Rays Using Deep Neural Network and Grad-CAM Explanationscited by 0
- 2025Weakly Supervised Pneumonia Localization from Chest X-Rays Using Deep Neural Network and Grad-CAM Explanations1 Nov 2025
- 2025BRISC: Annotated Dataset for Brain Tumor Segmentation and Classification17 Jun 2025
- 2024FusionLungNet: Multi-scale Fusion Convolution with Refinement Network for Lung CT Image Segmentation21 Oct 2024
- 2024MSDNet: Multi-Scale Decoder for Few-Shot Semantic Segmentation via Transformer-Guided Prototyping17 Sep 2024
- 2024Enhancing Few-Shot Image Classification through Learnable Multi-Scale Embedding and Attention Mechanisms12 Sep 2024