mlsanityData to 7 Oct 2026

Efficient and Accurate Pneumonia Detection Using a Novel Multi-Scale Transformer Approach

arXiv 2408.04290 ↗First posted 8 Aug 2024eess.IV cs.CV cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Pneumonia, a prevalent respiratory infection, remains a leading cause of morbidity and mortality worldwide, particularly among vulnerable populations. Chest X-rays serve as a primary tool for pneumonia detection; however, variations in imaging conditions and subtle visual indicators complicate consistent interpretation. Automated tools can enhance traditional methods by improving diagnostic reliability and supporting clinical decision-making. In this study, we propose a novel multi-scale transformer approach for pneumonia detection that integrates lung segmentation and classification into a unified framework. Our method introduces a lightweight transformer-enhanced TransUNet for precise lung segmentation, achieving a Dice score of 95.68% on the "Chest X-ray Masks and Labels" dataset with fewer parameters than traditional transformers. For classification, we employ pre-trained ResNet models (ResNet-50 and ResNet-101) to extract multi-scale feature maps, which are then processed through a modified transformer module to enhance pneumonia detection. This integration of multi-scale feature extraction and lightweight transformer modules ensures robust performance, making our method suitable for resource-constrained clinical environments. Our approach achieves 93.75% accuracy on the "Kermany" dataset and 96.04% accuracy on the "Cohen" dataset, outperforming existing methods while maintaining computational efficiency. This work demonstrates the potential of multi-scale transformer architectures to improve pneumonia diagnosis, offering a scalable and accurate solution to global healthcare challenges. https://github.com/amirrezafateh/Multi-Scale-Transformer-Pneumonia

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 28 of its 116 references that are in the map. First posted on arXiv 8 Aug 2024.

Builds on

28 of 116 references.

References · 28

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  3. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  4. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
  5. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
  6. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
  7. 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
  8. 2015Recent Advances in Convolutional Neural Networkscited by 360
  9. 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 331
  10. 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 319
  11. 2020DoubleU-Net: A Deep Convolutional Neural Network for Medical Image Segmentationcited by 125
  12. 2020COVID-19 Image Data Collectioncited by 100
16 more
  1. 2021TransMed: Transformers Advance Multi-modal Medical Image Classificationcited by 85
  2. 2019Bi-Directional ConvLSTM U-Net with Densley Connected Convolutionscited by 82
  3. 2020CA-Net: Comprehensive Attention Convolutional Neural Networks for Explainable Medical Image Segmentationcited by 79
  4. 2024On Large Visual Language Models for Medical Imaging Analysis: An Empirical Studycited by 28
  5. 2021Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantificationcited by 21
  6. 2020Deep Learning for Automatic Pneumonia Detectioncited by 20
  7. 2021Self-supervised deep convolutional neural network for chest X-ray classificationcited by 16
  8. 2020Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection using Chest X-raycited by 15
  9. 2023Pneumonia Detection on chest X-ray images Using Ensemble of Deep Convolutional Neural Networkscited by 9
  10. 2018Towards Robust Lung Segmentation in Chest Radiographs with Deep Learningcited by 3
  11. 2020Intra-model Variability in COVID-19 Classification Using Chest X-ray Imagescited by 3
  12. 2021Automatic Head Overcoat Thickness Measure with NASNet-Large-Decoder Netcited by 3
  13. 2024A Novel Approach to Chest X-ray Lung Segmentation Using U-net and Modified Convolutional Block Attention Modulecited by 3
  14. 2023Employing similarity to highlight differences: On the impact of anatomical assumptions in chest X-ray registration methodscited by 2
  15. 2023Exploring Self-Supervised Representation Learning For Low-Resource Medical Image Analysiscited by 2
  16. 2024A novel method to enhance pneumonia detection via a model-level ensembling of CNN and vision transformercited by 1

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 2.

5 papers.