Comparison of Deep Learning Approaches for Multi-Label Chest X-Ray Classification
Not on the map. Why?
Abstract (arXiv)
The increased availability of X-ray image archives (e.g. the ChestX-ray14 dataset from the NIH Clinical Center) has triggered a growing interest in deep learning techniques. To provide better insight into the different approaches, and their applications to chest X-ray classification, we investigate a powerful network architecture in detail: the ResNet-50. Building on prior work in this domain, we consider transfer learning with and without fine-tuning as well as the training of a dedicated X-ray network from scratch. To leverage the high spatial resolution of X-ray data, we also include an extended ResNet-50 architecture, and a network integrating non-image data (patient age, gender and acquisition type) in the classification process. In a concluding experiment, we also investigate multiple ResNet depths (i.e. ResNet-38 and ResNet-101). In a systematic evaluation, using 5-fold re-sampling and a multi-label loss function, we compare the performance of the different approaches for pathology classification by ROC statistics and analyze differences between the classifiers using rank correlation. Overall, we observe a considerable spread in the achieved performance and conclude that the X-ray-specific ResNet-38, integrating non-image data yields the best overall results. Furthermore, class activation maps are used to understand the classification process, and a detailed analysis of the impact of non-image features is provided.
Key facts. Cited by 57 papers in the map (data through 13 Oct 2026). First posted on arXiv 6 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 15; 2023: 8; 2024: 5; 2025: 9; 2026: 5.
57 papers.
Sort:
By area:
- 2021Deep Learning for Chest X-ray Analysis: A Surveycited by 84
- 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classificationcited by 65
- 2023A comprehensive survey on deep active learning in medical image analysiscited by 34
- 2024Review of multimodal machine learning approaches in healthcarecited by 30
- 2023GazeGNN: A Gaze-Guided Graph Neural Network for Chest X-ray Classificationcited by 25
- 2021Learning Hierarchical Attention for Weakly-supervised Chest X-Ray Abnormality Localization and Diagnosiscited by 24
- 2021Label-Assemble: Leveraging Multiple Datasets with Partial Labelscited by 20
- 2023Synthetically Enhanced: Unveiling Synthetic Data's Potential in Medical Imaging Researchcited by 18
- 2021Towards Evaluating the Robustness of Deep Diagnostic Models by Adversarial Attackcited by 15
- 2022SwinCheX: Multi-label classification on chest X-ray images with transformerscited by 12
- 2022Indication as Prior Knowledge for Multimodal Disease Classification in Chest Radiographs with Transformerscited by 8
- 2022Defending against Reconstruction Attacks through Differentially Private Federated Learning for Classification of Heterogeneous Chest X-Ray Datacited by 8
38 more
- 2021Learning to Automatically Diagnose Multiple Diseases in Pediatric Chest Radiographs Using Deep Convolutional Neural Networkscited by 7
- 2024Nodule detection and generation on chest X-rays: NODE21 Challengecited by 7
- 2021Key Technology Considerations in Developing and Deploying Machine Learning Models in Clinical Radiology Practicecited by 6
- 2022Semantic Representation and Dependency Learning for Multi-Label Image Recognitioncited by 6
- 2023HydraViT: Adaptive Multi-Branch Transformer for Multi-Label Disease Classification from Chest X-ray Imagescited by 6
- 2021Beyond Fine-tuning: Classifying High Resolution Mammograms using Function-Preserving Transformationscited by 5
- 2022ThoraX-PriorNet: A Novel Attention-Based Architecture Using Anatomical Prior Probability Maps for Thoracic Disease Classificationcited by 5
- 2022What's Cracking? A Review and Analysis of Deep Learning Methods for Structural Crack Segmentation, Detection and Quantificationcited by 4
- 2022Manifestations of Xenophobia in AI Systemscited by 4
- 2024Learning Low-Rank Feature for Thorax Disease Classificationcited by 4
- 2025CCD: Mitigating Hallucinations in Radiology MLLMs via Clinical Contrastive Decodingcited by 4
- 2021Multi-label Ranking: Mining Multi-label and Label Ranking Datacited by 3
- 2021Rheumatoid Arthritis: Automated Scoring of Radiographic Joint Damagecited by 3
- 2022Deep learning for understanding multilabel imbalanced Chest X-ray datasetscited by 3
- 2022On Evaluating Adversarial Robustness of Chest X-ray Classification: Pitfalls and Best Practicescited by 3
- 2021Searching for Pneumothorax in X-Ray Images Using Autoencoded Deep Featurescited by 2
- 2021Many-to-One Distribution Learning and K-Nearest Neighbor Smoothing for Thoracic Disease Identificationcited by 2
- 2021Multi-target prediction for dummies using two-branch neural networkscited by 2
- 2022Image Projective Transformation Rectification with Synthetic Data for Smartphone-captured Chest X-ray Photos Classificationcited by 2
- 2023On the Learnability of Multilabel Rankingcited by 2
- 2025DeepChest: Dynamic Gradient-Free Task Weighting for Effective Multi-Task Learning in Chest X-ray Classificationcited by 2
- 2021Classification of COVID-19 from CXR Images in a 15-class Scenario: an Attempt to Avoid Bias in the Systemcited by 1
- 2021CXR-Net: An Encoder-Decoder-Encoder Multitask Deep Neural Network for Explainable and Accurate Diagnosis of COVID-19 pneumonia with Chest X-ray Imagescited by 1
- 2021Explainable multiple abnormality classification of chest CT volumescited by 1
- 2022Debiasing pipeline improves deep learning model generalization for X-ray based lung nodule detectioncited by 1
- 2023Real-World Performance of Autonomously Reporting Normal Chest Radiographs in NHS Trusts Using a Deep-Learning Algorithm on the GP Pathwaycited by 1
- 20233DGAUnet: 3D generative adversarial networks with a 3D U-Net based generator to achieve the accurate and effective synthesis of clinical tumor image data for pancreatic cancercited by 1
- 2024Discrepancy-based Diffusion Models for Lesion Detection in Brain MRIcited by 1
- 2024Fast-staged CNN Model for Accurate pulmonary diseases and Lung cancer detectioncited by 1
- 2025Hybrid Ensemble Approaches: Optimal Deep Feature Fusion and Hyperparameter-Tuned Classifier Ensembling for Enhanced Brain Tumor Classificationcited by 1
- 2022A Deep Learning Technique using a Sequence of Follow Up X-Rays for Disease classificationcited by 0
- 2022Prediction of COVID-19 using chest X-ray imagescited by 0
- 2022Auto-outlier Fusion Technique for Chest X-ray classification with Multi-head Attention Mechanismcited by 0
- 2023Inspecting Model Fairness in Ultrasound Segmentation Taskscited by 0
- 2025Artificially Generated Visual Scanpath Improves Multi-label Thoracic Disease Classification in Chest X-Ray Imagescited by 0
- 2025Chest X-ray Classification using Deep Convolution Models on Low-resolution images with Uncertain Labelscited by 0
- 2025PromptForSegCXR: Prompt-Driven Multi-Organ and Multi-Disease Segmentation in Chest X-rays using a Multi-stage Fusion Mechanismcited by 0
- 2025MetaChest: Generalized few-shot learning of pathologies from chest X-rayscited by 0
50 most cited of 57 All 57 (JSON)
- 2026Exponential Pixelating Integral transform with dual fractal features for enhanced chest X-ray abnormality detection10 Sep 2026
- 2026PulmoSight-XAI: An Explainable Multi-View Attention Ensemble with Gradient Boosting Meta-Learning for Multi-Label Chest X-Ray Classification5 Jul 2026
- 2026TRCGL-Net: A Long-Tailed Multi-Label Chest X-Ray Classification Framework with Generative Data Augmentation and Label Co-Occurrence Modeling1 Jul 2026
- 2026Learning from Compressed CT: Feature Attention Style Transfer and Structured Factorized Projections for Resource-Efficient Medical Image Analysis1 May 2026
- 2026Comparative Analysis of Deep Learning Architectures for Multi-Disease Classification of Single-Label Chest X-rays11 Mar 2026
- 2025MedSAM-based lung masking for multi-label chest X-ray classification28 Dec 2025
- 2025Learning Sparse Label Couplings for Multilabel Chest X-Ray Diagnosis11 Nov 2025
- 2025MetaChest: Generalized few-shot learning of pathologies from chest X-rays29 Sep 2025
- 2025CCD: Mitigating Hallucinations in Radiology MLLMs via Clinical Contrastive Decoding27 Sep 2025
- 2025Hybrid Ensemble Approaches: Optimal Deep Feature Fusion and Hyperparameter-Tuned Classifier Ensembling for Enhanced Brain Tumor Classification16 Jul 2025
- 2025PromptForSegCXR: Prompt-Driven Multi-Organ and Multi-Disease Segmentation in Chest X-rays using a Multi-stage Fusion Mechanism1 Jul 2025
- 2025DeepChest: Dynamic Gradient-Free Task Weighting for Effective Multi-Task Learning in Chest X-ray Classification29 May 2025
38 more
- 2025Chest X-ray Classification using Deep Convolution Models on Low-resolution images with Uncertain Labels12 Apr 2025
- 2025Artificially Generated Visual Scanpath Improves Multi-label Thoracic Disease Classification in Chest X-Ray Images1 Mar 2025
- 2024Fast-staged CNN Model for Accurate pulmonary diseases and Lung cancer detection16 Dec 2024
- 2024Discrepancy-based Diffusion Models for Lesion Detection in Brain MRI8 May 2024
- 2024Learning Low-Rank Feature for Thorax Disease Classification14 Feb 2024
- 2024Review of multimodal machine learning approaches in healthcare4 Feb 2024
- 2024Nodule detection and generation on chest X-rays: NODE21 Challenge4 Jan 2024
- 2023Inspecting Model Fairness in Ultrasound Segmentation Tasks5 Dec 2023
- 2023Synthetically Enhanced: Unveiling Synthetic Data's Potential in Medical Imaging Research15 Nov 2023
- 20233DGAUnet: 3D generative adversarial networks with a 3D U-Net based generator to achieve the accurate and effective synthesis of clinical tumor image data for pancreatic cancer9 Nov 2023
- 2023A comprehensive survey on deep active learning in medical image analysis22 Oct 2023
- 2023HydraViT: Adaptive Multi-Branch Transformer for Multi-Label Disease Classification from Chest X-ray Images9 Oct 2023
- 2023Real-World Performance of Autonomously Reporting Normal Chest Radiographs in NHS Trusts Using a Deep-Learning Algorithm on the GP Pathway28 Jun 2023
- 2023GazeGNN: A Gaze-Guided Graph Neural Network for Chest X-ray Classification29 May 2023
- 2023On the Learnability of Multilabel Ranking6 Apr 2023
- 2022On Evaluating Adversarial Robustness of Chest X-ray Classification: Pitfalls and Best Practices15 Dec 2022
- 2022Manifestations of Xenophobia in AI Systems15 Dec 2022
- 2022Auto-outlier Fusion Technique for Chest X-ray classification with Multi-head Attention Mechanism15 Nov 2022
- 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification23 Oct 2022
- 2022Image Projective Transformation Rectification with Synthetic Data for Smartphone-captured Chest X-ray Photos Classification12 Oct 2022
- 2022ThoraX-PriorNet: A Novel Attention-Based Architecture Using Anatomical Prior Probability Maps for Thoracic Disease Classification6 Oct 2022
- 2022Deep learning for understanding multilabel imbalanced Chest X-ray datasets28 Jul 2022
- 2022SwinCheX: Multi-label classification on chest X-ray images with transformers9 Jun 2022
- 2022Defending against Reconstruction Attacks through Differentially Private Federated Learning for Classification of Heterogeneous Chest X-Ray Data6 May 2022
- 2022Prediction of COVID-19 using chest X-ray images8 Apr 2022
- 2022Semantic Representation and Dependency Learning for Multi-Label Image Recognition8 Apr 2022
- 2022A Deep Learning Technique using a Sequence of Follow Up X-Rays for Disease classification28 Mar 2022
- 2022Indication as Prior Knowledge for Multimodal Disease Classification in Chest Radiographs with Transformers12 Feb 2022
- 2022What's Cracking? A Review and Analysis of Deep Learning Methods for Structural Crack Segmentation, Detection and Quantification8 Feb 2022
- 2022Debiasing pipeline improves deep learning model generalization for X-ray based lung nodule detection24 Jan 2022
- 2021Learning Hierarchical Attention for Weakly-supervised Chest X-Ray Abnormality Localization and Diagnosis23 Dec 2021
- 2021Explainable multiple abnormality classification of chest CT volumes24 Nov 2021
- 2021CXR-Net: An Encoder-Decoder-Encoder Multitask Deep Neural Network for Explainable and Accurate Diagnosis of COVID-19 pneumonia with Chest X-ray Images20 Oct 2021
- 2021Rheumatoid Arthritis: Automated Scoring of Radiographic Joint Damage17 Oct 2021
- 2021Classification of COVID-19 from CXR Images in a 15-class Scenario: an Attempt to Avoid Bias in the System25 Sep 2021
- 2021Label-Assemble: Leveraging Multiple Datasets with Partial Labels25 Sep 2021
- 2021Learning to Automatically Diagnose Multiple Diseases in Pediatric Chest Radiographs Using Deep Convolutional Neural Networks14 Aug 2021
- 2021Multi-target prediction for dummies using two-branch neural networks19 Apr 2021
50 newest of 57 All 57 (JSON)
- 2021Deep Learning for Chest X-ray Analysis: A Surveycited by 84
- 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classificationcited by 65
- 2023A comprehensive survey on deep active learning in medical image analysiscited by 34
- 2024Review of multimodal machine learning approaches in healthcarecited by 30
- 2023GazeGNN: A Gaze-Guided Graph Neural Network for Chest X-ray Classificationcited by 25
- 2021Learning Hierarchical Attention for Weakly-supervised Chest X-Ray Abnormality Localization and Diagnosiscited by 24
- 2021Label-Assemble: Leveraging Multiple Datasets with Partial Labelscited by 20
- 2021Towards Evaluating the Robustness of Deep Diagnostic Models by Adversarial Attackcited by 15
- 2022SwinCheX: Multi-label classification on chest X-ray images with transformerscited by 12
- 2022Indication as Prior Knowledge for Multimodal Disease Classification in Chest Radiographs with Transformerscited by 8
- 2022Defending against Reconstruction Attacks through Differentially Private Federated Learning for Classification of Heterogeneous Chest X-Ray Datacited by 8
- 2021Learning to Automatically Diagnose Multiple Diseases in Pediatric Chest Radiographs Using Deep Convolutional Neural Networkscited by 7
12 most cited of 54 All 54 (JSON)
- 2026Exponential Pixelating Integral transform with dual fractal features for enhanced chest X-ray abnormality detection10 Sep 2026
- 2026PulmoSight-XAI: An Explainable Multi-View Attention Ensemble with Gradient Boosting Meta-Learning for Multi-Label Chest X-Ray Classification5 Jul 2026
- 2026TRCGL-Net: A Long-Tailed Multi-Label Chest X-Ray Classification Framework with Generative Data Augmentation and Label Co-Occurrence Modeling1 Jul 2026
- 2026Learning from Compressed CT: Feature Attention Style Transfer and Structured Factorized Projections for Resource-Efficient Medical Image Analysis1 May 2026
- 2026Comparative Analysis of Deep Learning Architectures for Multi-Disease Classification of Single-Label Chest X-rays11 Mar 2026
- 2025MedSAM-based lung masking for multi-label chest X-ray classification28 Dec 2025
- 2025Learning Sparse Label Couplings for Multilabel Chest X-Ray Diagnosis11 Nov 2025
- 2025MetaChest: Generalized few-shot learning of pathologies from chest X-rays29 Sep 2025
- 2025Hybrid Ensemble Approaches: Optimal Deep Feature Fusion and Hyperparameter-Tuned Classifier Ensembling for Enhanced Brain Tumor Classification16 Jul 2025
- 2025PromptForSegCXR: Prompt-Driven Multi-Organ and Multi-Disease Segmentation in Chest X-rays using a Multi-stage Fusion Mechanism1 Jul 2025
- 2025DeepChest: Dynamic Gradient-Free Task Weighting for Effective Multi-Task Learning in Chest X-ray Classification29 May 2025
- 2025Chest X-ray Classification using Deep Convolution Models on Low-resolution images with Uncertain Labels12 Apr 2025
12 newest of 54 All 54 (JSON)