Predicting COVID-19 Pneumonia Severity on Chest X-ray with Deep Learning
Not on the map. Why?
Abstract (arXiv)
Purpose: The need to streamline patient management for COVID-19 has become more pressing than ever. Chest X-rays provide a non-invasive (potentially bedside) tool to monitor the progression of the disease. In this study, we present a severity score prediction model for COVID-19 pneumonia for frontal chest X-ray images. Such a tool can gauge severity of COVID-19 lung infections (and pneumonia in general) that can be used for escalation or de-escalation of care as well as monitoring treatment efficacy, especially in the ICU. Methods: Images from a public COVID-19 database were scored retrospectively by three blinded experts in terms of the extent of lung involvement as well as the degree of opacity. A neural network model that was pre-trained on large (non-COVID-19) chest X-ray datasets is used to construct features for COVID-19 images which are predictive for our task. Results: This study finds that training a regression model on a subset of the outputs from an this pre-trained chest X-ray model predicts our geographic extent score (range 0-8) with 1.14 mean absolute error (MAE) and our lung opacity score (range 0-6) with 0.78 MAE. Conclusions: These results indicate that our model's ability to gauge severity of COVID-19 lung infections could be used for escalation or de-escalation of care as well as monitoring treatment efficacy, especially in the intensive care unit (ICU). A proper clinical trial is needed to evaluate efficacy. To enable this we make our code, labels, and data available online at https://github.com/mlmed/torchxrayvision/tree/master/scripts/covid-severity and https://github.com/ieee8023/covid-chestxray-dataset
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 3; 2023: 1; 2024: 1; 2025: 2.
21 papers.
Sort:
- 2021TorchXRayVision: A library of chest X-ray datasets and modelscited by 131
- 2021Deep Learning for Chest X-ray Analysis: A Surveycited by 84
- 2021Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantificationcited by 21
- 2021Improving Pneumonia Localization via Cross-Attention on Medical Images and Reportscited by 21
- 2022A Survey of Deep Learning Techniques for the Analysis of COVID-19 and their usability for Detecting Omicroncited by 13
- 2024Multi-Dataset Multi-Task Learning for COVID-19 Prognosiscited by 11
- 2021COVID-19 Modeling: A Reviewcited by 7
- 2021COVID-Net CXR-S: Deep Convolutional Neural Network for Severity Assessment of COVID-19 Cases from Chest X-ray Imagescited by 6
- 2021An Analysis of the Deployment of Models Trained on Private Tabular Synthetic Data: Unexpected Surprisescited by 6
- 2021Event-based clinical findings extraction from radiology reports with pre-trained language modelcited by 3
- 2021Severity Quantification and Lesion Localization of COVID-19 on CXR using Vision Transformercited by 2
- 2021COVID-Net CT-S: 3D Convolutional Neural Network Architectures for COVID-19 Severity Assessment using Chest CT Imagescited by 1
9 more
- 2021COVID-19 Pneumonia Severity Prediction using Hybrid Convolution-Attention Neural Architecturescited by 1
- 2021MobileCaps: A Lightweight Model for Screening and Severity Analysis of COVID-19 Chest X-Ray Imagescited by 1
- 2022Deterioration Prediction using Time-Series of Three Vital Signs and Current Clinical Features Amongst COVID-19 Patientscited by 1
- 2023Vision Transformer-based Model for Severity Quantification of Lung Pneumonia Using Chest X-ray Imagescited by 1
- 2025Lung Infection Severity Prediction Using Transformers with Conditional TransMix Augmentation and Cross-Attentioncited by 1
- 2021COVID-19 Lung Lesion Segmentation Using a Sparsely Supervised Mask R-CNN on Chest X-rays Automatically Computed from Volumetric CTscited by 0
- 2021A Data Augmented Approach to Transfer Learning for Covid-19 Detectioncited by 0
- 2022Pneumonia Detection in Chest X-Rays using Neural Networkscited by 0
- 2025Diagnosing COVID-19 Severity from Chest X-Ray Images Using ViT and CNN Architecturescited by 0
- 2025Lung Infection Severity Prediction Using Transformers with Conditional TransMix Augmentation and Cross-Attention8 Oct 2025
- 2025Diagnosing COVID-19 Severity from Chest X-Ray Images Using ViT and CNN Architectures23 Feb 2025
- 2024Multi-Dataset Multi-Task Learning for COVID-19 Prognosis22 May 2024
- 2023Vision Transformer-based Model for Severity Quantification of Lung Pneumonia Using Chest X-ray Images18 Mar 2023
- 2022Deterioration Prediction using Time-Series of Three Vital Signs and Current Clinical Features Amongst COVID-19 Patients12 Oct 2022
- 2022Pneumonia Detection in Chest X-Rays using Neural Networks7 Apr 2022
- 2022A Survey of Deep Learning Techniques for the Analysis of COVID-19 and their usability for Detecting Omicron13 Feb 2022
- 2021Event-based clinical findings extraction from radiology reports with pre-trained language model27 Dec 2021
- 2021TorchXRayVision: A library of chest X-ray datasets and models31 Oct 2021
- 2021Improving Pneumonia Localization via Cross-Attention on Medical Images and Reports6 Oct 2021
- 2021MobileCaps: A Lightweight Model for Screening and Severity Analysis of COVID-19 Chest X-Ray Images19 Aug 2021
- 2021A Data Augmented Approach to Transfer Learning for Covid-19 Detection5 Aug 2021
9 more
- 2021COVID-19 Pneumonia Severity Prediction using Hybrid Convolution-Attention Neural Architectures6 Jul 2021
- 2021An Analysis of the Deployment of Models Trained on Private Tabular Synthetic Data: Unexpected Surprises15 Jun 2021
- 2021COVID-19 Lung Lesion Segmentation Using a Sparsely Supervised Mask R-CNN on Chest X-rays Automatically Computed from Volumetric CTs17 May 2021
- 2021COVID-Net CT-S: 3D Convolutional Neural Network Architectures for COVID-19 Severity Assessment using Chest CT Images4 May 2021
- 2021COVID-Net CXR-S: Deep Convolutional Neural Network for Severity Assessment of COVID-19 Cases from Chest X-ray Images1 May 2021
- 2021COVID-19 Modeling: A Review16 Apr 2021
- 2021Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantification15 Apr 2021
- 2021Deep Learning for Chest X-ray Analysis: A Survey15 Mar 2021
- 2021Severity Quantification and Lesion Localization of COVID-19 on CXR using Vision Transformer12 Mar 2021
- 2021TorchXRayVision: A library of chest X-ray datasets and modelscited by 131
- 2021Deep Learning for Chest X-ray Analysis: A Surveycited by 84
- 2021Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantificationcited by 21
- 2021Improving Pneumonia Localization via Cross-Attention on Medical Images and Reportscited by 21
- 2022A Survey of Deep Learning Techniques for the Analysis of COVID-19 and their usability for Detecting Omicroncited by 13
- 2024Multi-Dataset Multi-Task Learning for COVID-19 Prognosiscited by 11
- 2021COVID-19 Modeling: A Reviewcited by 7
- 2021COVID-Net CXR-S: Deep Convolutional Neural Network for Severity Assessment of COVID-19 Cases from Chest X-ray Imagescited by 6
- 2021An Analysis of the Deployment of Models Trained on Private Tabular Synthetic Data: Unexpected Surprisescited by 6
- 2021Event-based clinical findings extraction from radiology reports with pre-trained language modelcited by 3
- 2021Severity Quantification and Lesion Localization of COVID-19 on CXR using Vision Transformercited by 2
- 2021COVID-Net CT-S: 3D Convolutional Neural Network Architectures for COVID-19 Severity Assessment using Chest CT Imagescited by 1
12 most cited of 21 All 21 (JSON)
- 2025Lung Infection Severity Prediction Using Transformers with Conditional TransMix Augmentation and Cross-Attention8 Oct 2025
- 2025Diagnosing COVID-19 Severity from Chest X-Ray Images Using ViT and CNN Architectures23 Feb 2025
- 2024Multi-Dataset Multi-Task Learning for COVID-19 Prognosis22 May 2024
- 2023Vision Transformer-based Model for Severity Quantification of Lung Pneumonia Using Chest X-ray Images18 Mar 2023
- 2022Deterioration Prediction using Time-Series of Three Vital Signs and Current Clinical Features Amongst COVID-19 Patients12 Oct 2022
- 2022Pneumonia Detection in Chest X-Rays using Neural Networks7 Apr 2022
- 2022A Survey of Deep Learning Techniques for the Analysis of COVID-19 and their usability for Detecting Omicron13 Feb 2022
- 2021Event-based clinical findings extraction from radiology reports with pre-trained language model27 Dec 2021
- 2021TorchXRayVision: A library of chest X-ray datasets and models31 Oct 2021
- 2021Improving Pneumonia Localization via Cross-Attention on Medical Images and Reports6 Oct 2021
- 2021MobileCaps: A Lightweight Model for Screening and Severity Analysis of COVID-19 Chest X-Ray Images19 Aug 2021
- 2021A Data Augmented Approach to Transfer Learning for Covid-19 Detection5 Aug 2021
12 newest of 21 All 21 (JSON)