Explainable artificial intelligence model to predict acute critical illness from electronic health records
Not on the map. Why?
Abstract (arXiv)
We developed an explainable artificial intelligence (AI) early warning score (xAI-EWS) system for early detection of acute critical illness. While maintaining a high predictive performance, our system explains to the clinician on which relevant electronic health records (EHRs) data the prediction is grounded. Acute critical illness is often preceded by deterioration of routinely measured clinical parameters, e.g., blood pressure and heart rate. Early clinical prediction is typically based on manually calculated screening metrics that simply weigh these parameters, such as Early Warning Scores (EWS). The predictive performance of EWSs yields a tradeoff between sensitivity and specificity that can lead to negative outcomes for the patient. Previous work on EHR-trained AI systems offers promising results with high levels of predictive performance in relation to the early, real-time prediction of acute critical illness. However, without insight into the complex decisions by such system, clinical translation is hindered. In this letter, we present our xAI-EWS system, which potentiates clinical translation by accompanying a prediction with information on the EHR data explaining it.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 11; 2023: 11; 2024: 3; 2025: 6; 2026: 4.
42 papers.
Sort:
By area:
- 2021Unbox the Black-box for the Medical Explainable AI via Multi-modal and Multi-centre Data Fusion: A Mini-Review, Two Showcases and Beyondcited by 75
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2022Explainable AI for clinical and remote health applications: a survey on tabular and time series datacited by 24
- 2022WindowSHAP: An Efficient Framework for Explaining Time-series Classifiers based on Shapley Valuescited by 24
- 2023A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?cited by 24
- 2022Explainable Artificial Intelligence (XAI) from a user perspective- A synthesis of prior literature and problematizing avenues for future researchcited by 20
- 2023The role of causality in explainable artificial intelligencecited by 17
- 2023Remote patient monitoring using artificial intelligence: Current state, applications, and challengescited by 14
- 2022Analysis of a Deep Learning Model for 12-Lead ECG Classification Reveals Learned Features Similar to Diagnostic Criteriacited by 11
- 2021Offline reinforcement learning with uncertainty for treatment strategies in sepsiscited by 9
- 2025MAP: Evaluation and Multi-Agent Enhancement of Large Language Models for Inpatient Pathwayscited by 9
- 2021Explainable Artificial Intelligence Methods in Combating Pandemics: A Systematic Reviewcited by 5
30 more
- 2022Label Dependent Attention Model for Disease Risk Prediction Using Multimodal Electronic Health Recordscited by 5
- 2021Coalitional strategies for efficient individual prediction explanationcited by 4
- 2022An empirical study of the effect of background data size on the stability of SHapley Additive exPlanations (SHAP) for deep learning modelscited by 4
- 2021Quantifying Explainability in NLP and Analyzing Algorithms for Performance-Explainability Tradeoffcited by 3
- 2023MLOps Spanning Whole Machine Learning Life Cycle: A Surveycited by 3
- 2022Modelling Patient Trajectories Using Multimodal Informationcited by 2
- 2022Using explainability to design physics-aware CNNs for solving subsurface inverse problemscited by 2
- 2023A Brief Review of Explainable Artificial Intelligence in Healthcarecited by 2
- 2023Interpreting Deep Neural Networks with the Package innsightcited by 2
- 2023Explainable AI for clinical risk prediction: a survey of concepts, methods, and modalitiescited by 2
- 2025DynaGraph: Interpretable Multi-Label Prediction from EHRs via Dynamic Graph Learning and Contrastive Augmentationcited by 2
- 2021The Consequences of the Framing of Machine Learning Risk Prediction Models: Evaluation of Sepsis in General Wardscited by 1
- 2021Simple black-box universal adversarial attacks on medical image classification based on deep neural networkscited by 1
- 2022Balanced background and explanation data are needed in explaining deep learning models with SHAP: An empirical study on clinical decision makingcited by 1
- 2023NPRL: Nightly Profile Representation Learning for Early Sepsis Onset Prediction in ICU Trauma Patientscited by 1
- 2023Evaluation of Popular XAI Applied to Clinical Prediction Models: Can They be Trusted?cited by 1
- 2024Applications of Explainable artificial intelligence in Earth system sciencecited by 1
- 2025Explainable AI For Early Detection Of Sepsiscited by 1
- 2022Performance of multilabel machine learning models and risk stratification schemas for predicting stroke and bleeding risk in patients with non-valvular atrial fibrillationcited by 0
- 2022Exploring How Anomalous Model Input and Output Alerts Affect Decision-Making in Healthcarecited by 0
- 2023Echoes of Biases: How Stigmatizing Language Affects AI Performancecited by 0
- 2024Reading ability detection using eye-tracking data with LSTM-based few-shot learningcited by 0
- 2024Development and Comparative Analysis of Machine Learning Models for Hypoxemia Severity Triage in CBRNE Emergency Scenarios Using Physiological and Demographic Data from Medical-Grade Devicescited by 0
- 2025Causally-informed Deep Learning towards Explainable and Generalizable Outcomes Prediction in Critical Carecited by 0
- 2025Towards a Transparent and Interpretable AI Model for Medical Image Classificationscited by 0
- 2025Beyond Traditional Diagnostics: Transforming Patient-Side Information into Predictive Insights with Knowledge Graphs and Prototypescited by 0
- 2026Exposing Vulnerabilities in Explanation for Time Series Classifiers via Dual-Target Attackscited by 0
- 2026YOLO with Kolmogorov-Arnold networks and vision-language foundation models for interpretable object detection with trustworthy multimodal AI in computer vision perceptioncited by 0
- 2026Causal-Transformer with Adaptive Mutation-Locking for Early Prediction of Acute Kidney Injurycited by 0
- 2026ChatHealthAI: Aligning Electronic Health Record Representations with Large Language Models for Grounded Clinical Reasoningcited by 0
- 2026ChatHealthAI: Aligning Electronic Health Record Representations with Large Language Models for Grounded Clinical Reasoning1 Jun 2026
- 2026Causal-Transformer with Adaptive Mutation-Locking for Early Prediction of Acute Kidney Injury22 Apr 2026
- 2026YOLO with Kolmogorov-Arnold networks and vision-language foundation models for interpretable object detection with trustworthy multimodal AI in computer vision perception24 Mar 2026
- 2026Exposing Vulnerabilities in Explanation for Time Series Classifiers via Dual-Target Attacks2 Feb 2026
- 2025Beyond Traditional Diagnostics: Transforming Patient-Side Information into Predictive Insights with Knowledge Graphs and Prototypes9 Dec 2025
- 2025Explainable AI For Early Detection Of Sepsis9 Nov 2025
- 2025Towards a Transparent and Interpretable AI Model for Medical Image Classifications20 Sep 2025
- 2025DynaGraph: Interpretable Multi-Label Prediction from EHRs via Dynamic Graph Learning and Contrastive Augmentation28 Mar 2025
- 2025MAP: Evaluation and Multi-Agent Enhancement of Large Language Models for Inpatient Pathways17 Mar 2025
- 2025Causally-informed Deep Learning towards Explainable and Generalizable Outcomes Prediction in Critical Care4 Feb 2025
- 2024Development and Comparative Analysis of Machine Learning Models for Hypoxemia Severity Triage in CBRNE Emergency Scenarios Using Physiological and Demographic Data from Medical-Grade Devices30 Oct 2024
- 2024Reading ability detection using eye-tracking data with LSTM-based few-shot learning13 Sep 2024
30 more
- 2024Applications of Explainable artificial intelligence in Earth system science12 Jun 2024
- 2023CLIP in Medical Imaging: A Survey12 Dec 2023
- 2023The role of causality in explainable artificial intelligence18 Sep 2023
- 2023Explainable AI for clinical risk prediction: a survey of concepts, methods, and modalities16 Aug 2023
- 2023Evaluation of Popular XAI Applied to Clinical Prediction Models: Can They be Trusted?21 Jun 2023
- 2023Interpreting Deep Neural Networks with the Package innsight19 Jun 2023
- 2023Echoes of Biases: How Stigmatizing Language Affects AI Performance17 May 2023
- 2023NPRL: Nightly Profile Representation Learning for Early Sepsis Onset Prediction in ICU Trauma Patients25 Apr 2023
- 2023MLOps Spanning Whole Machine Learning Life Cycle: A Survey13 Apr 2023
- 2023A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?10 Apr 2023
- 2023A Brief Review of Explainable Artificial Intelligence in Healthcare4 Apr 2023
- 2023Remote patient monitoring using artificial intelligence: Current state, applications, and challenges19 Jan 2023
- 2022Explainable Artificial Intelligence (XAI) from a user perspective- A synthesis of prior literature and problematizing avenues for future research24 Nov 2022
- 2022Using explainability to design physics-aware CNNs for solving subsurface inverse problems16 Nov 2022
- 2022WindowSHAP: An Efficient Framework for Explaining Time-series Classifiers based on Shapley Values11 Nov 2022
- 2022Analysis of a Deep Learning Model for 12-Lead ECG Classification Reveals Learned Features Similar to Diagnostic Criteria3 Nov 2022
- 2022Explainable AI for clinical and remote health applications: a survey on tabular and time series data14 Sep 2022
- 2022Modelling Patient Trajectories Using Multimodal Information9 Sep 2022
- 2022Balanced background and explanation data are needed in explaining deep learning models with SHAP: An empirical study on clinical decision making8 Jun 2022
- 2022Exploring How Anomalous Model Input and Output Alerts Affect Decision-Making in Healthcare27 Apr 2022
- 2022An empirical study of the effect of background data size on the stability of SHapley Additive exPlanations (SHAP) for deep learning models24 Apr 2022
- 2022Performance of multilabel machine learning models and risk stratification schemas for predicting stroke and bleeding risk in patients with non-valvular atrial fibrillation2 Feb 2022
- 2022Label Dependent Attention Model for Disease Risk Prediction Using Multimodal Electronic Health Records18 Jan 2022
- 2021Explainable Artificial Intelligence Methods in Combating Pandemics: A Systematic Review23 Dec 2021
- 2021Simple black-box universal adversarial attacks on medical image classification based on deep neural networks11 Aug 2021
- 2021Quantifying Explainability in NLP and Analyzing Algorithms for Performance-Explainability Tradeoff12 Jul 2021
- 2021Offline reinforcement learning with uncertainty for treatment strategies in sepsis9 Jul 2021
- 2021Coalitional strategies for efficient individual prediction explanation1 Apr 2021
- 2021Unbox the Black-box for the Medical Explainable AI via Multi-modal and Multi-centre Data Fusion: A Mini-Review, Two Showcases and Beyond3 Feb 2021
- 2021The Consequences of the Framing of Machine Learning Risk Prediction Models: Evaluation of Sepsis in General Wards26 Jan 2021
- 2021Unbox the Black-box for the Medical Explainable AI via Multi-modal and Multi-centre Data Fusion: A Mini-Review, Two Showcases and Beyondcited by 75
- 2023CLIP in Medical Imaging: A Surveycited by 40
- 2022Explainable AI for clinical and remote health applications: a survey on tabular and time series datacited by 24
- 2022WindowSHAP: An Efficient Framework for Explaining Time-series Classifiers based on Shapley Valuescited by 24
- 2023A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?cited by 24
- 2022Explainable Artificial Intelligence (XAI) from a user perspective- A synthesis of prior literature and problematizing avenues for future researchcited by 20
- 2023The role of causality in explainable artificial intelligencecited by 17
- 2023Remote patient monitoring using artificial intelligence: Current state, applications, and challengescited by 14
- 2022Analysis of a Deep Learning Model for 12-Lead ECG Classification Reveals Learned Features Similar to Diagnostic Criteriacited by 11
- 2021Explainable Artificial Intelligence Methods in Combating Pandemics: A Systematic Reviewcited by 5
- 2022Label Dependent Attention Model for Disease Risk Prediction Using Multimodal Electronic Health Recordscited by 5
- 2021Coalitional strategies for efficient individual prediction explanationcited by 4
12 most cited of 38 All 38 (JSON)
- 2026Causal-Transformer with Adaptive Mutation-Locking for Early Prediction of Acute Kidney Injury22 Apr 2026
- 2026Exposing Vulnerabilities in Explanation for Time Series Classifiers via Dual-Target Attacks2 Feb 2026
- 2025Beyond Traditional Diagnostics: Transforming Patient-Side Information into Predictive Insights with Knowledge Graphs and Prototypes9 Dec 2025
- 2025Explainable AI For Early Detection Of Sepsis9 Nov 2025
- 2025Towards a Transparent and Interpretable AI Model for Medical Image Classifications20 Sep 2025
- 2025DynaGraph: Interpretable Multi-Label Prediction from EHRs via Dynamic Graph Learning and Contrastive Augmentation28 Mar 2025
- 2025Causally-informed Deep Learning towards Explainable and Generalizable Outcomes Prediction in Critical Care4 Feb 2025
- 2024Development and Comparative Analysis of Machine Learning Models for Hypoxemia Severity Triage in CBRNE Emergency Scenarios Using Physiological and Demographic Data from Medical-Grade Devices30 Oct 2024
- 2024Reading ability detection using eye-tracking data with LSTM-based few-shot learning13 Sep 2024
- 2024Applications of Explainable artificial intelligence in Earth system science12 Jun 2024
- 2023CLIP in Medical Imaging: A Survey12 Dec 2023
- 2023The role of causality in explainable artificial intelligence18 Sep 2023
12 newest of 38 All 38 (JSON)