mlsanityData to 7 Oct 2026

XAI for In-hospital Mortality Prediction via Multimodal ICU Data

arXiv 2312.17624 ↗First posted 29 Dec 2023cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Predicting in-hospital mortality for intensive care unit (ICU) patients is key to final clinical outcomes. AI has shown advantaged accuracy but suffers from the lack of explainability. To address this issue, this paper proposes an eXplainable Multimodal Mortality Predictor (X-MMP) approaching an efficient, explainable AI solution for predicting in-hospital mortality via multimodal ICU data. We employ multimodal learning in our framework, which can receive heterogeneous inputs from clinical data and make decisions. Furthermore, we introduce an explainable method, namely Layer-Wise Propagation to Transformer, as a proper extension of the LRP method to Transformers, producing explanations over multimodal inputs and revealing the salient features attributed to prediction. Moreover, the contribution of each modality to clinical outcomes can be visualized, assisting clinicians in understanding the reasoning behind decision-making. We construct a multimodal dataset based on MIMIC-III and MIMIC-III Waveform Database Matched Subset. Comprehensive experiments on benchmark datasets demonstrate that our proposed framework can achieve reasonable interpretation with competitive prediction accuracy. In particular, our framework can be easily transferred to other clinical tasks, which facilitates the discovery of crucial factors in healthcare research.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 62 references that are in the map. First posted on arXiv 29 Dec 2023.

Builds on

33 of 62 references.

References · 33

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  4. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  5. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  6. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  7. 2019Publicly Available Clinical BERT Embeddingscited by 995
  8. 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 844
  9. 2020Quantifying Attention Flow in Transformerscited by 759
  10. 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
  11. 2017Multitask learning and benchmarking with clinical time series datacited by 287
  12. 2018Scalable and accurate deep learning for electronic health recordscited by 275
21 more
  1. 2015Doctor AI: Predicting Clinical Events via Recurrent Neural Networkscited by 205
  2. 2020A Diagnostic Study of Explainability Techniques for Text Classificationcited by 158
  3. 2020The elephant in the interpretability room: Why use attention as explanation when we have saliency methods?cited by 122
  4. 2017Attend and Diagnose: Clinical Time Series Analysis using Attention Modelscited by 105
  5. 2022XAI for Transformers: Better Explanations through Conservative Propagationcited by 100
  6. 2015Learning to Diagnose with LSTM Recurrent Neural Networkscited by 99
  7. 2020Hurtful Words: Quantifying Biases in Clinical Contextual Word Embeddingscited by 79
  8. 2019Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications, and Bibliography for Explainable AIcited by 63
  9. 2022A Multimodal Transformer: Fusing Clinical Notes with Structured EHR Data for Interpretable In-Hospital Mortality Predictioncited by 48
  10. 2018RAIM: Recurrent Attentive and Intensive Model of Multimodal Patient Monitoring Datacited by 47
  11. 2020Recent advances in deep learning theorycited by 41
  12. 2019Using Clinical Notes with Time Series Data for ICU Managementcited by 38
  13. 2022Explainable AI for clinical and remote health applications: a survey on tabular and time series datacited by 24
  14. 2021BERTSurv: BERT-Based Survival Models for Predicting Outcomes of Trauma Patientscited by 15
  15. 2022Integrating Physiological Time Series and Clinical Notes with Transformer for Early Prediction of Sepsiscited by 14
  16. 2020Temporal Pointwise Convolutional Networks for Length of Stay Prediction in the Intensive Care Unitcited by 13
  17. 2021Explainable Artificial Intelligence for Human Decision-Support System in Medical Domaincited by 12
  18. 2021T3-Vis: a visual analytic framework for Training and fine-Tuning Transformers in NLPcited by 11
  19. 2020Integrating Physiological Time Series and Clinical Notes with Deep Learning for Improved ICU Mortality Predictioncited by 6
  20. 2017Deep Learning to Attend to Risk in ICUcited by 3
  21. 2023XMI-ICU: Explainable Machine Learning Model for Pseudo-Dynamic Prediction of Mortality in the ICU for Heart Attack Patientscited by 2

Built on by

Not cited yet.