Improving Hospital Mortality Prediction with Medical Named Entities and Multimodal Learning
Not on the map. Why?
Abstract (arXiv)
Clinical text provides essential information to estimate the acuity of a patient during hospital stays in addition to structured clinical data. In this study, we explore how clinical text can complement a clinical predictive learning task. We leverage an internal medical natural language processing service to perform named entity extraction and negation detection on clinical notes and compose selected entities into a new text corpus to train document representations. We then propose a multimodal neural network to jointly train time series signals and unstructured clinical text representations to predict the in-hospital mortality risk for ICU patients. Our model outperforms the benchmark by 2% AUC.
Key facts. Cited by 14 papers in the map (data through 13 Oct 2026). First posted on arXiv 29 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 3; 2023: 2; 2024: 1; 2025: 2.
14 papers.
Sort:
- 2022Integrated multimodal artificial intelligence framework for healthcare applicationscited by 70
- 2021Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Reviewcited by 35
- 2024Review of multimodal machine learning approaches in healthcarecited by 30
- 2021Literature-Augmented Clinical Outcome Predictioncited by 20
- 2022Multimodal data matters: language model pre-training over structured and unstructured electronic health recordscited by 13
- 2022On the Importance of Clinical Notes in Multi-modal Learning for EHR Datacited by 10
- 2023FineEHR: Refine Clinical Note Representations to Improve Mortality Predictioncited by 9
- 2025Explainable AI for Clinical Outcome Prediction: A Survey of Clinician Perceptions and Preferencescited by 4
- 2021Improving Early Sepsis Prediction with Multi Modal Learningcited by 2
- 2023Patient Outcome Predictions Improve Operations at a Large Hospital Networkcited by 2
- 2021Neural Entity Recognition with Gazetteer based Fusioncited by 1
- 2021Using Clinical Drug Representations for Improving Mortality and Length of Stay Predictionscited by 1
- 2025Multilingual Clinical NER for Diseases and Medications Recognition in Cardiology Texts using BERT Embeddings20 Oct 2025
- 2025Explainable AI for Clinical Outcome Prediction: A Survey of Clinician Perceptions and Preferences27 Feb 2025
- 2024Review of multimodal machine learning approaches in healthcare4 Feb 2024
- 2023Patient Outcome Predictions Improve Operations at a Large Hospital Network25 May 2023
- 2023FineEHR: Refine Clinical Note Representations to Improve Mortality Prediction24 Apr 2023
- 2022On the Importance of Clinical Notes in Multi-modal Learning for EHR Data6 Dec 2022
- 2022Integrated multimodal artificial intelligence framework for healthcare applications25 Feb 2022
- 2022Multimodal data matters: language model pre-training over structured and unstructured electronic health records25 Jan 2022
- 2021Literature-Augmented Clinical Outcome Prediction16 Nov 2021
- 2021Using Clinical Drug Representations for Improving Mortality and Length of Stay Predictions17 Oct 2021
- 2021Improving Early Sepsis Prediction with Multi Modal Learning23 Jul 2021
- 2021Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Review7 Jul 2021
2 more
- 2022Integrated multimodal artificial intelligence framework for healthcare applicationscited by 70
- 2021Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Reviewcited by 35
- 2024Review of multimodal machine learning approaches in healthcarecited by 30
- 2021Literature-Augmented Clinical Outcome Predictioncited by 20
- 2022Multimodal data matters: language model pre-training over structured and unstructured electronic health recordscited by 13
- 2022On the Importance of Clinical Notes in Multi-modal Learning for EHR Datacited by 10
- 2023FineEHR: Refine Clinical Note Representations to Improve Mortality Predictioncited by 9
- 2025Explainable AI for Clinical Outcome Prediction: A Survey of Clinician Perceptions and Preferencescited by 4
- 2021Improving Early Sepsis Prediction with Multi Modal Learningcited by 2
- 2023Patient Outcome Predictions Improve Operations at a Large Hospital Networkcited by 2
- 2021Neural Entity Recognition with Gazetteer based Fusioncited by 1
- 2021Using Clinical Drug Representations for Improving Mortality and Length of Stay Predictionscited by 1
12 most cited of 14 All 14 (JSON)
- 2025Multilingual Clinical NER for Diseases and Medications Recognition in Cardiology Texts using BERT Embeddings20 Oct 2025
- 2025Explainable AI for Clinical Outcome Prediction: A Survey of Clinician Perceptions and Preferences27 Feb 2025
- 2024Review of multimodal machine learning approaches in healthcare4 Feb 2024
- 2023Patient Outcome Predictions Improve Operations at a Large Hospital Network25 May 2023
- 2023FineEHR: Refine Clinical Note Representations to Improve Mortality Prediction24 Apr 2023
- 2022On the Importance of Clinical Notes in Multi-modal Learning for EHR Data6 Dec 2022
- 2022Integrated multimodal artificial intelligence framework for healthcare applications25 Feb 2022
- 2022Multimodal data matters: language model pre-training over structured and unstructured electronic health records25 Jan 2022
- 2021Literature-Augmented Clinical Outcome Prediction16 Nov 2021
- 2021Using Clinical Drug Representations for Improving Mortality and Length of Stay Predictions17 Oct 2021
- 2021Improving Early Sepsis Prediction with Multi Modal Learning23 Jul 2021
- 2021Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Review7 Jul 2021
12 newest of 14 All 14 (JSON)