Improving Clinical Outcome Predictions Using Convolution over Medical Entities with Multimodal Learning
Not on the map. Why?
Abstract (arXiv)
Early prediction of mortality and length of stay(LOS) of a patient is vital for saving a patient's life and management of hospital resources. Availability of electronic health records(EHR) makes a huge impact on the healthcare domain and there has seen several works on predicting clinical problems. However, many studies did not benefit from the clinical notes because of the sparse, and high dimensional nature. In this work, we extract medical entities from clinical notes and use them as additional features besides time-series features to improve our predictions. We propose a convolution based multimodal architecture, which not only learns effectively combining medical entities and time-series ICU signals of patients, but also allows us to compare the effect of different embedding techniques such as Word2vec, FastText on medical entities. In the experiments, our proposed method robustly outperforms all other baseline models including different multimodal architectures for all clinical tasks. The code for the proposed method is available at https://github.com/tanlab/ConvolutionMedicalNer.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 3; 2024: 1; 2025: 1.
11 papers.
- 2022Integrated multimodal artificial intelligence framework for healthcare applicationscited by 71
- 2022Multimodal data matters: language model pre-training over structured and unstructured electronic health recordscited by 13
- 2021Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectivescited by 7
- 2022Multimodal Machine Learning in Precision Healthcited by 3
- 2023Knowledge Graph Representations to enhance Intensive Care Time-Series Predictionscited by 3
- 2024Contrastive Learning on Multimodal Analysis of Electronic Health Recordscited by 3
- 2021Patient Outcome and Zero-shot Diagnosis Prediction with Hypernetwork-guided Multitask Learningcited by 2
- 2023Patient Outcome Predictions Improve Operations at a Large Hospital Networkcited by 2
- 2021Using Clinical Drug Representations for Improving Mortality and Length of Stay Predictionscited by 1
- 2025CURENet: Combining Unified Representations for Efficient Chronic Disease Predictioncited by 1
- 2023On Preserving the Knowledge of Long Clinical Textscited by 0
- 2025CURENet: Combining Unified Representations for Efficient Chronic Disease Prediction14 Nov 2025
- 2024Contrastive Learning on Multimodal Analysis of Electronic Health Records22 Mar 2024
- 2023Knowledge Graph Representations to enhance Intensive Care Time-Series Predictions13 Nov 2023
- 2023On Preserving the Knowledge of Long Clinical Texts2 Nov 2023
- 2023Patient Outcome Predictions Improve Operations at a Large Hospital Network25 May 2023
- 2022Multimodal Machine Learning in Precision Health10 Apr 2022
- 2022Integrated multimodal artificial intelligence framework for healthcare applications25 Feb 2022
- 2022Multimodal data matters: language model pre-training over structured and unstructured electronic health records25 Jan 2022
- 2021Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectives9 Nov 2021
- 2021Using Clinical Drug Representations for Improving Mortality and Length of Stay Predictions17 Oct 2021
- 2021Patient Outcome and Zero-shot Diagnosis Prediction with Hypernetwork-guided Multitask Learning7 Sep 2021