mlsanityData to 14 Oct 2026

Prediction of mortality and resource utilization in critical care: a deep learning approach using multimodal electronic health records with natural language processing techniques

arXiv 2508.20460 ↗First posted 28 Aug 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Background Predicting mortality and resource utilization from electronic health records (EHRs) is challenging yet crucial for optimizing patient outcomes and managing costs in intensive care unit (ICU). Existing approaches predominantly focus on structured EHRs, often ignoring the valuable clinical insights in free-text notes. Additionally, the potential of textual information within structured data is not fully leveraged. This study aimed to introduce and assess a deep learning framework using natural language processing techniques that integrates multimodal EHRs to predict mortality and resource utilization in critical care settings. Methods Utilizing two real-world EHR datasets, we developed and evaluated our model on three clinical tasks with leading existing methods. We also performed an ablation study on three key components in our framework: medical prompts, free-texts, and pre-trained sentence encoder. Furthermore, we assessed the model's robustness against the corruption in structured EHRs. Results Our experiments on two real-world datasets across three clinical tasks showed that our proposed model improved performance metrics by 1.6%/0.8% on BACC/AUROC for mortality prediction, 0.5%/2.2% on RMSE/MAE for LOS prediction, 10.9%/11.0% on RMSE/MAE for surgical duration estimation compared to the best existing methods. It consistently demonstrated superior performance compared to other baselines across three tasks at different corruption rates. Conclusions The proposed framework is an effective and accurate deep learning approach for predicting mortality and resource utilization in critical care. The study also highlights the success of using prompt learning with a transformer encoder in analyzing multimodal EHRs. Importantly, the model showed strong resilience to data corruption within structured data, especially at high corruption levels.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 39 references that are in the map. First posted on arXiv 28 Aug 2025.

Builds on

12 of 39 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  6. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  7. 2021Revisiting Deep Learning Models for Tabular Datacited by 740
  8. 2019TabNet: Attentive Interpretable Tabular Learningcited by 648
  9. 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 409
  10. 2021SCARF: Self-Supervised Contrastive Learning using Random Feature Corruptioncited by 156
  11. 2022TransTab: Learning Transferable Tabular Transformers Across Tablescited by 132
  12. 2021Improving Early Sepsis Prediction with Multi Modal Learningcited by 2

Built on by

Not cited yet.