mlsanityData to 13 Oct 2026

Multimodal Prompt Learning with Irregular EHRs for Robust Monitoring of Critical Care Patients

arXiv 2608.21941 ↗First posted 22 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate assessment of patients in intensive care units (ICUs) is essential for timely clinical intervention and improved patient outcomes. Multimodal electronic health records (EHRs), including structured physiological time series and longitudinal clinical notes, provide complementary information for critical care prediction. However, in real-world clinical settings, individual modalities may be partially observed or entirely unavailable, resulting in substantial performance degradation for existing multimodal models. To address this challenge, we propose a multimodal prompt-learning framework for robust clinical prediction under diverse missing-modality scenarios. The proposed framework introduces four complementary types of prompts: generative prompts, missing-signal prompts, missing-type prompts, and temporal prompts. Generative prompts construct surrogate latent representations for unavailable modalities, while missing-signal prompts distinguish observed representations from generated ones. Missing-type prompts condition the model on different modality-availability configurations, whereas temporal prompts perform condition-specific aggregation over temporally encoded clinical sequences. Together, these prompts enable the model to capture missingness-aware intramodal dependencies and cross-modal interactions within a unified architecture. Extensive experiments demonstrate that our method outperforms existing approaches across evaluation metrics on two missingness settings. Ablation and robustness analyses further verify the complementary contributions of the four prompt types and the effectiveness of the proposed framework for clinical prediction from incomplete multimodal EHR data.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 27 of its 49 references that are in the map. First posted on arXiv 22 Aug 2026.

Builds on

27 of 49 references.

References · 27

  1. 2017Attention Is All You Needcited by 60,106
  2. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  3. 2022MaPLe: Multi-modal Prompt Learningcited by 685
  4. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 564
  5. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 552
  6. 2018Scalable and accurate deep learning for electronic health recordscited by 278
  7. 2021Multi-Time Attention Networks for Irregularly Sampled Time Seriescited by 236
  8. 2018Found in Translation: Learning Robust Joint Representations by Cyclic Translations Between Modalitiescited by 149
  9. 2017Deep EHR: A Survey of Recent Advances in Deep Learning Techniques for Electronic Health Record (EHR) Analysiscited by 146
  10. 2019Set Functions for Time Seriescited by 138
  11. 2019MMTM: Multimodal Transfer Module for CNN Fusioncited by 128
  12. 2023Multimodal Prompting with Missing Modalities for Visual Recognitioncited by 121
15 more
  1. 2021Graph-Guided Network for Irregularly Sampled Multivariate Time Seriescited by 111
  2. 2019Hierarchical Transformers for Long Document Classificationcited by 104
  3. 2019Interpolation-Prediction Networks for Irregularly Sampled Time Seriescited by 89
  4. 2016Modeling Missing Data in Clinical Time Series with RNNscited by 80
  5. 2022Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencescited by 68
  6. 2022MedFuse: Multi-modal fusion with clinical time-series data and chest X-ray imagescited by 53
  7. 2024DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistencycited by 52
  8. 2021Combining 3D Image and Tabular Data via the Dynamic Affine Feature Map Transformcited by 38
  9. 2022Improving Medical Predictions by Irregular Multimodal Electronic Health Records Modelingcited by 33
  10. 2021Dynamic Gaussian Mixture based Deep Generative Model For Robust Forecasting on Sparse Multivariate Time Seriescited by 30
  11. 2024Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognitioncited by 26
  12. 2023Missing-modality Enabled Multi-modal Fusion Architecture for Medical Datacited by 8
  13. 2023SHAPE: A Sample-adaptive Hierarchical Prediction Network for Medication Recommendationcited by 7
  14. 2024CTPD: Cross-Modal Temporal Pattern Discovery for Enhanced Multimodal Electronic Health Records Analysiscited by 6
  15. 2025Causal Representation Learning from Multimodal Clinical Records under Non-Random Modality Missingnesscited by 5

Built on by

Not cited yet.