mlsanityData to 7 Oct 2026

RAIM: Recurrent Attentive and Intensive Model of Multimodal Patient Monitoring Data

arXiv 1807.08820 ↗First posted 23 Jul 2018cs.LG stat.MLcited by 47

Not on the map. Why?

Abstract (arXiv)

With the improvement of medical data capturing, vast amount of continuous patient monitoring data, e.g., electrocardiogram (ECG), real-time vital signs and medications, become available for clinical decision support at intensive care units (ICUs). However, it becomes increasingly challenging to model such data, due to high density of the monitoring data, heterogeneous data types and the requirement for interpretable models. Integration of these high-density monitoring data with the discrete clinical events (including diagnosis, medications, labs) is challenging but potentially rewarding since richness and granularity in such multimodal data increase the possibilities for accurate detection of complex problems and predicting outcomes (e.g., length of stay and mortality). We propose Recurrent Attentive and Intensive Model (RAIM) for jointly analyzing continuous monitoring data and discrete clinical events. RAIM introduces an efficient attention mechanism for continuous monitoring data (e.g., ECG), which is guided by discrete clinical events (e.g, medication usage). We apply RAIM in predicting physiological decompensation and length of stay in those critically ill patients at ICU. With evaluations on MIMIC- III Waveform Database Matched Subset, we obtain an AUC-ROC score of 90.18% for predicting decompensation and an accuracy of 86.82% for forecasting length of stay with our final model, which outperforms our six baseline models.

Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Jul 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 8; 2022: 10; 2023: 10; 2024: 7; 2025: 11; 2026: 1.

47 papers.

Sort:

By area:

  1. 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 97
  2. 2021Explaining Time Series Predictions with Dynamic Maskscited by 72
  3. 2022M3Care: Learning with Missing Modalities in Multimodal Healthcare Datacited by 71
  4. 2023Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Seriescited by 54
  5. 2021MUFASA: Multimodal Fusion Architecture Search for Electronic Health Recordscited by 30
  6. 2021Temporal Dependencies in Feature Importance for Time Series Predictionscited by 27
  7. 2021How to Leverage Multimodal EHR Data for Better Medical Predictions?cited by 26
  8. 2024Large Language Models in Drug Discovery and Development: From Disease Mechanisms to Clinical Trialscited by 24
  9. 2025Beyond Sensor Data: Foundation Models of Behavioral Data from Wearables Improve Health Predictionscited by 18
  10. 2025Out-of-Distribution Generalization in Time Series: A Surveycited by 15
  11. 2022Integrating Physiological Time Series and Clinical Notes with Transformer for Early Prediction of Sepsiscited by 14
  12. 2023Hierarchical Pretraining on Multimodal Electronic Health Recordscited by 11
35 more
  1. 2024Recent Advances in Predictive Modeling with Electronic Health Recordscited by 11
  2. 2025Dynamic Uncertainty-aware Multimodal Fusion for Outdoor Health Monitoringcited by 10
  3. 2021PyHealth: A Python Library for Health Predictive Modelscited by 9
  4. 2024SMART: Towards Pre-trained Missing-Aware Model for Patient Health Status Predictioncited by 8
  5. 2023MTS2Graph: Interpretable Multivariate Time Series Classification with Temporal Evolving Graphscited by 7
  6. 2024Synthesizing Multimodal Electronic Health Records via Predictive Diffusion Modelscited by 7
  7. 2022Artificial Intelligence for In Silico Clinical Trials: A Reviewcited by 6
  8. 2022Label Dependent Attention Model for Disease Risk Prediction Using Multimodal Electronic Health Recordscited by 5
  9. 2023On the Importance of Step-wise Embeddings for Heterogeneous Clinical Time-Seriescited by 5
  10. 2021Explainable Health Risk Predictor with Transformer-based Medicare Claim Encodercited by 4
  11. 2022Self-explaining Hierarchical Model for Intraoperative Time Seriescited by 4
  12. 2021Generalized and Transferable Patient Language Representation for Phenotyping with Limited Datacited by 3
  13. 2022Multimodal Machine Learning in Precision Healthcited by 3
  14. 2023Temporal-spatial Correlation Attention Network for Clinical Data Analysis in Intensive Care Unitcited by 3
  15. 2023PyTrial: Machine Learning Software and Benchmark for Clinical Trial Applicationscited by 3
  16. 2024Automated Fusion of Multimodal Electronic Health Records for Better Medical Predictionscited by 3
  17. 2022Self-supervised Representation Learning on Electronic Health Records with Graph Kernel Infomaxcited by 2
  18. 2024GARNN: An Interpretable Graph Attentive Recurrent Neural Network for Predicting Blood Glucose Levels via Multivariate Time Seriescited by 2
  19. 2024Large Language Model as a Universal Clinical Multi-task Decodercited by 2
  20. 2025Representation Learning of Limit Order Book: A Comprehensive Study and Benchmarkingcited by 2
  21. 2025MEDMKG: Benchmarking Medical Knowledge Exploitation with Multimodal Knowledge Graphcited by 2
  22. 2025MTM: A Multi-Scale Token Mixing Transformer for Irregular Multivariate Time Series Classificationcited by 2
  23. 2021Interpretable Additive Recurrent Neural Networks For Multivariate Clinical Time Seriescited by 1
  24. 2022Label-dependent and event-guided interpretable disease risk prediction using EHRscited by 1
  25. 2022UnfoldML: Cost-Aware and Uncertainty-Based Dynamic 2D Prediction for Multi-Stage Classificationcited by 1
  26. 2025Multimodal Disease Progression Modeling via Spatiotemporal Disentanglement and Multiscale Alignmentcited by 1
  27. 2025CURENet: Combining Unified Representations for Efficient Chronic Disease Predictioncited by 1
  28. 2026VTBench: A Multimodal Framework for Time-Series Classification with Chart-Based Representationscited by 1
  29. 2022GRU-TV: Time- and velocity-aware GRU for patient representation on multivariate clinical time-series datacited by 0
  30. 2023Length of Stay prediction for Hospital Management using Domain Adaptationcited by 0
  31. 2023Language Model Training Paradigms for Clinical Feature Embeddingscited by 0
  32. 2023XAI for In-hospital Mortality Prediction via Multimodal ICU Datacited by 0
  33. 2025Predicting Clinical Outcomes with Waveform LSTMscited by 0
  34. 2025STRGCN: Capturing Asynchronous Spatio-Temporal Dependencies for Irregular Multivariate Time Series Forecastingcited by 0
  35. 2025Early GVHD Prediction in Liver Transplantation via Multi-Modal Deep Learning on Imbalanced EHR Datacited by 0