mlsanityData to 7 Oct 2026

SMART: Towards Pre-trained Missing-Aware Model for Patient Health Status Prediction

arXiv 2405.09039 ↗First posted 15 May 2024cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Electronic health record (EHR) data has emerged as a valuable resource for analyzing patient health status. However, the prevalence of missing data in EHR poses significant challenges to existing methods, leading to spurious correlations and suboptimal predictions. While various imputation techniques have been developed to address this issue, they often obsess unnecessary details and may introduce additional noise when making clinical predictions. To tackle this problem, we propose SMART, a Self-Supervised Missing-Aware RepresenTation Learning approach for patient health status prediction, which encodes missing information via elaborated attentions and learns to impute missing values through a novel self-supervised pre-training approach that reconstructs missing data representations in the latent space. By adopting missing-aware attentions and focusing on learning higher-order representations, SMART promotes better generalization and robustness to missing data. We validate the effectiveness of SMART through extensive experiments on six EHR tasks, demonstrating its superiority over state-of-the-art methods.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 35 of its 67 references that are in the map. First posted on arXiv 15 May 2024.

Builds on

35 of 67 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2016Layer Normalizationcited by 5,579
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  6. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  7. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 548
  8. 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 344
  9. 2017Multitask learning and benchmarking with clinical time series datacited by 287
  10. 2021Multi-Time Attention Networks for Irregularly Sampled Time Seriescited by 234
  11. 2016GRAM: Graph-based Attention Model for Healthcare Representation Learningcited by 152
  12. 2019Set Functions for Time Seriescited by 137
23 more
  1. 2017Dipole: Diagnosis Prediction in Healthcare via Attention-based Bidirectional Recurrent Neural Networkscited by 114
  2. 2021Graph-Guided Network for Irregularly Sampled Multivariate Time Seriescited by 110
  3. 2017Attend and Diagnose: Clinical Time Series Analysis using Attention Modelscited by 105
  4. 2016Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequencescited by 98
  5. 2019Interpolation-Prediction Networks for Irregularly Sampled Time Seriescited by 89
  6. 2022M3Care: Learning with Missing Modalities in Multimodal Healthcare Datacited by 71
  7. 2024ContiFormer: Continuous-Time Transformer for Irregular Time Series Modelingcited by 61
  8. 2023GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge Graphscited by 57
  9. 2019ConCare: Personalized Clinical Feature Embedding via Capturing the Healthcare Contextcited by 56
  10. 2023Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Seriescited by 54
  11. 2019AdaCare: Explainable Clinical Health Status Representation Learning via Scale-Adaptive Feature Extraction and Recalibrationcited by 50
  12. 2018RAIM: Recurrent Attentive and Intensive Model of Multimodal Patient Monitoring Datacited by 47
  13. 2020StageNet: Stage-Aware Neural Networks for Health Risk Predictioncited by 47
  14. 2020Deep Representation Learning of Patient Data from Electronic Health Records (EHR): A Systematic Reviewcited by 46
  15. 2020Deep Representation Learning of Electronic Health Records to Unlock Patient Stratification at Scalecited by 39
  16. 2022Improving Medical Predictions by Irregular Multimodal Electronic Health Records Modelingcited by 33
  17. 2018Patient2Vec: A Personalized Interpretable Deep Representation of the Longitudinal Electronic Health Recordcited by 30
  18. 2021Collaborative Graph Learning with Auxiliary Text for Temporal Event Prediction in Healthcarecited by 30
  19. 2023Probabilistic Imputation for Time-series Classification with Missing Datacited by 21
  20. 2021Context-aware Health Event Prediction via Transition Functions on Dynamic Disease Graphscited by 20
  21. 2021SCEHR: Supervised Contrastive Learning for Clinical Risk Prediction using Electronic Health Recordscited by 9
  22. 2022MedML: Fusing Medical Knowledge and Machine Learning Models for Early Pediatric COVID-19 Hospitalization and Severity Predictioncited by 8
  23. 2023Predict and Interpret Health Risk using EHR through Typical Patientscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 4.

8 papers.

  1. 2025Bridging Data Gaps of Rare Conditions in ICU: A Multi-Disease Adaptation Approach for Clinical Predictioncited by 4
  2. 2026GlucoFM: A Dual-Stream Foundation Model for Continuous Glucose Monitoringcited by 4
  3. 2025Diffmv: A Unified Diffusion Framework for Healthcare Predictions with Random Missing Views and View Lazinesscited by 2
  4. 2025Improving Hospital Risk Prediction with Knowledge-Augmented Multimodal EHR Modelingcited by 1
  5. 2025Think as a Doctor: An Interpretable AI Approach for ICU Mortality Predictioncited by 1
  6. 2026Structure-Aware Set Transformers: Temporal and Variable-Type Attention Biases for Asynchronous Clinical Time Seriescited by 0
  7. 2026Dementia Etiology Diagnosis via Collaborative Meta Knowledge Enhancementcited by 0
  8. 2026NeuroECG: ECGFounder-Based Deep ECG Representation for EEG-Free Neurological Prognostication After Cardiac Arrestcited by 0