Foundation Model of Electronic Medical Records for Adaptive Risk Estimation
Not on the map. Why?
Abstract (arXiv)
Hospitals struggle to predict critical outcomes. Traditional early warning systems, like NEWS and MEWS, rely on static variables and fixed thresholds, limiting their adaptability, accuracy, and personalization. We previously developed the Enhanced Transformer for Health Outcome Simulation (ETHOS), an AI model that tokenizes patient health timelines (PHTs) from EHRs and uses transformer-based architectures to predict future PHTs. ETHOS is a versatile framework for developing a wide range of applications. In this work, we develop the Adaptive Risk Estimation System (ARES) that leverages ETHOS to compute dynamic, personalized risk probabilities for clinician-defined critical events. ARES also features a personalized explainability module that highlights key clinical factors influencing risk estimates. We evaluated ARES using the MIMIC-IV v2.2 dataset together with its Emergency Department (ED) extension and benchmarked performance against both classical early warning systems and contemporary machine learning models. The entire dataset was tokenized resulting in 285,622 PHTs, comprising over 360 million tokens. ETHOS outperformed benchmark models in predicting hospital admissions, ICU admissions, and prolonged stays, achieving superior AUC scores. Its risk estimates were robust across demographic subgroups, with calibration curves confirming model reliability. The explainability module provided valuable insights into patient-specific risk factors. ARES, powered by ETHOS, advances predictive healthcare AI by delivering dynamic, real-time, personalized risk estimation with patient-specific explainability. Although our results are promising, the clinical impact remains uncertain. Demonstrating ARES's true utility in real-world settings will be the focus of our future work. We release the source code to facilitate future research.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 11 of its 54 references that are in the map. First posted on arXiv 10 Feb 2025.
Builds on
11 of 54 references.
References · 11
- 2017Attention Is All You Needcited by 59,932
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2019BEHRT: Transformer for Electronic Health Recordscited by 258
- 2024Zero Shot Health Trajectory Prediction Using Transformercited by 74
- 2024Large language models surpass human experts in predicting neuroscience resultscited by 69
- 2016Multi-layer Representation Learning for Medical Conceptscited by 68
- 2021Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health recordscited by 53
- 2023Event Stream GPT: A Data Pre-processing and Modeling Library for Generative, Pre-trained Transformers over Continuous-time Sequences of Complex Eventscited by 46
- 2021Benchmarking emergency department triage prediction models with machine learning and large public electronic health recordscited by 30
- 2023Event-Based Contrastive Learning for Medical Time Seriescited by 13
- 2024MEDS-Tab: Automated tabularization and baseline methods for MEDS datasetscited by 4
Built on by
Citing papers per year: 2025: 6; 2026: 11.
17 papers.
Sort:
By area:
- 2025EHR-R1: A Reasoning-Enhanced Foundational Language Model for Electronic Health Record Analysiscited by 17
- 2025Foundation models for electronic health records: representation dynamics and transferabilitycited by 11
- 2025Evolving Interactive Diagnostic Agents in a Virtual Clinical Environmentcited by 7
- 2026Tokenization Tradeoffs in Structured EHR Foundation Modelscited by 6
- 2025Quantifying surprise in clinical care: Detecting highly informative events in electronic health records with foundation modelscited by 3
- 2026The Taxonomies, Training, and Applications of Event Stream Modelling for Electronic Health Recordscited by 3
- 2026Efficient Generative Prediction for EHR Foundation Models: The SCOPE and REACH Estimatorscited by 2
- 2025Integrating Genomics into Multimodal EHR Foundation Modelscited by 1
- 2026EHR-MPC: Inference-Time Control for Sepsis Treatment with Generative Patient Digital Twinscited by 1
- 2025Toward Scalable Early Cancer Detection: Evaluating EHR-Based Predictive Models Against Traditional Screening Criteriacited by 0
- 2026Clinical Data Goes MEDS? Let's OWL make sense of itcited by 0
- 2026EveryQuery: A Promptable Foundation Model for Clinical Prediction Tasks over Electronic Health Recordscited by 0
5 more
- 2026EHR-RAGp: Retrieval-Augmented Prototype-Guided Foundation Model for Electronic Health Recordscited by 0
- 2026X-FEMR: A Token-level Explainable Approach for Electronic Health Records Foundation Models using Transformer-based Modelscited by 0
- 2026Pretraining EHR Foundation Models with Patient-Aware Samplingcited by 0
- 2026Federated generative event models for tokenized electronic health recordscited by 0
- 2026Reinforcement Learning over Patient Trajectories for Clinical Reasoning in EHR Foundation Modelscited by 0
- 2026Reinforcement Learning over Patient Trajectories for Clinical Reasoning in EHR Foundation Models10 Sep 2026
- 2026Federated generative event models for tokenized electronic health records3 Aug 2026
- 2026Pretraining EHR Foundation Models with Patient-Aware Sampling24 Jul 2026
- 2026EHR-MPC: Inference-Time Control for Sepsis Treatment with Generative Patient Digital Twins7 Jul 2026
- 2026X-FEMR: A Token-level Explainable Approach for Electronic Health Records Foundation Models using Transformer-based Models7 Jul 2026
- 2026EHR-RAGp: Retrieval-Augmented Prototype-Guided Foundation Model for Electronic Health Records12 May 2026
- 2026The Taxonomies, Training, and Applications of Event Stream Modelling for Electronic Health Records14 Mar 2026
- 2026EveryQuery: A Promptable Foundation Model for Clinical Prediction Tasks over Electronic Health Records9 Mar 2026
- 2026Tokenization Tradeoffs in Structured EHR Foundation Models3 Mar 2026
- 2026Efficient Generative Prediction for EHR Foundation Models: The SCOPE and REACH Estimators3 Feb 2026
- 2026Clinical Data Goes MEDS? Let's OWL make sense of it7 Jan 2026
- 2025Toward Scalable Early Cancer Detection: Evaluating EHR-Based Predictive Models Against Traditional Screening Criteria14 Nov 2025
5 more
- 2025EHR-R1: A Reasoning-Enhanced Foundational Language Model for Electronic Health Record Analysis29 Oct 2025
- 2025Evolving Interactive Diagnostic Agents in a Virtual Clinical Environment28 Oct 2025
- 2025Integrating Genomics into Multimodal EHR Foundation Models24 Oct 2025
- 2025Quantifying surprise in clinical care: Detecting highly informative events in electronic health records with foundation models30 Jul 2025
- 2025Foundation models for electronic health records: representation dynamics and transferability14 Apr 2025
- 2025Foundation models for electronic health records: representation dynamics and transferabilitycited by 11
- 2026Tokenization Tradeoffs in Structured EHR Foundation Modelscited by 6
- 2025Quantifying surprise in clinical care: Detecting highly informative events in electronic health records with foundation modelscited by 3
- 2026The Taxonomies, Training, and Applications of Event Stream Modelling for Electronic Health Recordscited by 3
- 2026Efficient Generative Prediction for EHR Foundation Models: The SCOPE and REACH Estimatorscited by 2
- 2025Integrating Genomics into Multimodal EHR Foundation Modelscited by 1
- 2026EHR-MPC: Inference-Time Control for Sepsis Treatment with Generative Patient Digital Twinscited by 1
- 2025Toward Scalable Early Cancer Detection: Evaluating EHR-Based Predictive Models Against Traditional Screening Criteriacited by 0
- 2026Clinical Data Goes MEDS? Let's OWL make sense of itcited by 0
- 2026EveryQuery: A Promptable Foundation Model for Clinical Prediction Tasks over Electronic Health Recordscited by 0
- 2026X-FEMR: A Token-level Explainable Approach for Electronic Health Records Foundation Models using Transformer-based Modelscited by 0
- 2026Pretraining EHR Foundation Models with Patient-Aware Samplingcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Reinforcement Learning over Patient Trajectories for Clinical Reasoning in EHR Foundation Models10 Sep 2026
- 2026Federated generative event models for tokenized electronic health records3 Aug 2026
- 2026Pretraining EHR Foundation Models with Patient-Aware Sampling24 Jul 2026
- 2026EHR-MPC: Inference-Time Control for Sepsis Treatment with Generative Patient Digital Twins7 Jul 2026
- 2026X-FEMR: A Token-level Explainable Approach for Electronic Health Records Foundation Models using Transformer-based Models7 Jul 2026
- 2026The Taxonomies, Training, and Applications of Event Stream Modelling for Electronic Health Records14 Mar 2026
- 2026EveryQuery: A Promptable Foundation Model for Clinical Prediction Tasks over Electronic Health Records9 Mar 2026
- 2026Tokenization Tradeoffs in Structured EHR Foundation Models3 Mar 2026
- 2026Efficient Generative Prediction for EHR Foundation Models: The SCOPE and REACH Estimators3 Feb 2026
- 2026Clinical Data Goes MEDS? Let's OWL make sense of it7 Jan 2026
- 2025Toward Scalable Early Cancer Detection: Evaluating EHR-Based Predictive Models Against Traditional Screening Criteria14 Nov 2025
- 2025Integrating Genomics into Multimodal EHR Foundation Models24 Oct 2025
12 newest of 14 All 14 (JSON)