Trajectory-guided discharge stratification for heart failure using short-context electronic health record sequence modeling
Not on the map. Why?
Abstract (arXiv)
Purpose: Heart failure (HF) discharge planning depends on identifying patients at risk of deterioration or death, yet accurate prediction from routinely collected electronic health records (EHRs) remains challenging. Methods: We develop trajectory-guided discharge stratification for heart failure (TGDS-HF), a methodology that reads the patient in-hospital trajectory of diagnoses, vital signs, laboratories, medications, and procedures end-to-end with a compact short-context autoregressive Transformer, and uses it to stratify one-year risks of clinical instability (a rehospitalization phenotype) or mortality for discharge care. We instantiate TGDS-HF on a Swedish HF cohort (N = 42,820) to predict one-year clinical instability or mortality at the initial HF diagnosis in-hospital. TGDS-HF has three components: category-level tokenization, recency-weighted temporal representation, and sequence model configuration. We run ablations on these components to show the effectiveness of TGDS-HF. Results: Against traditional eXtreme gradient boosting machine (XGBoost) and bidirectional encoder representations from Transformers (BERT)-based EHR sequence-modeling baselines, TGDS-HF (Llama backbone) achieved area under the precision-recall curves (AUPRCs) with 95% confidence intervals of 0.555 (0.535-0.575) and 0.574 (0.550-0.599) across the two tasks at the method default, with robust calibration. A task-specific refinement using daily aggregation of repeated continuous events improves the mortality task to 0.582 (0.558-0.608). Further, TGDS-HF maintains strong performance under reduced clinical concept availability and limited training data. Conclusion: Combined predictions of instability and mortality from TGDS-HF may support personalized discharge planning, ranging from follow-up in primary care to specialist-led management and, when appropriate, palliative care.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 56 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
30 of 56 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2020GLU Variants Improve Transformercited by 1,804
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2020On Layer Normalization in the Transformer Architecturecited by 922
- 2023Vision Transformers Need Registerscited by 871
18 more
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
- 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
- 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 349
- 2019BEHRT: Transformer for Electronic Health Recordscited by 263
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2024An Empirical Study of Mamba-based Language Modelscited by 186
- 2019Pre-training of Graph Augmented Transformers for Medication Recommendationcited by 127
- 2021CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction taskscited by 76
- 2016Deepr: A Convolutional Net for Medical Recordscited by 60
- 2021Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health recordscited by 54
- 2024Vision Mamba: A Comprehensive Survey and Taxonomycited by 54
- 2024A Survey of Mambacited by 39
- 2024Context Clues: Evaluating Long Context Models for Clinical Prediction Tasks on EHRscited by 39
- 2021AMMU : A Survey of Transformer-based Biomedical Pretrained Language Modelscited by 32
- 2024EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Recordscited by 32
- 2024CORE-BEHRT: A Carefully Optimized and Rigorously Evaluated BEHRTcited by 20
- 2023ExBEHRT: Extended Transformer for Electronic Health Records to Predict Disease Subtypes & Progressionscited by 12
- 2022Targeted-BEHRT: Deep learning for observational causal inference on longitudinal electronic health recordscited by 9
Built on by
Not cited yet.