Deep Representation Learning of Electronic Health Records to Unlock Patient Stratification at Scale
Not on the map. Why?
Abstract (arXiv)
Deriving disease subtypes from electronic health records (EHRs) can guide next-generation personalized medicine. However, challenges in summarizing and representing patient data prevent widespread practice of scalable EHR-based stratification analysis. Here we present an unsupervised framework based on deep learning to process heterogeneous EHRs and derive patient representations that can efficiently and effectively enable patient stratification at scale. We considered EHRs of 1,608,741 patients from a diverse hospital cohort comprising of a total of 57,464 clinical concepts. We introduce a representation learning model based on word embeddings, convolutional neural networks, and autoencoders (i.e., ConvAE) to transform patient trajectories into low-dimensional latent vectors. We evaluated these representations as broadly enabling patient stratification by applying hierarchical clustering to different multi-disease and disease-specific patient cohorts. ConvAE significantly outperformed several baselines in a clustering task to identify patients with different complex conditions, with 2.61 entropy and 0.31 purity average scores. When applied to stratify patients within a certain condition, ConvAE led to various clinically relevant subtypes for different disorders, including type 2 diabetes, Parkinson's disease and Alzheimer's disease, largely related to comorbidities, disease progression, and symptom severity. With these results, we demonstrate that ConvAE can generate patient representations that lead to clinically meaningful insights. This scalable framework can help better understand varying etiologies in heterogeneous sub-populations and unlock patterns for EHR-based research in the realm of personalized medicine.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 8; 2023: 4; 2024: 7; 2025: 5; 2026: 6.
39 papers.
Sort:
- 2022GenHPF: General Healthcare Predictive Framework with Multi-task Multi-source Learningcited by 35
- 2021Deep learning for temporal data representation in electronic health records: A systematic review of challenges and methodologiescited by 34
- 2021Neighborhood Contrastive Learning Applied to Online Patient Monitoringcited by 32
- 2021Unifying Heterogeneous Electronic Health Records Systems via Text-Based Code Embeddingcited by 24
- 2021Estimating Redundancy in Clinical Textcited by 10
- 2022Unsupervised pre-training of graph transformers on patient population graphscited by 9
- 2024SMART: Towards Pre-trained Missing-Aware Model for Patient Health Status Predictioncited by 8
- 2021Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectivescited by 7
- 2022Get your Foes Fooled: Proximal Gradient Split Learning for Defense against Model Inversion Attacks on IoMT datacited by 7
- 2023Split Learning for Distributed Collaborative Training of Deep Learning Models in Health Informaticscited by 5
- 2025Representation learning to advance multi-institutional studies with electronic health record data from US and Francecited by 5
- 2021Transformer-based unsupervised patient representation learning based on medical claims for risk stratification and analysiscited by 4
27 more
- 2021Longitudinal patient stratification of electronic health records with flexible adjustment for clinical outcomescited by 4
- 2024MUSE-Net: Missingness-aware mUlti-branching Self-attention Encoder for Irregular Longitudinal Electronic Health Recordscited by 4
- 2025Knowledge Graph Augmented Large Language Models for Disease Predictioncited by 4
- 2026GlucoFM: A Dual-Stream Foundation Model for Continuous Glucose Monitoringcited by 4
- 2022Representational Ethical Model Calibrationcited by 3
- 2024Fusing Echocardiography Images and Medical Records for Continuous Patient Stratificationcited by 3
- 2024Unsupervised Discovery of Clinical Disease Signatures Using Probabilistic Independencecited by 3
- 2024HealthGAT: Node Classifications in Electronic Health Records using Graph Attention Networkscited by 3
- 2023Fair Patient Model: Mitigating Bias in the Patient Representation Learned from the Electronic Health Recordscited by 2
- 2022Deep Normed Embeddings for Patient Representationcited by 1
- 2023Rediscovery of CNN's Versatility for Text-based Encoding of Raw Electronic Health Recordscited by 1
- 2023Interpreting deep embeddings for disease progression clusteringcited by 1
- 2025Comparing representations of long clinical texts for the task of patient note-identificationcited by 1
- 2025Semi-supervised Clustering Through Representation Learning of Large-scale EHR Datacited by 1
- 2026Capture Timing-Attention of Events in Clinical Time Seriescited by 1
- 2026HypEHR: Hyperbolic Modeling of Electronic Health Records for Efficient Question Answeringcited by 1
- 2021Contrastive Learning Improves Critical Event Prediction in COVID-19 Patientscited by 0
- 2021Unifying Heterogeneous Electronic Health Records Systems via Text-Based Code Embeddingcited by 0
- 2022Identifying Dementia Subtypes with Electronic Health Recordscited by 0
- 2022Temporal Subtyping of Alzheimer's Disease Using Medical Conditions Preceding Alzheimer's Disease Onset in Electronic Health Recordscited by 0
- 2022Modeling electronic health record data using a knowledge-graph-embedded topic modelcited by 0
- 2024Is plantar thermography a valid digital biomarker for characterising diabetic foot ulceration risk?cited by 0
- 2024HBIC: A Biclustering Algorithm for Heterogeneous Datasetscited by 0
- 2025Scaling Electronic Health Record Foundation Models for Population Health Managementcited by 0
- 2026ReToP: Learning to Rewrite Electronic Health Records for Clinical Predictioncited by 0
- 2026Enhancing Spectral Embedding through Robust and Flexible Knowledge Transfer in Electronic Health Recordscited by 0
- 2026Cohort-Anchored Foundation Models for Electronic Health Records: From Risk Scores to Auditable Peer Cohortscited by 0
- 2026Cohort-Anchored Foundation Models for Electronic Health Records: From Risk Scores to Auditable Peer Cohorts20 Jun 2026
- 2026Enhancing Spectral Embedding through Robust and Flexible Knowledge Transfer in Electronic Health Records10 Jun 2026
- 2026GlucoFM: A Dual-Stream Foundation Model for Continuous Glucose Monitoring29 May 2026
- 2026HypEHR: Hyperbolic Modeling of Electronic Health Records for Efficient Question Answering22 Apr 2026
- 2026Capture Timing-Attention of Events in Clinical Time Series11 Feb 2026
- 2026ReToP: Learning to Rewrite Electronic Health Records for Clinical Prediction27 Jan 2026
- 2025Knowledge Graph Augmented Large Language Models for Disease Prediction1 Dec 2025
- 2025Scaling Electronic Health Record Foundation Models for Population Health Management30 May 2025
- 2025Semi-supervised Clustering Through Representation Learning of Large-scale EHR Data27 May 2025
- 2025Comparing representations of long clinical texts for the task of patient note-identification31 Mar 2025
- 2025Representation learning to advance multi-institutional studies with electronic health record data from US and France12 Feb 2025
- 2024HBIC: A Biclustering Algorithm for Heterogeneous Datasets23 Aug 2024
27 more
- 2024Is plantar thermography a valid digital biomarker for characterising diabetic foot ulceration risk?5 Jul 2024
- 2024MUSE-Net: Missingness-aware mUlti-branching Self-attention Encoder for Irregular Longitudinal Electronic Health Records30 Jun 2024
- 2024SMART: Towards Pre-trained Missing-Aware Model for Patient Health Status Prediction15 May 2024
- 2024HealthGAT: Node Classifications in Electronic Health Records using Graph Attention Networks26 Mar 2024
- 2024Unsupervised Discovery of Clinical Disease Signatures Using Probabilistic Independence8 Feb 2024
- 2024Fusing Echocardiography Images and Medical Records for Continuous Patient Stratification15 Jan 2024
- 2023Split Learning for Distributed Collaborative Training of Deep Learning Models in Health Informatics21 Aug 2023
- 2023Interpreting deep embeddings for disease progression clustering12 Jul 2023
- 2023Fair Patient Model: Mitigating Bias in the Patient Representation Learned from the Electronic Health Records5 Jun 2023
- 2023Rediscovery of CNN's Versatility for Text-based Encoding of Raw Electronic Health Records15 Mar 2023
- 2022Representational Ethical Model Calibration25 Jul 2022
- 2022Unsupervised pre-training of graph transformers on patient population graphs21 Jul 2022
- 2022GenHPF: General Healthcare Predictive Framework with Multi-task Multi-source Learning20 Jul 2022
- 2022Modeling electronic health record data using a knowledge-graph-embedded topic model3 Jun 2022
- 2022Deep Normed Embeddings for Patient Representation12 Apr 2022
- 2022Temporal Subtyping of Alzheimer's Disease Using Medical Conditions Preceding Alzheimer's Disease Onset in Electronic Health Records22 Feb 2022
- 2022Identifying Dementia Subtypes with Electronic Health Records31 Jan 2022
- 2022Get your Foes Fooled: Proximal Gradient Split Learning for Defense against Model Inversion Attacks on IoMT data12 Jan 2022
- 2021Unifying Heterogeneous Electronic Health Records Systems via Text-Based Code Embedding12 Nov 2021
- 2021Longitudinal patient stratification of electronic health records with flexible adjustment for clinical outcomes11 Nov 2021
- 2021Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectives9 Nov 2021
- 2021Unifying Heterogeneous Electronic Health Records Systems via Text-Based Code Embedding8 Aug 2021
- 2021Deep learning for temporal data representation in electronic health records: A systematic review of challenges and methodologies21 Jul 2021
- 2021Transformer-based unsupervised patient representation learning based on medical claims for risk stratification and analysis23 Jun 2021
- 2021Neighborhood Contrastive Learning Applied to Online Patient Monitoring9 Jun 2021
- 2021Estimating Redundancy in Clinical Text25 May 2021
- 2021Contrastive Learning Improves Critical Event Prediction in COVID-19 Patients11 Jan 2021
- 2022GenHPF: General Healthcare Predictive Framework with Multi-task Multi-source Learningcited by 35
- 2021Deep learning for temporal data representation in electronic health records: A systematic review of challenges and methodologiescited by 34
- 2021Neighborhood Contrastive Learning Applied to Online Patient Monitoringcited by 32
- 2021Unifying Heterogeneous Electronic Health Records Systems via Text-Based Code Embeddingcited by 24
- 2021Estimating Redundancy in Clinical Textcited by 10
- 2022Unsupervised pre-training of graph transformers on patient population graphscited by 9
- 2024SMART: Towards Pre-trained Missing-Aware Model for Patient Health Status Predictioncited by 8
- 2021Machine Learning for Multimodal Electronic Health Records-based Research: Challenges and Perspectivescited by 7
- 2022Get your Foes Fooled: Proximal Gradient Split Learning for Defense against Model Inversion Attacks on IoMT datacited by 7
- 2023Split Learning for Distributed Collaborative Training of Deep Learning Models in Health Informaticscited by 5
- 2025Representation learning to advance multi-institutional studies with electronic health record data from US and Francecited by 5
- 2021Transformer-based unsupervised patient representation learning based on medical claims for risk stratification and analysiscited by 4
12 most cited of 39 All 39 (JSON)
- 2026Cohort-Anchored Foundation Models for Electronic Health Records: From Risk Scores to Auditable Peer Cohorts20 Jun 2026
- 2026Enhancing Spectral Embedding through Robust and Flexible Knowledge Transfer in Electronic Health Records10 Jun 2026
- 2026GlucoFM: A Dual-Stream Foundation Model for Continuous Glucose Monitoring29 May 2026
- 2026HypEHR: Hyperbolic Modeling of Electronic Health Records for Efficient Question Answering22 Apr 2026
- 2026Capture Timing-Attention of Events in Clinical Time Series11 Feb 2026
- 2026ReToP: Learning to Rewrite Electronic Health Records for Clinical Prediction27 Jan 2026
- 2025Knowledge Graph Augmented Large Language Models for Disease Prediction1 Dec 2025
- 2025Scaling Electronic Health Record Foundation Models for Population Health Management30 May 2025
- 2025Semi-supervised Clustering Through Representation Learning of Large-scale EHR Data27 May 2025
- 2025Comparing representations of long clinical texts for the task of patient note-identification31 Mar 2025
- 2025Representation learning to advance multi-institutional studies with electronic health record data from US and France12 Feb 2025
- 2024HBIC: A Biclustering Algorithm for Heterogeneous Datasets23 Aug 2024
12 newest of 39 All 39 (JSON)