Representation Learning for Electronic Health Records
Not on the map. Why?
Abstract (arXiv)
Information in electronic health records (EHR), such as clinical narratives, examination reports, lab measurements, demographics, and other patient encounter entries, can be transformed into appropriate data representations that can be used for downstream clinical machine learning tasks using representation learning. Learning better representations is critical to improve the performance of downstream tasks. Due to the advances in machine learning, we now can learn better and meaningful representations from EHR through disentangling the underlying factors inside data and distilling large amounts of information and knowledge from heterogeneous EHR sources. In this chapter, we first introduce the background of learning representations and reasons why we need good EHR representations in machine learning for medicine and healthcare in Section 1. Next, we explain the commonly-used machine learning and evaluation methods for representation learning using a deep learning approach in Section 2. Following that, we review recent related studies of learning patient state representation from EHR for clinical machine learning tasks in Section 3. Finally, in Section 4 we discuss more techniques, studies, and challenges for learning natural language representations when free texts, such as clinical notes, examination reports, or biomedical literature are used. We also discuss challenges and opportunities in these rapidly growing research fields.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 1; 2024: 3; 2025: 1.
8 papers.
- 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
- 2023Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applicationscited by 27
- 2024Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcarecited by 12
- 2024Representation Learning of Structured Data for Medical Foundation Modelscited by 5
- 2022Representational Ethical Model Calibrationcited by 3
- 2022Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challengescited by 3
- 2024Unsupervised Discovery of Clinical Disease Signatures Using Probabilistic Independencecited by 3
- 2025A Weakly Supervised Transformer for Rare Disease Diagnosis and Subphenotyping from EHRs with Pulmonary Case Studiescited by 1
- 2025A Weakly Supervised Transformer for Rare Disease Diagnosis and Subphenotyping from EHRs with Pulmonary Case Studies1 Jul 2025
- 2024Representation Learning of Structured Data for Medical Foundation Models17 Oct 2024
- 2024Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare10 May 2024
- 2024Unsupervised Discovery of Clinical Disease Signatures Using Probabilistic Independence8 Feb 2024
- 2023Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applications1 Feb 2023
- 2022Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challenges27 Nov 2022
- 2022Representational Ethical Model Calibration25 Jul 2022
- 2021Pre-trained Language Models in Biomedical Domain: A Systematic Survey11 Oct 2021