Integrating Genomics into Multimodal EHR Foundation Models
Not on the map. Why?
Abstract (arXiv)
This paper introduces an innovative Electronic Health Record (EHR) foundation model that integrates Polygenic Risk Scores (PRS) as a foundational data modality, moving beyond traditional EHR-only approaches to build more holistic health profiles. Leveraging the extensive and diverse data from the All of Us (AoU) Research Program, this multimodal framework aims to learn complex relationships between clinical data and genetic predispositions. The methodology extends advancements in generative AI to the EHR foundation model space, enhancing predictive capabilities and interpretability. Evaluation on AoU data demonstrates the model's predictive value for the onset of various conditions, particularly Type 2 Diabetes (T2D), and illustrates the interplay between PRS and EHR data. The work also explores transfer learning for custom classification tasks, showcasing the architecture's versatility and efficiency. This approach is pivotal for unlocking new insights into disease prediction, proactive health management, risk stratification, and personalized treatment strategies, laying the groundwork for more personalized, equitable, and actionable real-world evidence generation in healthcare.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 26 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
11 of 26 references.
References · 11
- 2017Attention Is All You Needcited by 59,932
- 2023Visual Instruction Tuningcited by 7,792
- 2023Towards Generalist Biomedical AIcited by 286
- 2021CAT: Cross Attention in Vision Transformercited by 92
- 2024Advancing Multimodal Medical Capabilities of Geminicited by 88
- 2020Language Models Are An Effective Patient Representation Learning Technique For Electronic Health Record Datacited by 85
- 2024Zero Shot Health Trajectory Prediction Using Transformercited by 74
- 2024Context Clues: Evaluating Long Context Models for Clinical Prediction Tasks on EHRscited by 39
- 2025Generative Medical Event Models Improve with Scalecited by 24
- 2025Advancing Conversational Diagnostic AI with Multimodal Reasoningcited by 20
- 2025Foundation Model of Electronic Medical Records for Adaptive Risk Estimationcited by 17
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Autoregressive EHR Foundation Models with Multimodal Inputs24 Jul 2026