mlsanityData to 14 Oct 2026

EHR-RAGp: Retrieval-Augmented Prototype-Guided Foundation Model for Electronic Health Records

arXiv 2605.12335 ↗First posted 12 May 2026cs.IR cs.AI cs.LGcited by 0

On the map: Retrieval-augmented generation → Medical and biomedical RAG

Abstract (arXiv)

Electronic Health Records (EHR) contain rich longitudinal patient information and are widely used in predictive modeling applications. However, effectively leveraging historical data remains challenging due to long trajectories, heterogeneous events, temporal irregularity, and the varying relevance of past clinical context. Existing approaches often rely on fixed windows or uniform aggregation, which can obscure clinically important signals. In this work, we introduce EHR-RAGp, a retrieval-based framework that dynamically integrates the most relevant patient history consisting of diverse clinical event types. We propose a prototype-guided retrieval module that acts as an alignment mechanism and estimates the relevance of retrieved historical chunks with respect to a given prediction task, guiding the model towards the most informative context. Across multiple clinical prediction tasks and two benchmark datasets, EHR-RAGp consistently outperforms state-of- the-art EHR-based and transformer-based baselines. Furthermore, EHR-RAGp is model-agnostic, as integrating it with various backbone models yields substantial performance gains. Overall, EHR-RAGp establishes a novel direction for modeling long-range clinical context to improve downstream performance via retrieval.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and biomedical RAG, one of 15 directions in Retrieval-augmented generation. Builds on 54 of its 83 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

54 of 83 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Grounding Large Language Models in Clinical Evidence: A Retrieval-Augmented Generation System for Querying UK NICE Clinical Guidelines3 Oct
  2. 2025A Retrieval-Augmented Knowledge Mining Method with Deep Thinking LLMs for Biomedical Research and Clinical Support29 Mar
  3. 2025Generating patient cohorts from electronic health records using two-step retrieval-augmented text-to-SQL generation28 Feb
  4. 2025OntologyRAG: Better and Faster Biomedical Code Mapping with Retrieval-Augmented Generation (RAG) Leveraging Ontology Knowledge Graphs and Large Language Models26 Feb
  5. 2024Rationale-Guided Retrieval Augmented Generation for Medical Question Answering1 Nov
  6. 2024EMERGE: Enhancing Multimodal Electronic Health Records Predictive Modeling with Retrieval-Augmented Generation27 May
  7. 2024Question-Answering Based Summarization of Electronic Health Records using Retrieval Augmented Generation3 Jan

Other references · 47

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  7. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  8. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  9. 2023Mistral 7Bcited by 3,164
  10. 2024Qwen2 Technical Reportcited by 2,120
  11. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  12. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
35 more
  1. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  2. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
  3. 2015Cyclical Learning Rates for Training Neural Networkscited by 629
  4. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
  5. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
  6. 2023Active Retrieval Augmented Generationcited by 516
  7. 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 393
  8. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
  9. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 354
  10. 2022Masked Siamese Networks for Label-Efficient Learningcited by 302
  11. 2017Multitask learning and benchmarking with clinical time series datacited by 290
  12. 2019BEHRT: Transformer for Electronic Health Recordscited by 263
  13. 2019Time2Vec: Learning a Vector Representation of Timecited by 213
  14. 2024Evaluation of Retrieval-Augmented Generation: A Surveycited by 146
  15. 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 105
  16. 2021CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction taskscited by 76
  17. 2021Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health recordscited by 54
  18. 2022MedFuse: Multi-modal fusion with clinical time-series data and chest X-ray imagescited by 54
  19. 2026MedGemma 1.5 Technical Reportcited by 45
  20. 2024Context Clues: Evaluating Long Context Models for Clinical Prediction Tasks on EHRscited by 39
  21. 2022GenHPF: General Healthcare Predictive Framework with Multi-task Multi-source Learningcited by 36
  22. 2024EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Recordscited by 32
  23. 2025Retrieval Augmented Generation and Understanding in Vision: A Survey and New Outlookcited by 32
  24. 2025Generative Medical Event Models Improve with Scalecited by 26
  25. 2021Unifying Heterogeneous Electronic Health Records Systems via Text-Based Code Embeddingcited by 24
  26. 2024REALM: RAG-Driven Enhancement of Multimodal Electronic Health Records Analysis via Large Language Modelscited by 23
  27. 2024CEHR-GPT: Generating Electronic Health Records with Chronological Patient Timelinescited by 22
  28. 2024RAM-EHR: Retrieval Augmentation Meets Clinical Predictions on Electronic Health Recordscited by 21
  29. 2024CORE-BEHRT: A Carefully Optimized and Rigorously Evaluated BEHRTcited by 20
  30. 2025Foundation Model of Electronic Medical Records for Adaptive Risk Estimationcited by 19
  31. 2023General-Purpose Retrieval-Enhanced Medical Prediction Model Using Near-Infinite Historycited by 12
  32. 2025A Comprehensive Survey of Electronic Health Record Modeling: From Deep Learning Approaches to Large Language Modelscited by 8
  33. 2021Predicting Intensive Care Unit Length of Stay and Mortality Using Patient Vital Signs: Machine Learning Model Development and Validationcited by 7
  34. 2022UniHPF : Universal Healthcare Predictive Framework with Zero Domain Knowledgecited by 4
  35. 2023Explainable Machine Learning for ICU Readmission Predictioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026EHR-RAG: Bridging Long-Horizon Structured Electronic Health Records and Large Language Models via Enhanced Retrieval-Augmented Generation
  2. 2025Evaluating Retrieval-Augmented Generation vs. Long-Context Input for Clinical Reasoning over EHRs
  3. 2025Building the EHR Foundation Model via Next Event Prediction
  4. 2024Lessons Learned on Information Retrieval in Electronic Health Records: A Comparison of Embedding Models and Pooling Strategies
  5. 2026Retrieval-aligned Tabular Foundation Models Enable Robust Clinical Risk Prediction in Electronic Health Records Under Real-world Constraints
  6. 2025CEHR-XGPT: A Scalable Multi-Task Foundation Model for Electronic Health Records
  7. 2025MedRAG: Enhancing Retrieval-augmented Generation with Knowledge Graph-Elicited Reasoning for Healthcare Copilot
  8. 2026Lightweight Retrieval-Augmented Generation and Large Language Model-Based Modeling for Scalable Patient-Trial Matching