RAM-EHR: Retrieval Augmentation Meets Clinical Predictions on Electronic Health Records
Not on the map. Why?
Abstract (arXiv)
We present RAM-EHR, a Retrieval AugMentation pipeline to improve clinical predictions on Electronic Health Records (EHRs). RAM-EHR first collects multiple knowledge sources, converts them into text format, and uses dense retrieval to obtain information related to medical concepts. This strategy addresses the difficulties associated with complex names for the concepts. RAM-EHR then augments the local EHR predictive model co-trained with consistency regularization to capture complementary information from patient visits and summarized knowledge. Experiments on two EHR datasets show the efficacy of RAM-EHR over previous knowledge-enhanced baselines (3.4% gain in AUROC and 7.2% gain in AUPR), emphasizing the effectiveness of the summarized knowledge from RAM-EHR for clinical prediction tasks. The code will be published at urlhttps://github.com/ritaranx/RAM-EHR.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 30 of its 56 references that are in the map. First posted on arXiv 25 Feb 2024.
Builds on
30 of 56 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2021Improving language models by retrieving from trillions of tokenscited by 1,278
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
- 2023Benchmarking Large Language Models for News Summarizationcited by 444
- 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 344
- 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 326
- 2017Multitask learning and benchmarking with clinical time series datacited by 287
18 more
- 2019BEHRT: Transformer for Electronic Health Recordscited by 258
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 190
- 2023Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Modelscited by 180
- 2016GRAM: Graph-based Attention Model for Healthcare Representation Learningcited by 152
- 2021Retrieval Augmented Code Generation and Summarizationcited by 148
- 2023Almanac: Retrieval-Augmented Language Models for Clinical Medicinecited by 122
- 2023How to Train Your DRAGON: Diverse Augmentation Towards Generalizable Dense Retrievalcited by 116
- 2019Learning the Graphical Structure of Electronic Health Records with Graph Convolutional Transformercited by 88
- 2023Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Studycited by 63
- 2021Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processingcited by 57
- 2020UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System Metathesauruscited by 53
- 2020StageNet: Stage-Aware Neural Networks for Health Risk Predictioncited by 47
- 2021Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integrationcited by 43
- 2021Knowledge-Rich Self-Supervision for Biomedical Entity Linkingcited by 31
- 2021Collaborative Graph Learning with Auxiliary Text for Temporal Event Prediction in Healthcarecited by 30
- 2021Literature-Augmented Clinical Outcome Predictioncited by 20
- 2021Retrieval Enhanced Model for Commonsense Generationcited by 18
- 2023Weakly-Supervised Scientific Document Classification via Retrieval-Augmented Multi-Stage Trainingcited by 8
Built on by
Citing papers per year: 2024: 4; 2025: 9; 2026: 8.
21 papers.
Sort:
By area:
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 170
- 2024HYDRA: Model Factorization Framework for Black-Box LLM Personalizationcited by 59
- 2025Personalize Your LLM: Fake it then Align itcited by 15
- 2025KERAP: A Knowledge-Enhanced Reasoning Approach for Accurate Zero-shot Diagnosis Prediction Using Multi-agent LLMscited by 12
- 2026Query-Aware Flow Diffusion for Graph-Based RAG with Retrieval Guaranteescited by 7
- 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphscited by 5
- 2025Knowledge Graph Augmented Large Language Models for Disease Predictioncited by 4
- 2024Bridging Stepwise Lab-Informed Pretraining and Knowledge-Guided Learning for Diagnostic Reasoningcited by 3
- 2025Toward Better EHR Reasoning in LLMs: Reinforcement Learning with Expert Attention Guidancecited by 3
- 2026Core-based Hierarchies for Efficient GraphRAGcited by 2
- 2026Retrieving Minimal and Sufficient Reasoning Subgraphs with Graph Foundation Models for Path-aware GraphRAGcited by 2
- 2024From Basic to Extra Features: Hypergraph Transformer Pretrain-then-Finetuning for Balanced Clinical Predictions on EHRcited by 1
9 more
- 2025Improving Hospital Risk Prediction with Knowledge-Augmented Multimodal EHR Modelingcited by 1
- 2025RAD: Towards Trustworthy Retrieval-Augmented Multi-modal Clinical Diagnosiscited by 1
- 2025CKD-EHR:Clinical Knowledge Distillation for Electronic Health Recordscited by 0
- 2025Patient-level Information Extraction by Consistent Integration of Textual and Tabular Evidence with Bayesian Networkscited by 0
- 2026EHR-RAGp: Retrieval-Augmented Prototype-Guided Foundation Model for Electronic Health Recordscited by 0
- 2026Trajectory-Aware Clinical Risk Prediction via Severity-Grounded Knowledge Graphs and Retrieval-Augmented Generationcited by 0
- 2026Role-Specialized Mixture-of-Agents with Open-Weight LLMs for Clinical Predictioncited by 0
- 2026Structured Evidence Routing for Incident Risk Prediction from Multimodal Longitudinal EHRscited by 0
- 2026Knowledge-Enriched Structured EHR Features for 30-Day Hospital Readmission Prediction on MIMIC-IVcited by 0
- 2026Knowledge-Enriched Structured EHR Features for 30-Day Hospital Readmission Prediction on MIMIC-IV14 Sep 2026
- 2026Structured Evidence Routing for Incident Risk Prediction from Multimodal Longitudinal EHRs24 Aug 2026
- 2026Role-Specialized Mixture-of-Agents with Open-Weight LLMs for Clinical Prediction23 Aug 2026
- 2026Trajectory-Aware Clinical Risk Prediction via Severity-Grounded Knowledge Graphs and Retrieval-Augmented Generation2 Jun 2026
- 2026EHR-RAGp: Retrieval-Augmented Prototype-Guided Foundation Model for Electronic Health Records12 May 2026
- 2026Query-Aware Flow Diffusion for Graph-Based RAG with Retrieval Guarantees21 Apr 2026
- 2026Retrieving Minimal and Sufficient Reasoning Subgraphs with Graph Foundation Models for Path-aware GraphRAG7 Mar 2026
- 2026Core-based Hierarchies for Efficient GraphRAG5 Mar 2026
- 2025Knowledge Graph Augmented Large Language Models for Disease Prediction1 Dec 2025
- 2025Patient-level Information Extraction by Consistent Integration of Textual and Tabular Evidence with Bayesian Networks21 Nov 2025
- 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphs8 Oct 2025
- 2025RAD: Towards Trustworthy Retrieval-Augmented Multi-modal Clinical Diagnosis24 Sep 2025
9 more
- 2025Toward Better EHR Reasoning in LLMs: Reinforcement Learning with Expert Attention Guidance19 Aug 2025
- 2025Improving Hospital Risk Prediction with Knowledge-Augmented Multimodal EHR Modeling4 Aug 2025
- 2025KERAP: A Knowledge-Enhanced Reasoning Approach for Accurate Zero-shot Diagnosis Prediction Using Multi-agent LLMs3 Jul 2025
- 2025CKD-EHR:Clinical Knowledge Distillation for Electronic Health Records18 Jun 2025
- 2025Personalize Your LLM: Fake it then Align it2 Mar 2025
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)31 Dec 2024
- 2024Bridging Stepwise Lab-Informed Pretraining and Knowledge-Guided Learning for Diagnostic Reasoning25 Oct 2024
- 2024From Basic to Extra Features: Hypergraph Transformer Pretrain-then-Finetuning for Balanced Clinical Predictions on EHR9 Jun 2024
- 2024HYDRA: Model Factorization Framework for Black-Box LLM Personalization5 Jun 2024
- 2025KERAP: A Knowledge-Enhanced Reasoning Approach for Accurate Zero-shot Diagnosis Prediction Using Multi-agent LLMscited by 12
- 2026Query-Aware Flow Diffusion for Graph-Based RAG with Retrieval Guaranteescited by 7
- 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphscited by 5
- 2024Bridging Stepwise Lab-Informed Pretraining and Knowledge-Guided Learning for Diagnostic Reasoningcited by 3
- 2025Toward Better EHR Reasoning in LLMs: Reinforcement Learning with Expert Attention Guidancecited by 3
- 2026Query-Aware Flow Diffusion for Graph-Based RAG with Retrieval Guarantees21 Apr 2026
- 2025Reasoning by Exploration: A Unified Approach to Retrieval and Generation over Graphs8 Oct 2025
- 2025Toward Better EHR Reasoning in LLMs: Reinforcement Learning with Expert Attention Guidance19 Aug 2025
- 2025KERAP: A Knowledge-Enhanced Reasoning Approach for Accurate Zero-shot Diagnosis Prediction Using Multi-agent LLMs3 Jul 2025
- 2024Bridging Stepwise Lab-Informed Pretraining and Knowledge-Guided Learning for Diagnostic Reasoning25 Oct 2024
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 170
- 2026Core-based Hierarchies for Efficient GraphRAGcited by 2
- 2026Retrieving Minimal and Sufficient Reasoning Subgraphs with Graph Foundation Models for Path-aware GraphRAGcited by 2
- 2025RAD: Towards Trustworthy Retrieval-Augmented Multi-modal Clinical Diagnosiscited by 1
- 2026EHR-RAGp: Retrieval-Augmented Prototype-Guided Foundation Model for Electronic Health Recordscited by 0
- 2026EHR-RAGp: Retrieval-Augmented Prototype-Guided Foundation Model for Electronic Health Records12 May 2026
- 2026Retrieving Minimal and Sufficient Reasoning Subgraphs with Graph Foundation Models for Path-aware GraphRAG7 Mar 2026
- 2026Core-based Hierarchies for Efficient GraphRAG5 Mar 2026
- 2025RAD: Towards Trustworthy Retrieval-Augmented Multi-modal Clinical Diagnosis24 Sep 2025
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)31 Dec 2024
- 2025Personalize Your LLM: Fake it then Align itcited by 15
- 2025Personalize Your LLM: Fake it then Align it2 Mar 2025
- 2024HYDRA: Model Factorization Framework for Black-Box LLM Personalizationcited by 59
- 2025Knowledge Graph Augmented Large Language Models for Disease Predictioncited by 4
- 2024From Basic to Extra Features: Hypergraph Transformer Pretrain-then-Finetuning for Balanced Clinical Predictions on EHRcited by 1
- 2025Improving Hospital Risk Prediction with Knowledge-Augmented Multimodal EHR Modelingcited by 1
- 2025CKD-EHR:Clinical Knowledge Distillation for Electronic Health Recordscited by 0
- 2025Patient-level Information Extraction by Consistent Integration of Textual and Tabular Evidence with Bayesian Networkscited by 0
- 2026Trajectory-Aware Clinical Risk Prediction via Severity-Grounded Knowledge Graphs and Retrieval-Augmented Generationcited by 0
- 2026Structured Evidence Routing for Incident Risk Prediction from Multimodal Longitudinal EHRscited by 0
- 2026Knowledge-Enriched Structured EHR Features for 30-Day Hospital Readmission Prediction on MIMIC-IVcited by 0
- 2026Knowledge-Enriched Structured EHR Features for 30-Day Hospital Readmission Prediction on MIMIC-IV14 Sep 2026
- 2026Structured Evidence Routing for Incident Risk Prediction from Multimodal Longitudinal EHRs24 Aug 2026
- 2026Trajectory-Aware Clinical Risk Prediction via Severity-Grounded Knowledge Graphs and Retrieval-Augmented Generation2 Jun 2026
- 2025Knowledge Graph Augmented Large Language Models for Disease Prediction1 Dec 2025
- 2025Patient-level Information Extraction by Consistent Integration of Textual and Tabular Evidence with Bayesian Networks21 Nov 2025
- 2025Improving Hospital Risk Prediction with Knowledge-Augmented Multimodal EHR Modeling4 Aug 2025
- 2025CKD-EHR:Clinical Knowledge Distillation for Electronic Health Records18 Jun 2025
- 2024From Basic to Extra Features: Hypergraph Transformer Pretrain-then-Finetuning for Balanced Clinical Predictions on EHR9 Jun 2024
- 2024HYDRA: Model Factorization Framework for Black-Box LLM Personalization5 Jun 2024