REFINE: LLM Refinement over Budgeted Text-Attributed Graphs for Personalized Medical Concept Representation
Not on the map. Why?
Abstract (arXiv)
Learning rich medical concept representations is essential for EHR prediction. Text-attributed knowledge graphs (TKGs) provide a natural foundation by organizing heterogeneous medical relations together with textual semantics. However, most existing encoders process concepts uniformly across patients, despite the fact that a code's meaning and predictive value depend on patient-specific clinical context and trajectory. Learning patient-personalized concept representations from TKGs introduces two key challenges: (1) deciding how much KG context to incorporate for each observed code, and (2) aligning semantic information with the patient-specific relational structure. We propose REFINE, a KG-aware budgeted LLM graph refinement framework for patient-personalized medical concept encoding. Starting from a global TKG, REFINE constructs patient-specific temporal graphs. A sequential reinforcement learning policy selects a personalized KG expansion budget for each observed code. The resulting patient graph is processed by a heterogeneous GNN to capture relation-aware structural dependencies, while a frozen LLM uses graph-aware soft prompts to semantically refine concept representations. Experiments on MIMIC-III and MIMIC-IV show that REFINE consistently improves diverse EHR backbones, outperforms strong baselines, and demonstrates robust gains across component ablation, KG selection, and data insufficiency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 29 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
16 of 29 references.
References · 16
- 2017Attention Is All You Needcited by 59,932
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
- 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 344
- 2019BEHRT: Transformer for Electronic Health Recordscited by 258
- 2015Doctor AI: Predicting Clinical Events via Recurrent Neural Networkscited by 205
- 2016GRAM: Graph-based Attention Model for Healthcare Representation Learningcited by 152
- 2019Pre-training of Graph Augmented Transformers for Medication Recommendationcited by 124
- 2023GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge Graphscited by 57
- 2019AdaCare: Explainable Clinical Health Status Representation Learning via Scale-Adaptive Feature Extraction and Recalibrationcited by 50
- 2024Reasoning-Enhanced Healthcare Predictions with Knowledge Graph Community Retrievalcited by 45
- 2021Collaborative Graph Learning with Auxiliary Text for Temporal Event Prediction in Healthcarecited by 30
4 more
- 2025Large Language Models are Good Relational Learnerscited by 22
- 2024Contrastive Learning on Medical Intents for Sequential Prescription Recommendationcited by 6
- 2025Multi-Ontology Integration with Dual-Axis Propagation for Medical Concept Representationcited by 3
- 2026Text-Attributed Knowledge Graph Enrichment with Large Language Models for Medical Concept Representationcited by 1
Built on by
Not cited yet.