Text-Attributed Knowledge Graph Enrichment with Large Language Models for Medical Concept Representation
Not on the map. Why?
Abstract (arXiv)
In electronic health record (EHR) mining, learning high-quality representations of medical concepts (e.g., standardized diagnosis, medication, and procedure codes) is fundamental for downstream clinical prediction. However, ro bust concept representation learning is hindered by two key challenges: (i) clinically important cross-type dependencies (e.g., diagnosis medication and medication-procedure relations) are often missing or incomplete in existing ontology resources, limiting the ability to model complex EHR patterns; and (ii) rich clinical semantics are often missing from structured resources, and even when available as text, are difficult to integrate with KG structure for representation learning. To address these challenges, we present MedCo, an LLM empowered graph learning framework for medical concept representation. MedCo first builds a global knowledge graph (KG) over medical codes by combining statistically reliable associations mined from EHRs with type-constrained LLM prompting to infer semantic relations. It then utilizes LLMs to enrich the KG into a text-attributed graph by generating node descriptions and edge rationales, providing semantic signals for both concepts and their relationships. Finally, MedCo jointly trains a LoRA-tuned LLaMA text encoder with a heterogeneous GNN, fusing text semantics and graph structure into unified concept embeddings. Extensive experiments on MIMIC-III and MIMIC-IV show that MedCo consistently improves prediction performance and serves as an effective plug-in concept encoder for standard EHR pipelines.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 34 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
16 of 34 references.
References · 16
- 2017Attention Is All You Needcited by 60,361
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 349
- 2019BEHRT: Transformer for Electronic Health Recordscited by 263
- 2015Doctor AI: Predicting Clinical Events via Recurrent Neural Networkscited by 208
- 2016GRAM: Graph-based Attention Model for Healthcare Representation Learningcited by 156
- 2019Pre-training of Graph Augmented Transformers for Medication Recommendationcited by 127
- 2023GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge Graphscited by 58
- 2019AdaCare: Explainable Clinical Health Status Representation Learning via Scale-Adaptive Feature Extraction and Recalibrationcited by 51
- 2024Reasoning-Enhanced Healthcare Predictions with Knowledge Graph Community Retrievalcited by 45
4 more
- 2021Collaborative Graph Learning with Auxiliary Text for Temporal Event Prediction in Healthcarecited by 30
- 2021Self-Supervised Graph Learning with Hyperbolic Embedding for Temporal Health Event Predictioncited by 15
- 2024Contrastive Learning on Medical Intents for Sequential Prescription Recommendationcited by 7
- 2025Multi-Ontology Integration with Dual-Axis Propagation for Medical Concept Representationcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.