When Documents Disagree: Measuring Institutional Variation in Transplant Guidance with Retrieval-Augmented Language Models
On the map: Retrieval-augmented generation → Medical and biomedical RAG
Abstract (arXiv)
Patient education materials for solid-organ transplantation vary substantially across U.S. centers, yet no systematic method exists to quantify this heterogeneity at scale. We introduce a framework that grounds the same patient questions in different centers' handbooks using retrieval-augmented language models and compares the resulting answers using a five-label consistency taxonomy. Applied to 102 handbooks from 23 centers and 1,115 benchmark questions, the framework quantifies heterogeneity across four dimensions: question, topic, organ, and center. We find that 20.8% of non-absent pairwise comparisons exhibit clinically meaningful divergence, concentrated in condition monitoring and lifestyle topics. Coverage gaps are even more prominent: 96.2% of question-handbook pairs miss relevant content, with reproductive health at 95.1% absence. Center-level divergence profiles are stable and interpretable, where heterogeneity reflects systematic institutional differences, likely due to patient diversity. These findings expose an information gap in transplant patient education materials, with document-grounded medical question answering highlighting opportunities for content improvement.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and biomedical RAG, one of 15 directions in Retrieval-augmented generation. Builds on 3 of its 12 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
3 of 12 references.
References · 3
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
- 2024The Faiss librarycited by 376
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Same Question, Different Source, Different Answer: Auditing Source-Dependence in Medical Multi-Source RAG
- 2025Contradictions in Context: Challenges for Retrieval-Augmented Generation in Healthcare
- 2025Evaluating Large Language Models for Evidence-Based Clinical Question Answering
- 2024HealthQ: Unveiling Questioning Capabilities of LLM Chains in Healthcare Conversations
- 2026SentryLine: Evidence-Grounded Question Answering over Evolving Documents in Oncology Care
- 2026This Treatment Works, Right? Evaluating LLM Sensitivity to Patient Question Framing in Medical QA
- 2024MedInsight: A Multi-Source Context Augmentation Framework for Generating Patient-Centric Medical Responses using Large Language Models
- 2026mamabench and mamaretrieval: Benchmarks for Evaluating Medical Retrieval-Augmented Generation in Maternal, Neonatal, and Reproductive Health