Propagating construction-time knowledge quality into medical question answering: A framework grounded in clinical guidelines
Not on the map. Why?
Abstract (arXiv)
Large language models have facilitated knowledge graph (KG) construction from clinical guidelines, but extracted triples vary in structural validity and evidential support. Meanwhile, graph-augmented question answering (QA) systems typically optimize query relevance during retrieval, with limited reuse of quality information produced during KG construction. This creates a disconnect between construction-time quality control and inference-time evidence use. We investigate whether construction-time triple quality can serve as a persistent signal for downstream evidence selection and presentation. We propose a quality-aware framework that models structural conformance (SchemaConf) and evidential support (EvidScore) as complementary dimensions and fuses them into a per-triple quality signal, Q(t). Rather than using quality solely for filtering, the framework retains Q(t) and derived quality tiers as graph attributes and propagates them into quality-weighted subgraph retrieval and tier-conditioned evidence prompting, while preserving passage-level provenance. Experiments on Chinese diabetes clinical guidelines show that the utility of the quality signal is distribution dependent. Under cross-version and cross-model shift, the fused Q(t) provides stronger triple-quality discrimination than either component alone (AUC 0.748 vs. 0.703 for EvidScore and 0.645 for SchemaConf). In guideline-grounded QA, propagating construction-time quality reduces required-knowledge omission from 16.3% to 5.3% and conflicting outputs from 16.3% to 2.7%, with an evidence-grounded precision of 81.6% and near-zero invalid citations. Blinded clinician ratings favor the full framework over no retrieval (4.68 vs. 4.21 on a five-point scale) and approach the oracle condition (4.80), while cross-generator experiments show consistent trends.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 47 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
27 of 47 references.
References · 27
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 328
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2022Unified Structure Generation for Universal Information Extractioncited by 221
- 2024Corrective Retrieval Augmented Generationcited by 197
- 2017Joint Extraction of Entities and Relations Based on a Novel Tagging Schemecited by 102
15 more
- 2023Revisiting Relation Extraction in the era of Large Language Modelscited by 102
- 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
- 2023Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Surveycited by 92
- 2025MedRAG: Enhancing Retrieval-augmented Generation with Knowledge Graph-Elicited Reasoning for Healthcare Copilotcited by 83
- 2024Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generationcited by 64
- 2023A Comprehensive Survey on Automatic Knowledge Graph Constructioncited by 63
- 2025Knowledge Graph-Guided Retrieval Augmented Generationcited by 58
- 2022Generative Knowledge Graph Construction: A Reviewcited by 49
- 2023Text2KGBench: A Benchmark for Ontology-Driven Knowledge Graph Generation from Textcited by 48
- 2023Leveraging Medical Knowledge Graphs Into Large Language Models for Diagnosis Prediction: Design and Application Studycited by 30
- 2018Embedding Uncertain Knowledge Graphscited by 25
- 2025Certainty in Uncertainty: Reasoning over Uncertain Knowledge Graphs with Statistical Guaranteescited by 9
- 2025MultiRAG: A Knowledge-guided Framework for Mitigating Hallucination in Multi-source Retrieval Augmented Generationcited by 3
- 2026Clinical Knowledge Graph Construction and Evaluation with Multi-LLMs via Retrieval-Augmented Generationcited by 2
- 2026DIAL-KG: Schema-Free Incremental Knowledge Graph Construction via Dynamic Schema Induction and Evolution-Intent Assessmentcited by 1
Built on by
Not cited yet.