Evaluating Factual Density in Multi-Source RAG: A Study in Medical AI Accuracy
On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) is the current industry standard for grounding AI in real-world facts. Traditional retrieval methods rely on keyword matching and topic proximity, ranking content based on how closely it sounds like the user's query. What they do not measure is how many verified facts the content actually contains. This structural gap, termed the Expert Blindness Effect, causes standard RAG pipelines to consistently bury high-density factual evidence in favor of lexically dominant text on the same topic. To address this gap, this paper introduces Factual Density (FD*), a novel retrieval optimization signal that measures the proportion of verified atomic claims relative to total token count. Using the NexusAgentics Ghost Audit preprocessing pipeline, raw text is scored for factual specificity using probabilistic factuality analysis to filter content before corpus ingestion. An initial formulation introduced a severe document-length confound (Pearson R = -0.8636, p = 2.27e-07). Implementing Z-score normalization within length bins resolved this bias, validating FD* as a length-independent density signal (p = 0.0749). Evaluated against the HealthFC benchmark (750 health claims labeled Supported, Refuted, or No Evidence by medical experts), FD*-optimized retrieval was the only condition to achieve 100% systematic review saturation in top-5 results, surfacing Cochrane evidence that standard cosine similarity ranked outside the top ten. Ground truth verification confirmed 25 mappings across seven HealthFC-supported claims. While full statistical validation across n=50 queries remains future work due to constraints on corpus-benchmark alignment, these findings establish factual density reranking as a low-cost, high-impact intervention for improving factual precision in health RAG architectures.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 4 of its 7 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
4 of 7 references.
References · 4
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systemscited by 265
- 2023Almanac: Retrieval-Augmented Language Models for Clinical Medicinecited by 123
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievals
- 2026Facet-Level Tracing of Evidence Uncertainty and Hallucination in RAG
- 2026Towards Dependable Retrieval-Augmented Generation Using Factual Confidence Prediction
- 2026Evaluating RAG Reliability under Clean, Misleading, and Mixed Retrieval
- 2026CiteGuard-RAG: A Validation-Centered AI System for Evidence-Grounded Question Answering
- 2025Fact or Facsimile? Evaluating the Factual Robustness of Modern Retrievers
- 2025MIRA: A Novel Framework for Fusing Modalities in Medical RAG
- 2025Faithfulness-Aware Uncertainty Quantification for Fact-Checking the Output of Retrieval Augmented Generation