Deceptive Grounding: Entity Attribution Failure in Clinical Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → Medical and biomedical RAG
Abstract (arXiv)
Retrieval-augmented generation evaluation checks whether model claims are factually grounded in retrieved documents. It does not check whether retrieved evidence is attributed to the correct entity. A clinical RAG response can pass every automated check (zero hallucinations, near-perfect faithfulness, real citations) while presenting drug Y's clinical evidence as evidence about queried drug X. We term this deceptive grounding (DG): a failure invisible to faithfulness, hallucination, and citation checks because every claim is sourced from a real document, about the wrong entity. Using a controlled factorial benchmark across 13 models, we find DG rates spanning 8-87% at peak adversarial conditions. Medical and biomedical fine-tuned models reach up to 86.7%; domain specialization amplifies the failure rather than mitigating it. A controlled ablation identifies the mechanism: removing entity-specific clinical evidence from retrieved documents eliminates entity-attribution failure entirely, shifting all failures to confabulation. The two failure modes respond to the same trigger, taking different paths. Production measurement across 740 drug-disease pairs finds 7.8% overall DG in a deployed RAG system, rising to 13.6% for recently approved drugs. Entity-attribution verification (checking that cited evidence applies to the queried entity) detects DG at 97.0% precision and 98.7% DG recall (IPW-adjusted human gold standard); no existing framework implements it.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and biomedical RAG, one of 15 directions in Retrieval-augmented generation. Builds on 23 of its 33 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
23 of 33 references.
Closest ancestors · 2
Same direction, newest first
- 2025Retrieval-augmented systems can be dangerous medical communicators18 Feb
- 2024Benchmarking Retrieval-Augmented Generation for Medicine20 Feb
Other references · 21
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 820
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
- 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 408
9 more
- 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 349
- 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 333
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
- 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systemscited by 259
- 2023WiCE: Real-World Entailment for Claims in Wikipediacited by 118
- 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 108
- 2024Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarkscited by 17
- 2024Merging Facts, Crafting Fallacies: Evaluating the Contradictory Nature of Aggregated Factual Claims in Long-Form Generationscited by 14
- 2024Groundedness in Retrieval-augmented Long-form Generation: An Empirical Studycited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Evaluating the Robustness of Retrieval-Augmented Generation to Adversarial Evidence in the Health Domain
- 2026When Retrieval Helps and Distracts: Evaluating Evidence-Generating LLMs for Biomedical Claim Verification
- 2026The strength of clinical evidence is recoverable from language model representations but not from their stated grades
- 2026Where Does Retrieval-Based Open-Ended Evaluation Fail? Automatic Taxonomy Induction from Long-Form Medical Answer Factuality Verification
- 2026MedRAGChecker: Claim-Level Verification for Biomedical Retrieval-Augmented Generation
- 2026Facet-Level Tracing of Evidence Uncertainty and Hallucination in RAG
- 2024Abstention vs. Hallucination: Benchmarking LLM Source Attribution for Scientific Citations
- 2026Stale-Document Poisoning: When Outdated Retrieval Overrides Correct Model Answers