MedSNIP: Building and Benchmarking Snippet-Level Granularity for Medical Fact Verification
Not on the map. Why?
Abstract (arXiv)
A medical claim's correctness often depends not on the claim alone, but on the clinical structure around it. A claim may require a lab reference range, a causal or conditional link, or patient-specific details to be judged correctly, and atom-level decomposition can fragment these dependencies, leaving the verifier with clinically incomplete claims. We reformulate medical fact-checking around snippet-level verification, where clause-grouped units preserve local clinical structure. We introduce MedSNIP-Bench, a human-annotated benchmark for snippet-level medical fact verification, and MedSNIP, an automatic snippet-generation pipeline. MedSNIP-Bench covers 276 consumer-health and clinical-vignette responses, segmented into 2,524 snippets with dual in-general and in-patient-context labels and six structural pattern codes. MedSNIP is evaluated against human snippet boundaries on MedSNIP-Bench and then used to generate snippet-level units for external corpora. Across MedSNIP-Bench, HealthFC, and MedHallu, snippet-level verification preserves or improves false-class F1, with gains concentrated where answers are long enough to fragment and where the verifier is strong enough to exploit the recovered structure. The largest merge-pattern gain is on causal-conditional clinical chains. It also reduces verifier calls by 24-73%, though the saving survives end-to-end only when decomposition is cheap, which an open-weight decomposer makes possible at no loss of chunking fidelity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 11 Sep 2026.
Builds on
15 of 28 references.
References · 15
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
- 2024Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questionscited by 109
- 2024Factuality of Large Language Models: A Surveycited by 66
- 2024Molecular Facts: Desiderata for Decontextualization in LLM Fact Verificationcited by 44
- 2024A Closer Look at Claim Decompositioncited by 41
- 2024FIRE: Fact-checking with Iterative Retrieval and Verificationcited by 39
- 2023HealthFC: Verifying Health Claims with Evidence-Based Medical Fact-Checkingcited by 35
- 2024K-QA: A Real-World Medical Q&A Benchmarkcited by 31
- 2024OpenFactCheck: A Unified Framework for Factuality Evaluation of LLMscited by 28
- 2024OpenFactCheck: Building, Benchmarking Customized Fact-Checking Systems and Evaluating the Factuality of Claims and LLMscited by 13
3 more
- 2025Optimizing Decomposition for Optimal Claim Verificationcited by 10
- 2025MedScore: Generalizable Factuality Evaluation of Free-Form Medical Answers by Domain-adapted Claim Decomposition and Verificationcited by 5
- 2025MedFact: Benchmarking the Fact-Checking Capabilities of Large Language Models on Chinese Medical Textscited by 1
Built on by
Not cited yet.