mlsanityData to 14 Oct 2026

VetScore: Risk-Weighted Fact Verification for Veterinary Long-Form QA with Citations

arXiv 2608.03675 ↗First posted 4 Aug 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Citation excerpts can be used to increase the reliability of generated outputs and their faithfulness to cited sources, which is especially important in high-stakes domains such as human and veterinary medicine. However, this does not guarantee that generated claims are faithful to the provided excerpts. We present VetScore, a multi-step evaluation method for veterinary long-form question answering, designed to assess how well are generated claims supported by the provided excerpts, weighing this information by each claim's harm potential. VetScore first segments the output and decomposes it into individual claims, then scores each claim with respect to its harm potential and evaluates its faithfulness to source excerpts, and finally calculates the overall risk-adjusted score. We collect an expert-annotated meta-evaluation dataset, evaluate our approach with a range of judge models, and show that it achieves high correlations with veterinary experts even with small judge models, while offering explainability across multiple dimensions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 82 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

31 of 82 references.

References · 31

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  3. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  4. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  5. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  6. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  7. 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 575
  8. 2020Fact or Fiction: Verifying Scientific Claimscited by 554
  9. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
  10. 2023Evaluating Verifiability in Generative Search Enginescited by 303
  11. 2022Teaching language models to support answers with verified quotescited by 292
  12. 2021Measuring Attribution in Natural Language Generation Modelscited by 256
19 more
  1. 2024VERISCORE: Evaluating the factuality of verifiable claims in long-form text generationcited by 117
  2. 2025Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoningcited by 104
  3. 2024LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QAcited by 81
  4. 2020Measuring a hate speech spectrum with faceted Rasch item response theory and perspective-aware, explainable-by-design deep learningcited by 68
  5. 2022Generating Scientific Claims for Zero-Shot Scientific Fact Checkingcited by 59
  6. 2020Generating Fact Checking Briefscited by 50
  7. 2024Molecular Facts: Desiderata for Decontextualization in LLM Fact Verificationcited by 44
  8. 2024A Closer Look at Claim Decompositioncited by 41
  9. 2024Correctness is not Faithfulness in RAG Attributionscited by 18
  10. 2025Citations and Trust in LLM Generated Responsescited by 18
  11. 2024Core: Robust Factual Precision with Informative Sub-Claim Identificationcited by 16
  12. 2026CiteAudit: You Cited It, But Did You Read It? A Benchmark for Verifying Scientific References in the LLM Eracited by 15
  13. 2024Learning Fine-Grained Grounded Citations for Attributed Large Language Modelscited by 13
  14. 2026Cited but Not Verified: Parsing and Evaluating Source Attribution in LLM Deep Research Agentscited by 12
  15. 2025All Claims Are Equal, but Some Claims Are More Equal Than Others: Importance-Sensitive Factuality Evaluation of LLM Generationscited by 6
  16. 2025MedScore: Generalizable Factuality Evaluation of Free-Form Medical Answers by Domain-adapted Claim Decomposition and Verificationcited by 5
  17. 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMscited by 4
  18. 2024Fine-tuning foundational models to code diagnoses from veterinary health recordscited by 3
  19. 2025Human Trust in AI Search: A Large-Scale Experimentcited by 3

Built on by

Not cited yet.