mlsanityData to 14 Oct 2026

DeepSciVerify: Verifying Scientific Claim--Citation Alignment via LLM-Driven Evidence Escalation

arXiv 2605.27710 ↗First posted 26 May 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Misalignment between claims and their cited evidence is a common failure mode in reports generated by large language models, limiting their reliability in scientific and other high-stakes settings. We present DeepSciVerify, a two-stage pipeline for scientific claim-citation verification that combines abstract-level reasoning with selective escalation to passage-level evidence. The system first verifies claims using the abstract and defers uncertain cases, retrieving and analyzing full-text passages only when necessary. This design leverages complementary behaviors across LLMs, as some models are more conservative while others are more decisive under uncertainty. On the SCitance benchmark, DeepSciVerify achieves 86.7 Micro-F1, outperforming strong abstract-only baselines by +4.5 points while resolving 67% of instances without full-text retrieval. These results suggest that selective evidence escalation improves both accuracy and efficiency in claim-citation verification.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 33 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

13 of 33 references.

References · 13

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  4. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  5. 2020Fact or Fiction: Verifying Scientific Claimscited by 554
  6. 2022OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and conceptscited by 177
  7. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
  8. 2023The Semantic Scholar Open Data Platformcited by 118
  9. 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 118
  10. 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
  11. 2024Delving into LLM-assisted writing in biomedical publications through excess vocabularycited by 78
  12. 2021Overview and Insights from the SciVer Shared Task on Scientific Claim Verificationcited by 17
1 more
  1. 2025SciVer: Evaluating Foundation Models for Multimodal Scientific Claim Verificationcited by 17

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Can AI Validate Science? Benchmarking LLMs for Accurate Scientific Claim rightarrow Evidence Reasoning
  2. 2025SemanticCite: Citation Verification with AI-Powered Full-Text Analysis and Evidence-Based Reasoning
  3. 2026Cited but Not Verified: Parsing and Evaluating Source Attribution in LLM Deep Research Agents
  4. 2025LLM-based Corroborating and Refuting Evidence Retrieval for Scientific Claim Verification
  5. 2026HiEviDR-Bench: A Benchmark for Hierarchical Evidence Aggregation in Deep Research
  6. 2026RefVerifier: Semi-Automated Reference Claim Verification for Scientific Manuscripts ↗
  7. 2025Table-Text Alignment: Explaining Claim Verification Against Tables in Scientific Papers
  8. 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factuality