mlsanityData to 7 Oct 2026

AutoVerifier: An Agentic Automated Verification Framework Using Large Language Models

arXiv 2604.02617 ↗First posted 3 Apr 2026cs.AI cs.CR cs.IRcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Scientific and Technical Intelligence (S&TI) analysis requires verifying complex technical claims across rapidly growing literature, where existing approaches fail to bridge the verification gap between surface-level accuracy and deeper methodological validity. We present AutoVerifier, an LLM-based agentic framework that automates end-to-end verification of technical claims without requiring domain expertise. AutoVerifier decomposes every technical assertion into structured claim triples of the form (Subject, Predicate, Object), constructing knowledge graphs that enable structured reasoning across six progressively enriching layers: corpus construction and ingestion, entity and claim extraction, intra-document verification, cross-source verification, external signal corroboration, and final hypothesis matrix generation. We demonstrate AutoVerifier on a contested quantum computing claim, where the framework, operated by analysts with no quantum expertise, automatically identified overclaims and metric inconsistencies within the target paper, traced cross-source contradictions, uncovered undisclosed commercial conflicts of interest, and produced a final assessment. These results show that structured LLM verification can reliably evaluate the validity and maturity of emerging technologies, turning raw technical documents into traceable, evidence-backed intelligence assessments.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 39 references that are in the map. First posted on arXiv 3 Apr 2026.

Builds on

15 of 39 references.

References · 15

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  5. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  6. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  7. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  8. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  9. 2021A Survey on Automated Fact-Checkingcited by 376
  10. 2018A Survey on Deep Learning for Named Entity Recognitioncited by 281
  11. 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
  12. 2023GPT-NER: Named Entity Recognition via Large Language Modelscited by 158
3 more
  1. 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forwardcited by 105
  2. 2023Revisiting Relation Extraction in the era of Large Language Modelscited by 100
  3. 2021Semi-Supervised Exaggeration Detection of Health Science Press Releasescited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026QuantumNovelty: A Skill-Orchestrating Language Agent for Referee-Style Review and Patentability Screening of Quantum Papers and Patents
  2. 2026MOF-VERIFY: A Failure-Aware Agentic Harness for MOF Hypothesis Verification
  3. 2026MerLean: An Agentic Framework for Autoformalization in Quantum Computation
  4. 2026Evaluating and Guarding Citation Faithfulness in Agentic Scientific Synthesis
  5. 2026Evidence-Grounded Verified Agentic Reasoning: A Path Toward Eliminating LLM Hallucination in Empirical Inference via Tool-Attested Kernel Proofs
  6. 2026Beyond Natural Language: An Agent-Native Language for Autonomous Science
  7. 2026Leveraging LLM Parametric Knowledge for Fact Checking without Retrieval
  8. 2025Can AI Validate Science? Benchmarking LLMs for Accurate Scientific Claim rightarrow Evidence Reasoning