EAVer: Long-Form Factuality Verification as an End-to-End Agentic Policy
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Long-form factuality verification is commonly implemented as a static decompose-search-verify pipeline, with separately prompted modules processing claims and invoking external search. Treating claims independently makes LLM and search calls scale with claim count and causes repeated searches for overlapping evidence about related claims. We introduce EAVer, an End-to-end Agentic Verifier that learns to control the complete response-level verification workflow as a unified policy. EAVer groups semantically related claims, routes each group to direct verification or targeted search based on confidence, and keeps evidence returned by search in compact in-context memos for cross-claim reuse. To train this policy, we develop a privileged-teacher synthesis pipeline that converts gold claim annotations into executable multi-turn tool-interaction trajectories with live search rather than post-hoc rationales. Structural, label-alignment, tool-use, search-budget, and leakage checks yield 1,447 quality-controlled trajectories. We further construct 794 bidirectional same-trajectory preference pairs that keep claim grouping, search, and evidence fixed, enabling decision-focused Direct Preference Optimization (DPO) over factuality-decision tokens. The results with Qwen3-8B show that EAVer outperforms the strongest search-based baseline on each benchmark by 2.88 Macro-F1 points on VeriFastScore and 4.73 points on the out-of-distribution FaStFact-Bench, while using about 80% fewer searches than the most search-efficient baseline. Moreover, EAVer consistently improves performance across models ranging from 4B to 32B parameters, demonstrating its strong generalizability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 8 of its 22 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
8 of 22 references.
References · 8
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
- 2024VERISCORE: Evaluating the factuality of verifiable claims in long-form text generationcited by 117
- 2024FIRE: Fact-checking with Iterative Retrieval and Verificationcited by 39
- 2025VeriFastScore: Speeding up long-form factuality evaluationcited by 8
- 2025FaStfact: Faster, Stronger Long-Form Factuality Evaluations in LLMscited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factuality
- 2025Althea: The Fact-Checking--Metalearning Tradeoff in AI-Assisted Verification
- 2026OpenFC: Learning Verification Policies towards Open-Search Fact Checking
- 2026Leveraging LLM Parametric Knowledge for Fact Checking without Retrieval
- 2025EMULATE: A Multi-Agent Framework for Determining the Veracity of Atomic Claims by Emulating Human Actions
- 2026From Verdict to Process: Agentic Reinforcement Learning for Multi-Stage Fact Verification
- 2025Optimizing Decomposition for Optimal Claim Verification
- 2026VeriHarness: Scaling Agentic Verification for Long-Horizon Tasks