Towards Robust Fact-Checking: A Multi-Agent System with Advanced Evidence Retrieval
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
The rapid spread of misinformation in the digital era poses significant challenges to public discourse, necessitating robust and scalable fact-checking solutions. Traditional human-led fact-checking methods, while credible, struggle with the volume and velocity of online content, prompting the integration of automated systems powered by Large Language Models (LLMs). However, existing automated approaches often face limitations, such as handling complex claims, ensuring source credibility, and maintaining transparency. This paper proposes a novel multi-agent system for automated fact-checking that enhances accuracy, efficiency, and explainability. The system comprises four specialized agents: an Input Ingestion Agent for claim decomposition, a Query Generation Agent for formulating targeted subqueries, an Evidence Retrieval Agent for sourcing credible evidence, and a Verdict Prediction Agent for synthesizing veracity judgments with human-interpretable explanations. Evaluated on benchmark datasets (FEVEROUS, HOVER, SciFact), the proposed system achieves a 12.3% improvement in Macro F1-score over baseline methods. The system effectively decomposes complex claims, retrieves reliable evidence from trusted sources, and generates transparent explanations for verification decisions. Our approach contributes to the growing field of automated fact-checking by providing a more accurate, efficient, and transparent verification methodology that aligns with human fact-checking practices while maintaining scalability for real-world applications. Our source code is available at https://github.com/HySonLab/FactAgent
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 10 of its 54 references that are in the map. First posted on arXiv 22 Jun 2025.
Builds on
10 of 54 references.
References · 10
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023A Survey of Large Language Modelscited by 2,576
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 268
- 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
- 2023All Languages Matter: On the Multilingual Safety of Large Language Modelscited by 53
- 2023Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Modelscited by 31
- 2023Revisiting Depth Completion from a Stereo Matching Perspective for Cross-domain Generalizationcited by 18
- 2023On the accuracy and efficiency of group-wise clipping in differentially private optimizationcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026TRUST Agents: A Collaborative Multi-Agent Framework for Fake News Detection, Explainable Verification, and Logic-Aware Claim Reasoning
- 2025RAMA: Retrieval-Augmented Multi-Agent Framework for Misinformation Detection in Multimodal Fact-Checking
- 2024Web Retrieval Agents for Evidence-Based Misinformation Detection
- 2025Toward Verifiable Misinformation Detection: A Multi-Tool LLM Agent Framework
- 2025Multi-agent Systems for Misinformation Lifecycle : Detection, Correction And Source Identification
- 2025EMULATE: A Multi-Agent Framework for Determining the Veracity of Atomic Claims by Emulating Human Actions
- 2023The Perils & Promises of Fact-checking with Large Language Models
- 2025Exploring Health Misinformation Detection with Multi-Agent Debate