Fact2Fiction: Targeted Poisoning Attack to Agentic Fact-checking System
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
State-of-the-art (SOTA) fact-checking systems combat misinformation by employing autonomous LLM-based agents to decompose complex claims into smaller sub-claims, verify each sub-claim individually, and aggregate the partial results to produce verdicts with justifications (explanations for the verdicts). The security of these systems is crucial, as compromised fact-checkers can amplify misinformation, but remains largely underexplored. To bridge this gap, this work introduces a novel threat model against such fact-checking systems and presents textscFact2Fiction, the first poisoning attack framework targeting SOTA agentic fact-checking systems. Fact2Fiction employs LLMs to mimic the decomposition strategy and exploit system-generated justifications to craft tailored malicious evidences that compromise sub-claim verification. Extensive experiments demonstrate that Fact2Fiction achieves 8.9%--21.2% higher attack success rates than SOTA attacks across various poisoning budgets and exposes security weaknesses in existing fact-checking systems, highlighting the need for defensive countermeasures.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 33 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
19 of 33 references.
Closest ancestors · 1
Same direction, newest first
Other references · 18
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 651
- 2023Detecting Language Model Attacks with Perplexitycited by 431
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 290
- 2022Demystifying Prompts in Language Models via Perplexity Estimationcited by 216
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2024Jasper and Stella: distillation of SOTA embedding modelscited by 112
- 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
- 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
- 2022Synthetic Disinformation Attacks on Automated Fact Verification Systemscited by 44
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 43
6 more
- 2024Decomposition Dilemmas: Does Claim Decomposition Boost or Burden Fact-Checking Performance?cited by 36
- 2024The Automated Verification of Textual Claims (AVeriTeC) Shared Taskcited by 29
- 2022Improved Target-specific Stance Detection on Social Media Platforms by Delving into Conversation Threadscited by 16
- 2024Loki: An Open-Source Tool for Fact Verificationcited by 16
- 2024HerO at AVeriTeC: The Herd of Open Large Language Models for Verifying Real-World Claimscited by 12
- 2025Debating Truth: Debate-driven Claim Verification with Multiple Large Language Model Agentscited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Adversarial Attacks Against Automated Fact-Checking: A Surveycited by 5
- 2026AtomEval: Validity-Aware Atomic Evaluation of Adversarial Claim Rewriting in Fact Verificationcited by 0
- 2026Large Language Models in Misinformation Ecosystems: Misuse, Defense, and Vulnerabilitycited by 0
- 2026Detecting and Explaining Fake News Short Videos with Multimodal Content and Real-World Evidencecited by 0
- 2026Detecting and Explaining Fake News Short Videos with Multimodal Content and Real-World Evidence11 Sep 2026
- 2026Large Language Models in Misinformation Ecosystems: Misuse, Defense, and Vulnerability11 Jul 2026
- 2026AtomEval: Validity-Aware Atomic Evaluation of Adversarial Claim Rewriting in Fact Verification9 Apr 2026
- 2025Adversarial Attacks Against Automated Fact-Checking: A Survey10 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026DECEIVE-AFC: Adversarial Claim Attacks against Search-Enabled LLM-based Fact-Checking Systems
- 2025Towards Robust Fact-Checking: A Multi-Agent System with Advanced Evidence Retrieval
- 2025Toward Verifiable Misinformation Detection: A Multi-Tool LLM Agent Framework
- 2026TRUST Agents: A Collaborative Multi-Agent Framework for Fake News Detection, Explainable Verification, and Logic-Aware Claim Reasoning
- 2025Goal-Aware Identification and Rectification of Misinformation in Multi-Agent Systems
- 2024Can LLMs Produce Faithful Explanations For Fact-checking? Towards Faithful Explainable Fact-Checking via Multi-Agent Debate
- 2025Attacks by Content: Automated Fact-checking is an AI Security Issue
- 2025EMULATE: A Multi-Agent Framework for Determining the Veracity of Atomic Claims by Emulating Human Actions