MM-VeriAgent: Learning to Use Extensive Tools to Verify Multimodal Misinformation with Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Real-world multimodal misinformation often involves mixed forgery sources, requiring sample-specific detection strategies. Existing tool-augmented methods rely on predefined workflows or inference-time planning, limiting adaptability or increasing inference cost. To address this issue, we introduce MM-VeriAgent, which learns to verify mixed-source multimodal misinformation with tools. We first build MM-VeriTools, a specialized toolkit for misinformation detection agents. By benchmarking various candidate models and methods on the sub-tasks required by mixed-source detection, we select the strongest for textual, visual, and cross-modal forgery analysis and encapsulate them as callable tools with a unified interface. On top of this toolkit, we train the LVLM agent with reinforcement learning to teach it how to use these tools to better solve mixed-source detection. Since many of the tools are specialized models whose online execution at every rollout severely limits RL efficiency, we further introduce Tool-Execution Cache, which pre-executes candidate tool calls and reuses their cached outputs during training. This preserves multi-step rollouts while reducing online tool execution, largely improving the training efficiency.Experiments on MMFakeBench demonstrate substantial accuracy gains over the base model without explicit tool search at inference time. Ablation and efficiency analyses further validate the learned tool-use policy and show that Tool-Execution Cache reduces online tool executions during training.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
20 of 34 references.
References · 20
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 98
- 2025VerlTool: Towards Holistic Agentic Reinforcement Learning with Tool Usecited by 92
- 2023GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformercited by 84
8 more
- 2024MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMscited by 60
- 2025Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizablecited by 58
- 2025Simulating Environments with Reasoning Models for Agent Trainingcited by 52
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 42
- 2022Faking Fake News for Real Fake News Detection: Propaganda-loaded Training Data Generationcited by 41
- 2024FKA-Owl: Advancing Multimodal Fake News Detection through Knowledge-Augmented LVLMscited by 38
- 2026TVCACHE: A Stateful Tool-Value Cache for Post-Training LLM Agentscited by 2
- 2026CacheRL:Multi-Turn Tool-Calling Agents via Cached Rollouts and Hybrid Rewardcited by 2
Built on by
Not cited yet.