EviScene: Beyond "Is It AI?" for Agentic Image Factuality Assessment
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Determining whether an image is AI-generated does not establish whether the situation it depicts is factually supported. We formulate Image Factuality Assessment: given an image and a generic verification instruction, a system returns a supported or refuted verdict with an evidence-grounded explanation. Without a supplied textual claim, the system must progressively refine factual questions during investigation and align external evidence with the specific situation depicted. We introduce EviLens, an expert-reviewed benchmark of 10,174 supported and refuted images from controlled construction and web collection, covering twelve factual error types and evaluating both verdict accuracy and evidence sufficiency. We develop EviScene, a multimodal ReAct agent that interleaves visual inspection, external retrieval, and evidence analysis, using new findings to refine its questions and revisit relevant image details. We train a compact policy with supervised fine-tuning on reviewed teacher trajectories, followed by privileged on-policy self-distillation applied to verified decisions from the policy's own investigations. On the 1,527-image test set, the trained Qwen3.5-9B agent achieves 79.05% balanced accuracy and a Strict Evidence Sufficiency Rate (SESR) of 52.26%, improving over the same-backbone base agent by 6.71 and 9.37 percentage points, respectively. Its SESR is the highest among the evaluated agents.Code, models, and data will be released at https://github.com/wangzian828/EVISCENE and https://huggingface.co/ZiAnwang/EviScene.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 56 references that are in the map. First posted on arXiv 10 Oct 2026.
Builds on
29 of 56 references.
Closest ancestors · 2
Same direction, newest first
- 2026Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning13 Jun
- 2026VisBrowse-Bench: Benchmarking Visual-Native Search for Multimodal Browsing Agents17 Mar
Other references · 27
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
- 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 107
- 2022End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Modelscited by 107
- 2023Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Imagescited by 80
- 2024SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detectioncited by 74
- 2025Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizablecited by 60
- 2023Multimodal Automated Fact-Checking: A Surveycited by 53
15 more
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 43
- 2023VERITE: A Robust Benchmark for Multimodal Misinformation Detection Accounting for Unimodal Biascited by 39
- 2025AVerImaTeC: A Dataset for Automatic Verification of Image-Text Claims with Evidence from the Webcited by 18
- 2023FACTIFY3M: A Benchmark for Multimodal Fact Verification with Explainability through 5W Question-Answeringcited by 16
- 2024Evaluating Image Hallucination in Text-to-Image Generation with Question-Answeringcited by 16
- 2024T2I-FactualBench: Benchmarking the Factuality of Text-to-Image Models with Knowledge-Intensive Conceptscited by 14
- 2025Beyond Artifacts: Real-Centric Envelope Modeling for Reliable AI-Generated Image Detectioncited by 11
- 2026MIRROR: Manifold Ideal Reference ReconstructOR for Generalizable AI-Generated Image Detectioncited by 11
- 2025Semantic Visual Anomaly Detection and Reasoning in AI-Generated Imagescited by 8
- 2026Towards On-Policy Data Evolution for Visual-Native Multimodal Deep Search Agentscited by 8
- 2026VeriTaS: The First Dynamic Benchmark for Multimodal Automated Fact-Checkingcited by 6
- 2024"Image, Tell me your story!" Predicting the original meta-context of visual misinformationcited by 4
- 2026RW-Post: Auditable Evidence-Grounded Multimodal Fact-Checking in the Wildcited by 2
- 2026Rethinking the Readout: Unlocking Video Backbones for AI-Generated Video Detectioncited by 2
- 2026FAGER: Factually Grounded Evaluation and Refinement of Text-to-Image Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025From Evidence to Verdict: An Agent-Based Forensic Framework for AI-Generated Image Detection
- 2026Dissecting Agentic Forensics: The Role of Triage, Prompting, and Evidence Arbitration in Open-World Fake Image Detection
- 2026InSight: A Benchmark for Agentic Claim Verification in Interactive Visualizations
- 2026WorldFact-Bench: Beyond Image-Internal Plausibility to Image-World Consistency
- 2026MIC: Explaining Image-Claim Inconsistencies in AI-Generated Multimodal Misinformation
- 2026Defake-o3: From Speculative Rationales to Verifiable Evidence for Explainable AIGI Detection
- 2026MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory
- 2026VILLAIN at AVerImaTeC: Verifying Image-Text Claims via Multi-Agent Collaboration