SynCred-Bench: Benchmarking Synthetic Credibility in AI-Generated Visual Misinformation
Not on the map. Why?
Abstract (arXiv)
Recent generative models can now produce visual artifacts with realistic embedded text and layouts, creating a new misinformation threat: synthetic credibility. We introduce SYNCRED-Bench, a benchmark of 600 AI-generated misinformation images balanced across six credible-form categories and seven fine-grained circulation styles, together with FP450, a real-image negative set for measuring false positives. Extensive evaluation shows that existing systems remain unreliable: under a 5% false-positive-rate constraint, 15 MLLMs achieve only 10.5% true positive rate (TPR), open-source AIGC detectors achieve less than 5%, and commercial APIs reach 57.6%. Human annotators also struggled to identify synthetic credibility, reaching only 63% TPR. These findings establish synthetic credibility as a severe and underexplored visual misinformation challenge, and provide a benchmark for developing detectors that reason beyond superficial credibility cues.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 35 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
12 of 35 references.
References · 12
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 398
- 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robustcited by 187
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 107
- 2024MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMscited by 61
- 2025SynthID-Image: Image watermarking at internet scalecited by 31
- 2024Multimodal Misinformation Detection by Learning from Synthetic Data with Multimodal LLMscited by 13
- 2026DOCFORGE-BENCH: A Comprehensive 0-shot Benchmark for Document Forgery Detection and Analysiscited by 4
- 2026When the Forger Is the Judge: GPT-Image-2 Cannot Recognize Its Own Faked Documentscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026AI-generated Images Challenge Visual Trust in High-risk Scenarios
- 2024The Visual Counter Turing Test (VCT2): A Benchmark for Evaluating AI-Generated Image Detection and the Visual AI Index (VAI)
- 2026The Synthetic Media Shift: Tracking the Rise, Virality, and Detectability of AI-Generated Multimodal Misinformation
- 2025So-Fake: Benchmarking and Explaining Social Media Image Forgery Detection
- 2026MIC: Explaining Image-Claim Inconsistencies in AI-Generated Multimodal Misinformation
- 2026EviScene: Beyond "Is It AI?" for Agentic Image Factuality Assessment
- 2025AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detection
- 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detection