mlsanityData to 14 Oct 2026

Can ChatGPT Perform Image Splicing Detection? A Preliminary Study

arXiv 2506.05358 ↗First posted 22 May 2025cs.CV cs.AI cs.CRcited by 1

On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness

Abstract (arXiv)

Multimodal Large Language Models (MLLMs) like GPT-4V are capable of reasoning across text and image modalities, showing promise in a variety of complex vision-language tasks. In this preliminary study, we investigate the out-of-the-box capabilities of GPT-4V in the domain of image forensics, specifically, in detecting image splicing manipulations. Without any task-specific fine-tuning, we evaluate GPT-4V using three prompting strategies: Zero-Shot (ZS), Few-Shot (FS), and Chain-of-Thought (CoT), applied over a curated subset of the CASIA v2.0 splicing dataset. Our results show that GPT-4V achieves competitive detection performance in zero-shot settings (more than 85% accuracy), with CoT prompting yielding the most balanced trade-off across authentic and spliced images. Qualitative analysis further reveals that the model not only detects low-level visual artifacts but also draws upon real-world contextual knowledge such as object scale, semantic consistency, and architectural facts, to identify implausible composites. While GPT-4V lags behind specialized state-of-the-art splicing detection models, its generalizability, interpretability, and encyclopedic reasoning highlight its potential as a flexible tool in image forensics.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 7 of its 22 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

7 of 22 references.

References · 7

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2017Mask R-CNNcited by 7,277
  5. 2015An Introduction to Convolutional Neural Networkscited by 514
  6. 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
  7. 2023Is ChatGPT a Good Sentiment Analyzer? A Preliminary Studycited by 96

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensics
  2. 2023Lost in Translation: When GPT-4V(ision) Can't See Eye to Eye with Text. A Vision-Language-Consistency Analysis of VLLMs and Beyond
  3. 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generation
  4. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
  5. 2025REVEAL -- Reasoning and Evaluation of Visual Evidence through Aligned Language
  6. 2024Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiency
  7. 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localization
  8. 2026Fingerprinting Multimodal Large Language Models