Can ChatGPT Perform Image Splicing Detection? A Preliminary Study
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) like GPT-4V are capable of reasoning across text and image modalities, showing promise in a variety of complex vision-language tasks. In this preliminary study, we investigate the out-of-the-box capabilities of GPT-4V in the domain of image forensics, specifically, in detecting image splicing manipulations. Without any task-specific fine-tuning, we evaluate GPT-4V using three prompting strategies: Zero-Shot (ZS), Few-Shot (FS), and Chain-of-Thought (CoT), applied over a curated subset of the CASIA v2.0 splicing dataset. Our results show that GPT-4V achieves competitive detection performance in zero-shot settings (more than 85% accuracy), with CoT prompting yielding the most balanced trade-off across authentic and spliced images. Qualitative analysis further reveals that the model not only detects low-level visual artifacts but also draws upon real-world contextual knowledge such as object scale, semantic consistency, and architectural facts, to identify implausible composites. While GPT-4V lags behind specialized state-of-the-art splicing detection models, its generalizability, interpretability, and encyclopedic reasoning highlight its potential as a flexible tool in image forensics.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 7 of its 22 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
7 of 22 references.
References · 7
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2017Mask R-CNNcited by 7,277
- 2015An Introduction to Convolutional Neural Networkscited by 514
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 431
- 2023Is ChatGPT a Good Sentiment Analyzer? A Preliminary Studycited by 96
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensics
- 2023Lost in Translation: When GPT-4V(ision) Can't See Eye to Eye with Text. A Vision-Language-Consistency Analysis of VLLMs and Beyond
- 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generation
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
- 2025REVEAL -- Reasoning and Evaluation of Visual Evidence through Aligned Language
- 2024Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiency
- 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localization
- 2026Fingerprinting Multimodal Large Language Models