ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanation
Not on the map. Why?
Abstract (arXiv)
With the rapid advancement of generative models, powerful image editing methods now enable diverse and highly realistic image manipulations that far surpass traditional deepfake techniques, posing new challenges for manipulation detection. Existing image manipulation detection and localization (IMDL) benchmarks suffer from limited content diversity, narrow generative-model coverage, and insufficient interpretability, which hinders the generalization and explanation capabilities of current manipulation detection methods. To address these limitations, we introduce ManipBench, a large-scale benchmark for image manipulation detection and localization focusing on AI-edited images. ManipBench contains over 450K manipulated images produced by 25 state-of-the-art image editing models across 12 manipulation categories, among which 100K images are further annotated with bounding boxes, judgment cues, and textual explanations to support interpretable detection. Building upon ManipBench, we propose ManipShield, an all-in-one model based on a Multimodal Large Language Model (MLLM) that leverages contrastive LoRA fine-tuning and task-specific decoders to achieve unified image manipulation detection, localization, and explanation. Extensive experiments on ManipBench and several public datasets demonstrate that ManipShield achieves state-of-the-art performance and exhibits strong generality to unseen manipulation models. Both ManipBench and ManipShield will be released upon publication.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 65 of its 83 references that are in the map. First posted on arXiv 18 Nov 2025.
Builds on
65 of 83 references.
References · 65
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2025Qwen3 Technical Reportcited by 8,195
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
38 more
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,093
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 285
- 2019On the Detection of Digital Face Manipulationcited by 259
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
- 2024Taming Rectified Flow for Inversion and Editingcited by 200
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
- 2024A Sanity Check for AI-generated Image Detectioncited by 187
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 168
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
- 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 127
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 111
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 107
- 2023Inversion-Free Image Editing with Natural Languagecited by 106
- 2025Ovis2.5 Technical Reportcited by 103
- 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
- 2017Image Splicing Localization Using A Multi-Task Fully Convolutional Network (MFCN)cited by 64
- 2023ZONE: Zero-Shot Instruction-Guided Local Editingcited by 61
- 2023Contrastive Denoising Score for Text-guided Latent Diffusion Image Editingcited by 49
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Servicescited by 4
- 2026LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detectioncited by 1
- 2026ITIScore: An Image-to-Text-to-Image Rating Framework for the Image Captioning Ability of MLLMscited by 0
- 2026Progressive Decision-Making for Localizing Open-Ended AI-Generated Image Forgeriescited by 0
- 2026Mandela-Bench: Multimodal Models Remember Canonical Images Instead of Seeing Themcited by 0
- 2026Mandela-Bench: Multimodal Models Remember Canonical Images Instead of Seeing Them26 Sep 2026
- 2026Progressive Decision-Making for Localizing Open-Ended AI-Generated Image Forgeries31 Jul 2026
- 2026LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection28 Jul 2026
- 2026ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Services27 Apr 2026
- 2026ITIScore: An Image-to-Text-to-Image Rating Framework for the Image Captioning Ability of MLLMs4 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Impostor: An Agent-Curated Benchmark for Realistic AIGC Manipulation Localization
- 2024ForgerySleuth: Empowering Multimodal Large Language Models for Image Manipulation Detection
- 2026REVEAL: Reference-Grounded Reasoning for Multimodal Manipulation Detection
- 2024ASAP: Advancing Semantic Alignment Promotes Multi-Modal Manipulation Detecting and Grounding
- 2025Propose and Rectify: A Forensics-Driven MLLM Framework for Image Manipulation Localization
- 2025Detecting Text Manipulation in Images using Vision Language Models
- 2025UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localization
- 2025DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baseline