Proactive Image Manipulation Detection
Not on the map. Why?
Abstract (arXiv)
Image manipulation detection algorithms are often trained to discriminate between images manipulated with particular Generative Models (GMs) and genuine/real images, yet generalize poorly to images manipulated with GMs unseen in the training. Conventional detection algorithms receive an input image passively. By contrast, we propose a proactive scheme to image manipulation detection. Our key enabling technique is to estimate a set of templates which when added onto the real image would lead to more accurate manipulation detection. That is, a template protected real image, and its manipulated version, is better discriminated compared to the original real image vs. its manipulated one. These templates are estimated using certain constraints based on the desired properties of templates. For image manipulation detection, our proposed approach outperforms the prior work by an average precision of 16% for CycleGAN and 32% for GauGAN. Our approach is generalizable to a variety of GMs showing an improvement over prior work by an average precision of 10% averaged across 12 GMs. Our code is available at https://www.github.com/vishal3477/proactive_IMD.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 41 of its 63 references that are in the map. First posted on arXiv 29 Mar 2022.
Builds on
41 of 63 references.
References · 41
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
29 more
- 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 858
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2017Toward Multimodal Image-to-Image Translationcited by 295
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2019On the Detection of Digital Face Manipulationcited by 259
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
- 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2020Adversarial Latent Autoencoderscited by 155
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2019Detecting GAN generated Fake Images using Co-occurrence Matricescited by 124
- 2019STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editingcited by 119
- 2018ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detectioncited by 104
- 2020Disrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systemscited by 65
- 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
- 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
- 2020FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Trackingcited by 46
- 2016Semantic Jitter: Dense Supervision for Visual Comparisons via Synthetic Imagescited by 45
- 2019Breaking the cycle -- Colleagues are all you needcited by 40
- 2021Unified Detection of Digital and Physical Face Attackscited by 31
- 2021MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulationcited by 24
- 2020OGAN: Disrupting Deepfakes with an Adversarial Attack that Survives Trainingcited by 8
- 2013Digital Watermarking for Image AuthenticationBased on Combined DCT, DWT and SVD Transformationcited by 3
Built on by
Citing papers per year: 2022: 2; 2023: 13; 2024: 9; 2025: 6; 2026: 5.
35 papers.
Sort:
By area:
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2023DCFace: Synthetic Face Generation with Dual Condition Diffusion Modelcited by 116
- 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Imagescited by 65
- 2024Watermark Anything with Localized Messagescited by 49
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detectioncited by 43
- 2022Multi-domain Learning for Updating Face Anti-spoofing Modelscited by 39
- 2024OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarkingcited by 35
- 2023Tame a Wild Camera: In-the-Wild Monocular Camera Calibrationcited by 34
- 2023MaLP: Manipulation Localization Using a Proactive Schemecited by 26
- 2025Deepfake Detection that Generalizes Across Benchmarkscited by 20
- 2023Robust Identity Perceptual Watermark Against Deepfake Face Swappingcited by 17
23 more
- 2024ProMark: Proactive Diffusion Watermarking for Causal Attributioncited by 16
- 2023Securing Deep Generative Models with Universal Adversarial Signaturecited by 13
- 202550 Years of Automated Face Recognitioncited by 13
- 2024Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensicscited by 12
- 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 12
- 2023DRAW: Defending Camera-shooted RAW against Image Manipulationcited by 10
- 2023PrObeD: Proactive Object Detection Wrappercited by 7
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
- 2023RetouchingFFHQ: A Large-scale Dataset for Fine-grained Face Retouching Detectioncited by 5
- 2023FakeTracer: Catching Face-swap DeepFakes via Implanting Traces in Trainingcited by 5
- 2024ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at Scalecited by 5
- 2022Traceable and Authenticable Image Tagging for Fake News Detectioncited by 4
- 2024ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identificationcited by 4
- 2025StableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Modelscited by 4
- 2025Big Brother is Watching: Proactive Deepfake Detection via Learnable Hidden Facecited by 2
- 2026RecoverMark: Robust Watermarking for Localization and Recovery of Manipulated Facescited by 2
- 2026All in One: Unifying Deepfake Detection, Tampering Localization, and Source Tracing with a Robust Landmark-Identity Watermarkcited by 2
- 2024Perturb, Attend, Detect and Localize (PADL): Robust Proactive Image Defensecited by 1
- 2025Could AI Trace and Explain the Origins of AI-Generated Images and Text?cited by 1
- 2026Learning Probabilistic Embeddings for Unsupervised Action Segmentationcited by 1
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learningcited by 0
- 2026TokenTrace: Multi-Concept Attribution through Watermarked Token Recoverycited by 0
- 2026ASAP: Visual Analytics for Identifying and Analyzing Image Patterns in AI-generated Imagescited by 0
- 2026ASAP: Visual Analytics for Identifying and Analyzing Image Patterns in AI-generated Images23 Sep 2026
- 2026Learning Probabilistic Embeddings for Unsupervised Action Segmentation6 Jul 2026
- 2026All in One: Unifying Deepfake Detection, Tampering Localization, and Source Tracing with a Robust Landmark-Identity Watermark26 Feb 2026
- 2026RecoverMark: Robust Watermarking for Localization and Recovery of Manipulated Faces24 Feb 2026
- 2026TokenTrace: Multi-Concept Attribution through Watermarked Token Recovery22 Feb 2026
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learning22 Nov 2025
- 2025StableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Models22 Sep 2025
- 2025Deepfake Detection that Generalizes Across Benchmarks8 Aug 2025
- 202550 Years of Automated Face Recognition30 May 2025
- 2025Big Brother is Watching: Proactive Deepfake Detection via Learnable Hidden Face15 Apr 2025
- 2025Could AI Trace and Explain the Origins of AI-Generated Images and Text?5 Apr 2025
- 2024OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarking2 Dec 2024
23 more
- 2024Watermark Anything with Localized Messages11 Nov 2024
- 2024Perturb, Attend, Detect and Localize (PADL): Robust Proactive Image Defense26 Sep 2024
- 2024ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identification20 Sep 2024
- 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authentication15 Jul 2024
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges11 Jun 2024
- 2024Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensics27 Apr 2024
- 2024ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at Scale3 Apr 2024
- 2024ProMark: Proactive Diffusion Watermarking for Causal Attribution14 Mar 2024
- 2023Robust Identity Perceptual Watermark Against Deepfake Face Swapping2 Nov 2023
- 2023PrObeD: Proactive Object Detection Wrapper28 Oct 2023
- 2023DRAW: Defending Camera-shooted RAW against Image Manipulation31 Jul 2023
- 2023FakeTracer: Catching Face-swap DeepFakes via Implanting Traces in Training27 Jul 2023
- 2023RetouchingFFHQ: A Large-scale Dataset for Fine-grained Face Retouching Detection20 Jul 2023
- 2023Tame a Wild Camera: In-the-Wild Monocular Camera Calibration19 Jun 2023
- 2023Securing Deep Generative Models with Universal Adversarial Signature25 May 2023
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detection10 May 2023
- 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Images25 Apr 2023
- 2023DCFace: Synthetic Face Generation with Dual Condition Diffusion Model14 Apr 2023
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localization30 Mar 2023
- 2023MaLP: Manipulation Localization Using a Proactive Scheme29 Mar 2023
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Models20 Feb 2023
- 2022Traceable and Authenticable Image Tagging for Fake News Detection20 Nov 2022
- 2022Multi-domain Learning for Updating Face Anti-spoofing Models23 Aug 2022
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detectioncited by 43
- 2023Robust Identity Perceptual Watermark Against Deepfake Face Swappingcited by 17
- 2024ProMark: Proactive Diffusion Watermarking for Causal Attributioncited by 16
- 2024Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensicscited by 12
- 2026All in One: Unifying Deepfake Detection, Tampering Localization, and Source Tracing with a Robust Landmark-Identity Watermarkcited by 2
- 2026TokenTrace: Multi-Concept Attribution through Watermarked Token Recoverycited by 0
- 2026All in One: Unifying Deepfake Detection, Tampering Localization, and Source Tracing with a Robust Landmark-Identity Watermark26 Feb 2026
- 2026TokenTrace: Multi-Concept Attribution through Watermarked Token Recovery22 Feb 2026
- 2024Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensics27 Apr 2024
- 2024ProMark: Proactive Diffusion Watermarking for Causal Attribution14 Mar 2024
- 2023Robust Identity Perceptual Watermark Against Deepfake Face Swapping2 Nov 2023
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detection10 May 2023
- 2023DCFace: Synthetic Face Generation with Dual Condition Diffusion Modelcited by 116
- 2024ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at Scalecited by 5
- 2025StableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Modelscited by 4
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learningcited by 0
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learning22 Nov 2025
- 2025StableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Models22 Sep 2025
- 2024ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at Scale3 Apr 2024
- 2023DCFace: Synthetic Face Generation with Dual Condition Diffusion Model14 Apr 2023
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Imagescited by 65
- 2024Watermark Anything with Localized Messagescited by 49
- 2022Multi-domain Learning for Updating Face Anti-spoofing Modelscited by 39
- 2024OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarkingcited by 35
- 2023Tame a Wild Camera: In-the-Wild Monocular Camera Calibrationcited by 34
- 2023MaLP: Manipulation Localization Using a Proactive Schemecited by 26
- 2025Deepfake Detection that Generalizes Across Benchmarkscited by 20
- 2023Securing Deep Generative Models with Universal Adversarial Signaturecited by 13
- 202550 Years of Automated Face Recognitioncited by 13
- 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 12
12 most cited of 24 All 24 (JSON)
- 2026ASAP: Visual Analytics for Identifying and Analyzing Image Patterns in AI-generated Images23 Sep 2026
- 2026Learning Probabilistic Embeddings for Unsupervised Action Segmentation6 Jul 2026
- 2026RecoverMark: Robust Watermarking for Localization and Recovery of Manipulated Faces24 Feb 2026
- 2025Deepfake Detection that Generalizes Across Benchmarks8 Aug 2025
- 202550 Years of Automated Face Recognition30 May 2025
- 2025Big Brother is Watching: Proactive Deepfake Detection via Learnable Hidden Face15 Apr 2025
- 2025Could AI Trace and Explain the Origins of AI-Generated Images and Text?5 Apr 2025
- 2024OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarking2 Dec 2024
- 2024Watermark Anything with Localized Messages11 Nov 2024
- 2024Perturb, Attend, Detect and Localize (PADL): Robust Proactive Image Defense26 Sep 2024
- 2024ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identification20 Sep 2024
- 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authentication15 Jul 2024
12 newest of 24 All 24 (JSON)