mlsanityData to 7 Oct 2026

Proactive Image Manipulation Detection

arXiv 2203.15880 ↗First posted 29 Mar 2022cs.CVcited by 35

Not on the map. Why?

Abstract (arXiv)

Image manipulation detection algorithms are often trained to discriminate between images manipulated with particular Generative Models (GMs) and genuine/real images, yet generalize poorly to images manipulated with GMs unseen in the training. Conventional detection algorithms receive an input image passively. By contrast, we propose a proactive scheme to image manipulation detection. Our key enabling technique is to estimate a set of templates which when added onto the real image would lead to more accurate manipulation detection. That is, a template protected real image, and its manipulated version, is better discriminated compared to the original real image vs. its manipulated one. These templates are estimated using certain constraints based on the desired properties of templates. For image manipulation detection, our proposed approach outperforms the prior work by an average precision of 16% for CycleGAN and 32% for GauGAN. Our approach is generalizable to a variety of GMs showing an improvement over prior work by an average precision of 10% averaged across 12 GMs. Our code is available at https://www.github.com/vishal3477/proactive_IMD.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 41 of its 63 references that are in the map. First posted on arXiv 29 Mar 2022.

Builds on

41 of 63 references.

References · 41

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  2. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  3. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  4. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  6. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  7. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  8. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  9. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  10. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  11. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  12. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
29 more
  1. 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 858
  2. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  3. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
  4. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  5. 2017Unsupervised Image-to-Image Translation Networkscited by 602
  6. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
  7. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  8. 2018HiDDeN: Hiding Data With Deep Networkscited by 384
  9. 2017Toward Multimodal Image-to-Image Translationcited by 295
  10. 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
  11. 2019On the Detection of Digital Face Manipulationcited by 259
  12. 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
  13. 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
  14. 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
  15. 2020Adversarial Latent Autoencoderscited by 155
  16. 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
  17. 2019Detecting GAN generated Fake Images using Co-occurrence Matricescited by 124
  18. 2019STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editingcited by 119
  19. 2018ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detectioncited by 104
  20. 2020Disrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systemscited by 65
  21. 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
  22. 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
  23. 2020FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Trackingcited by 46
  24. 2016Semantic Jitter: Dense Supervision for Visual Comparisons via Synthetic Imagescited by 45
  25. 2019Breaking the cycle -- Colleagues are all you needcited by 40
  26. 2021Unified Detection of Digital and Physical Face Attackscited by 31
  27. 2021MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulationcited by 24
  28. 2020OGAN: Disrupting Deepfakes with an Adversarial Attack that Survives Trainingcited by 8
  29. 2013Digital Watermarking for Image AuthenticationBased on Combined DCT, DWT and SVD Transformationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 13; 2024: 9; 2025: 6; 2026: 5.

35 papers.

Sort:

By area:

  1. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
  2. 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
  3. 2023DCFace: Synthetic Face Generation with Dual Condition Diffusion Modelcited by 116
  4. 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Imagescited by 65
  5. 2024Watermark Anything with Localized Messagescited by 49
  6. 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detectioncited by 43
  7. 2022Multi-domain Learning for Updating Face Anti-spoofing Modelscited by 39
  8. 2024OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarkingcited by 35
  9. 2023Tame a Wild Camera: In-the-Wild Monocular Camera Calibrationcited by 34
  10. 2023MaLP: Manipulation Localization Using a Proactive Schemecited by 26
  11. 2025Deepfake Detection that Generalizes Across Benchmarkscited by 20
  12. 2023Robust Identity Perceptual Watermark Against Deepfake Face Swappingcited by 17
23 more
  1. 2024ProMark: Proactive Diffusion Watermarking for Causal Attributioncited by 16
  2. 2023Securing Deep Generative Models with Universal Adversarial Signaturecited by 13
  3. 202550 Years of Automated Face Recognitioncited by 13
  4. 2024Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensicscited by 12
  5. 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 12
  6. 2023DRAW: Defending Camera-shooted RAW against Image Manipulationcited by 10
  7. 2023PrObeD: Proactive Object Detection Wrappercited by 7
  8. 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
  9. 2023RetouchingFFHQ: A Large-scale Dataset for Fine-grained Face Retouching Detectioncited by 5
  10. 2023FakeTracer: Catching Face-swap DeepFakes via Implanting Traces in Trainingcited by 5
  11. 2024ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at Scalecited by 5
  12. 2022Traceable and Authenticable Image Tagging for Fake News Detectioncited by 4
  13. 2024ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identificationcited by 4
  14. 2025StableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Modelscited by 4
  15. 2025Big Brother is Watching: Proactive Deepfake Detection via Learnable Hidden Facecited by 2
  16. 2026RecoverMark: Robust Watermarking for Localization and Recovery of Manipulated Facescited by 2
  17. 2026All in One: Unifying Deepfake Detection, Tampering Localization, and Source Tracing with a Robust Landmark-Identity Watermarkcited by 2
  18. 2024Perturb, Attend, Detect and Localize (PADL): Robust Proactive Image Defensecited by 1
  19. 2025Could AI Trace and Explain the Origins of AI-Generated Images and Text?cited by 1
  20. 2026Learning Probabilistic Embeddings for Unsupervised Action Segmentationcited by 1
  21. 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learningcited by 0
  22. 2026TokenTrace: Multi-Concept Attribution through Watermarked Token Recoverycited by 0
  23. 2026ASAP: Visual Analytics for Identifying and Analyzing Image Patterns in AI-generated Imagescited by 0