mlsanityData to 7 Oct 2026

MaLP: Manipulation Localization Using a Proactive Scheme

arXiv 2303.16976 ↗First posted 29 Mar 2023cs.CVcited by 26

Not on the map. Why?

Abstract (arXiv)

Advancements in the generation quality of various Generative Models (GMs) has made it necessary to not only perform binary manipulation detection but also localize the modified pixels in an image. However, prior works termed as passive for manipulation localization exhibit poor generalization performance over unseen GMs and attribute modifications. To combat this issue, we propose a proactive scheme for manipulation localization, termed MaLP. We encrypt the real images by adding a learned template. If the image is manipulated by any GM, this added protection from the template not only aids binary detection but also helps in identifying the pixels modified by the GM. The template is learned by leveraging local and global-level features estimated by a two-branch architecture. We show that MaLP performs better than prior passive works. We also show the generalizability of MaLP by testing on 22 different GMs, providing a benchmark for future research on manipulation localization. Finally, we show that MaLP can be used as a discriminator for improving the generation quality of GMs. Our models/codes are available at www.github.com/vishal3477/pro_loc.

Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 58 of its 72 references that are in the map. First posted on arXiv 29 Mar 2023.

Builds on

58 of 72 references.

References · 58

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  6. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  9. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  10. 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
  11. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  12. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
38 more
  1. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  2. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  3. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  4. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  5. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  6. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  7. 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 858
  8. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  9. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
  10. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  11. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  12. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  13. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  14. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  15. 2017Unsupervised Image-to-Image Translation Networkscited by 602
  16. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  17. 2022Detecting Deepfakes with Self-Blended Imagescited by 332
  18. 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
  19. 2017Toward Multimodal Image-to-Image Translationcited by 295
  20. 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
  21. 2020What makes fake images detectable? Understanding properties that generalizecited by 272
  22. 2019On the Detection of Digital Face Manipulationcited by 259
  23. 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
  24. 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
  25. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
  26. 2018GANimation: Anatomically-aware Facial Animation from a Single Imagecited by 160
  27. 2020Adversarial Latent Autoencoderscited by 155
  28. 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
  29. 2019Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videoscited by 130
  30. 2019Detecting GAN generated Fake Images using Co-occurrence Matricescited by 124
  31. 2019STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editingcited by 119
  32. 2020Disrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systemscited by 65
  33. 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
  34. 2018Image-to-Image Translation via Group-wise Deep Whitening-and-Coloring Transformationcited by 49
  35. 2020FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Trackingcited by 46
  36. 2019Breaking the cycle -- Colleagues are all you needcited by 40
  37. 2020FakeLocator: Robust Localization of GAN-Based Face Manipulationscited by 40
  38. 2022Multi-domain Learning for Updating Face Anti-spoofing Modelscited by 39

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 12; 2025: 6; 2026: 3.

26 papers.

Sort:

By area:

  1. 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
  2. 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 111
  3. 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 109
  4. 2024OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarkingcited by 35
  5. 2024V2A-Mark: Versatile Deep Visual-Audio Watermarking for Manipulation Localization and Copyright Protectioncited by 27
  6. 2025Deepfake Detection that Generalizes Across Benchmarkscited by 20
  7. 2024GIM: A Million-scale Benchmark for Generative Image Manipulation Detection and Localizationcited by 19
  8. 2023Robust Identity Perceptual Watermark Against Deepfake Face Swappingcited by 17
  9. 2024ProMark: Proactive Diffusion Watermarking for Causal Attributioncited by 16
  10. 2024Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensicscited by 12
  11. 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 12
  12. 2023Tracing Hyperparameter Dependencies for Model Parsing via Learnable Graph Pooling Networkcited by 8
14 more
  1. 2023PrObeD: Proactive Object Detection Wrappercited by 7
  2. 2025TAG-WM: Tamper-Aware Generative Image Watermarking via Diffusion Inversion Sensitivitycited by 7
  3. 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
  4. 2024COMPOSE: Comprehensive Portrait Shadow Editingcited by 6
  5. 2024ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identificationcited by 4
  6. 2025StableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Modelscited by 4
  7. 2025VizDefender: Unmasking Visualization Tampering through Proactive Localization and Intent Inferencecited by 3
  8. 2024Proactive Schemes: A Survey of Adversarial Attacks for Social Goodcited by 2
  9. 2025Big Brother is Watching: Proactive Deepfake Detection via Learnable Hidden Facecited by 2
  10. 2025VisGuard: Securing Visualization Dissemination through Tamper-Resistant Data Retrievalcited by 2
  11. 2024Perturb, Attend, Detect and Localize (PADL): Robust Proactive Image Defensecited by 1
  12. 2026TokenTrace: Multi-Concept Attribution through Watermarked Token Recoverycited by 0
  13. 2026APT: Anchor-aligned Perturbations for Tamper Localization in Fully Regenerated Imagescited by 0
  14. 2026Learning Semantic Inpainting for Animatable Gaussian Head Avatarscited by 0