mlsanityData to 14 Oct 2026

Building an Invisible Shield for Your Portrait against Deepfakes

arXiv 2305.12881 ↗First posted 22 May 2023cs.CV cs.MMcited by 1

Not on the map. Why?

Abstract (arXiv)

The issue of detecting deepfakes has garnered significant attention in the research community, with the goal of identifying facial manipulations for abuse prevention. Although recent studies have focused on developing generalized models that can detect various types of deepfakes, their performance is not always be reliable and stable, which poses limitations in real-world applications. Instead of learning a forgery detector, in this paper, we propose a novel framework - Integrity Encryptor, aiming to protect portraits in a proactive strategy. Our methodology involves covertly encoding messages that are closely associated with key facial attributes into authentic images prior to their public release. Unlike authentic images, where the hidden messages can be extracted with precision, manipulating the facial attributes through deepfake techniques can disrupt the decoding process. Consequently, the modified facial attributes serve as a mean of detecting manipulated images through a comparison of the decoded messages. Our encryption approach is characterized by its brevity and efficiency, and the resulting method exhibits a good robustness against typical image processing traces, such as image degradation and noise. When compared to baselines that struggle to detect deepfakes in a black-box setting, our method utilizing conditional encryption showcases superior performance when presented with a range of different types of forgeries. In experiments conducted on our protected data, our approach outperforms existing state-of-the-art methods by a significant margin.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 53 of its 78 references that are in the map. First posted on arXiv 22 May 2023.

Builds on

53 of 78 references.

References · 53

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  4. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  7. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  8. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  9. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
  10. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  11. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  12. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
38 more
  1. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  2. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  3. 2018HiDDeN: Hiding Data With Deep Networkscited by 397
  4. 2021Multi-attentional Deepfake Detectioncited by 341
  5. 2022Detecting Deepfakes with Self-Blended Imagescited by 338
  6. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
  7. 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
  8. 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 265
  9. 2019On the Detection of Digital Face Manipulationcited by 260
  10. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  11. 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 242
  12. 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 201
  13. 2017Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognitioncited by 178
  14. 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
  15. 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
  16. 2017Generative Adversarial Perturbationscited by 153
  17. 2019Robust Invisible Video Watermarking with Attentioncited by 149
  18. 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
  19. 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
  20. 2021Representative Forgery Mining for Fake Face Detectioncited by 108
  21. 2020Lipreading using Temporal Convolutional Networkscited by 102
  22. 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
  23. 2020ID-Reveal: Identity-aware DeepFake Video Detectioncited by 97
  24. 2020Responsible Disclosure of Generative Models Using Scalable Fingerprintingcited by 91
  25. 2020Distortion Agnostic Deep Watermarkingcited by 90
  26. 2020Detecting Deep-Fake Videos from Appearance and Behaviorcited by 66
  27. 2020Disrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systemscited by 65
  28. 2021Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learningcited by 60
  29. 2021Improving the Efficiency and Robustness of Deepfakes Detection through Precise Geometric Featurescited by 57
  30. 2021CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakescited by 56
  31. 2020Face Forgery Detection by 3D Decompositioncited by 53
  32. 2020FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Trackingcited by 46
  33. 2021DVMark: A Deep Multiscale Framework for Video Watermarkingcited by 46
  34. 2022Delving into Sequential Patches for Deepfake Detectioncited by 41
  35. 2020Head2Head: Video-based Neural Head Synthesiscited by 40
  36. 2022Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbationscited by 39
  37. 2021CoReD: Generalizing Fake Media Detection with Continual Representation using Distillationcited by 37
  38. 2022Explaining Deepfake Detection by Analysing Image Matchingcited by 34

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.