Building an Invisible Shield for Your Portrait against Deepfakes
Not on the map. Why?
Abstract (arXiv)
The issue of detecting deepfakes has garnered significant attention in the research community, with the goal of identifying facial manipulations for abuse prevention. Although recent studies have focused on developing generalized models that can detect various types of deepfakes, their performance is not always be reliable and stable, which poses limitations in real-world applications. Instead of learning a forgery detector, in this paper, we propose a novel framework - Integrity Encryptor, aiming to protect portraits in a proactive strategy. Our methodology involves covertly encoding messages that are closely associated with key facial attributes into authentic images prior to their public release. Unlike authentic images, where the hidden messages can be extracted with precision, manipulating the facial attributes through deepfake techniques can disrupt the decoding process. Consequently, the modified facial attributes serve as a mean of detecting manipulated images through a comparison of the decoded messages. Our encryption approach is characterized by its brevity and efficiency, and the resulting method exhibits a good robustness against typical image processing traces, such as image degradation and noise. When compared to baselines that struggle to detect deepfakes in a black-box setting, our method utilizing conditional encryption showcases superior performance when presented with a range of different types of forgeries. In experiments conducted on our protected data, our approach outperforms existing state-of-the-art methods by a significant margin.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 53 of its 78 references that are in the map. First posted on arXiv 22 May 2023.
Builds on
53 of 78 references.
References · 53
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
38 more
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2018HiDDeN: Hiding Data With Deep Networkscited by 397
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 265
- 2019On the Detection of Digital Face Manipulationcited by 260
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 242
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 201
- 2017Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognitioncited by 178
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
- 2017Generative Adversarial Perturbationscited by 153
- 2019Robust Invisible Video Watermarking with Attentioncited by 149
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
- 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
- 2021Representative Forgery Mining for Fake Face Detectioncited by 108
- 2020Lipreading using Temporal Convolutional Networkscited by 102
- 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
- 2020ID-Reveal: Identity-aware DeepFake Video Detectioncited by 97
- 2020Responsible Disclosure of Generative Models Using Scalable Fingerprintingcited by 91
- 2020Distortion Agnostic Deep Watermarkingcited by 90
- 2020Detecting Deep-Fake Videos from Appearance and Behaviorcited by 66
- 2020Disrupting Deepfakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systemscited by 65
- 2021Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learningcited by 60
- 2021Improving the Efficiency and Robustness of Deepfakes Detection through Precise Geometric Featurescited by 57
- 2021CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakescited by 56
- 2020Face Forgery Detection by 3D Decompositioncited by 53
- 2020FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Trackingcited by 46
- 2021DVMark: A Deep Multiscale Framework for Video Watermarkingcited by 46
- 2022Delving into Sequential Patches for Deepfake Detectioncited by 41
- 2020Head2Head: Video-based Neural Head Synthesiscited by 40
- 2022Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbationscited by 39
- 2021CoReD: Generalizing Fake Media Detection with Continual Representation using Distillationcited by 37
- 2022Explaining Deepfake Detection by Analysing Image Matchingcited by 34
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2024: 1.
1 paper.