IDRetracor: Towards Visual Forensics Against Malicious Face Swapping
Not on the map. Why?
Abstract (arXiv)
The face swapping technique based on deepfake methods poses significant social risks to personal identity security. While numerous deepfake detection methods have been proposed as countermeasures against malicious face swapping, they can only output binary labels (Fake/Real) for distinguishing fake content without reliable and traceable evidence. To achieve visual forensics and target face attribution, we propose a novel task named face retracing, which considers retracing the original target face from the given fake one via inverse mapping. Toward this goal, we propose an IDRetracor that can retrace arbitrary original target identities from fake faces generated by multiple face swapping methods. Specifically, we first adopt a mapping resolver to perceive the possible solution space of the original target face for the inverse mappings. Then, we propose mapping-aware convolutions to retrace the original target face from the fake one. Such convolutions contain multiple kernels that can be combined under the control of the mapping resolver to tackle different face swapping mappings dynamically. Extensive experiments demonstrate that the IDRetracor exhibits promising retracing performance from both quantitative and qualitative perspectives.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 63 references that are in the map. First posted on arXiv 13 Aug 2024.
Builds on
42 of 63 references.
References · 42
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 914
30 more
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2019Dynamic Convolution: Attention over Convolution Kernelscited by 356
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 201
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
- 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2020ID-Reveal: Identity-aware DeepFake Video Detectioncited by 97
- 2021HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swappingcited by 92
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 50
- 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
- 2022Deepfake Network Architecture Attributioncited by 47
- 2020FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Trackingcited by 46
- 2019GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detectioncited by 42
- 2022StyleSwap: Style-Based Generator Empowers Robust Face Swappingcited by 39
- 2022Detecting and Recovering Sequential DeepFake Manipulationcited by 34
- 2022Deep Convolutional Pooling Transformer for Deepfake Detectioncited by 19
- 2022Model Attribution of Face-swap Deepfake Videoscited by 17
- 2023Robust Identity Perceptual Watermark Against Deepfake Face Swappingcited by 17
- 2023MMNet: Multi-Collaboration and Multi-Supervision Network for Sequential Deepfake Detectioncited by 15
- 2023FakeTracer: Catching Face-swap DeepFakes via Implanting Traces in Trainingcited by 5
- 2023CapST: Leveraging Capsule Networks and Temporal Attention for Accurate Model Attribution in Deep-fake Videoscited by 3
- 2022Deepfake Face Traceability with Disentangling Reversing Networkcited by 1
Built on by
Not cited yet.