mlsanityData to 14 Oct 2026

IDRetracor: Towards Visual Forensics Against Malicious Face Swapping

arXiv 2408.06635 ↗First posted 13 Aug 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The face swapping technique based on deepfake methods poses significant social risks to personal identity security. While numerous deepfake detection methods have been proposed as countermeasures against malicious face swapping, they can only output binary labels (Fake/Real) for distinguishing fake content without reliable and traceable evidence. To achieve visual forensics and target face attribution, we propose a novel task named face retracing, which considers retracing the original target face from the given fake one via inverse mapping. Toward this goal, we propose an IDRetracor that can retrace arbitrary original target identities from fake faces generated by multiple face swapping methods. Specifically, we first adopt a mapping resolver to perceive the possible solution space of the original target face for the inverse mappings. Then, we propose mapping-aware convolutions to retrace the original target face from the fake one. Such convolutions contain multiple kernels that can be combined under the control of the mapping resolver to tackle different face swapping mappings dynamically. Extensive experiments demonstrate that the IDRetracor exhibits promising retracing performance from both quantitative and qualitative perspectives.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 63 references that are in the map. First posted on arXiv 13 Aug 2024.

Builds on

42 of 63 references.

References · 42

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  5. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  7. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  8. 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  10. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  11. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
  12. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 914
30 more
  1. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  2. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
  3. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  4. 2019Dynamic Convolution: Attention over Convolution Kernelscited by 356
  5. 2021Multi-attentional Deepfake Detectioncited by 341
  6. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  7. 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 201
  8. 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 180
  9. 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
  10. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
  11. 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
  12. 2021One Shot Face Swapping on Megapixelscited by 105
  13. 2020ID-Reveal: Identity-aware DeepFake Video Detectioncited by 97
  14. 2021HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swappingcited by 92
  15. 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
  16. 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
  17. 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 50
  18. 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
  19. 2022Deepfake Network Architecture Attributioncited by 47
  20. 2020FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Trackingcited by 46
  21. 2019GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detectioncited by 42
  22. 2022StyleSwap: Style-Based Generator Empowers Robust Face Swappingcited by 39
  23. 2022Detecting and Recovering Sequential DeepFake Manipulationcited by 34
  24. 2022Deep Convolutional Pooling Transformer for Deepfake Detectioncited by 19
  25. 2022Model Attribution of Face-swap Deepfake Videoscited by 17
  26. 2023Robust Identity Perceptual Watermark Against Deepfake Face Swappingcited by 17
  27. 2023MMNet: Multi-Collaboration and Multi-Supervision Network for Sequential Deepfake Detectioncited by 15
  28. 2023FakeTracer: Catching Face-swap DeepFakes via Implanting Traces in Trainingcited by 5
  29. 2023CapST: Leveraging Capsule Networks and Temporal Attention for Accurate Model Attribution in Deep-fake Videoscited by 3
  30. 2022Deepfake Face Traceability with Disentangling Reversing Networkcited by 1

Built on by

Not cited yet.