mlsanityData to 7 Oct 2026

Protecting Celebrities from DeepFake with Identity Consistency Transformer

arXiv 2203.01318 ↗First posted 2 Mar 2022cs.CVcited by 95

Not on the map. Why?

Abstract (arXiv)

In this work we propose Identity Consistency Transformer, a novel face forgery detection method that focuses on high-level semantics, specifically identity information, and detecting a suspect face by finding identity inconsistency in inner and outer face regions. The Identity Consistency Transformer incorporates a consistency loss for identity consistency determination. We show that Identity Consistency Transformer exhibits superior generalization ability not only across different datasets but also across various types of image degradation forms found in real-world applications including deepfake videos. The Identity Consistency Transformer can be easily enhanced with additional identity information when such information is available, and for this reason it is especially well-suited for detecting face forgeries involving celebrities. Code will be released at urlhttps://github.com/LightDXY/ICTDeepFake

Key facts. Cited by 95 papers in the map (data through 7 Oct 2026). Builds on 44 of its 62 references that are in the map. First posted on arXiv 2 Mar 2022.

Builds on

44 of 62 references.

References · 44

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  6. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  7. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
  8. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  9. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  10. 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
  11. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
  12. 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 526
32 more
  1. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
  2. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  3. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
  4. 2021Multi-attentional Deepfake Detectioncited by 339
  5. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
  6. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
  7. 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
  8. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
  9. 2020What makes fake images detectable? Understanding properties that generalizecited by 272
  10. 2019On the Detection of Digital Face Manipulationcited by 259
  11. 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 251
  12. 2021Mobile-Former: Bridging MobileNet and Transformercited by 234
  13. 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
  14. 2021BEVT: BERT Pretraining of Video Transformerscited by 169
  15. 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
  16. 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
  17. 2018Learning Rich Features for Image Manipulation Detectioncited by 154
  18. 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
  19. 2019Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videoscited by 130
  20. 2018Two-Stream Neural Networks for Tampered Face Detectioncited by 125
  21. 2016Fast Face-swap Using Convolutional Neural Networkscited by 119
  22. 2020ID-Reveal: Identity-aware DeepFake Video Detectioncited by 97
  23. 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
  24. 2017On Face Segmentation, Face Swapping, and Face Perceptioncited by 71
  25. 2019Use of a Capsule Network to Detect Fake Images and Videoscited by 63
  26. 2019Hybrid LSTM and Encoder-Decoder Architecture for Detection of Image Forgeriescited by 59
  27. 2018In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinkingcited by 54
  28. 2018RSGAN: Face Swapping and Editing using Face and Hair Representation in Latent Spacescited by 50
  29. 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
  30. 20193D Guided Fine-Grained Face Manipulationcited by 45
  31. 2016Do We Really Need to Collect Millions of Faces for Effective Face Recognition?cited by 17
  32. 2017SREFI: Synthesis of Realistic Example Face Imagescited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 7; 2023: 27; 2024: 26; 2025: 22; 2026: 13.

95 papers.

Sort:

By area:

  1. 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 126
  2. 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 122
  3. 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
  4. 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 83
  5. 2023AltFreezing for More General Video Face Forgery Detectioncited by 78
  6. 2023Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesiscited by 72
  7. 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
  8. 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
  9. 2024Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detectioncited by 47
  10. 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
  11. 2022Audio-Visual Person-of-Interest DeepFake Detectioncited by 43
  12. 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detectioncited by 43
38 more
  1. 2023Improving Fairness in Deepfake Detectioncited by 40
  2. 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Modelscited by 36
  3. 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
  4. 2023PTW: Pivotal Tuning Watermarking for Pre-Trained Image Generatorscited by 34
  5. 2024Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detectioncited by 30
  6. 2025BusterX: MLLM-Powered AI-Generated Video Forgery Detection and Explanationcited by 30
  7. 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusioncited by 29
  8. 2024MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery Detectioncited by 27
  9. 2025Exploring Unbiased Deepfake Detection via Token-Level Shuffling and Mixingcited by 27
  10. 2023DeepFake-Adapter: Dual-Level Adapter for DeepFake Detectioncited by 26
  11. 2023Locate and Verify: A Two-Stream Network for Improved Deepfake Detectioncited by 26
  12. 2024Learning Natural Consistency Representation for Face Forgery Video Detectioncited by 26
  13. 2023Weakly-supervised deepfake localization in diffusion-generated imagescited by 24
  14. 2022MINTIME: Multi-Identity Size-Invariant Video Deepfake Detectioncited by 23
  15. 2023DFIL: Deepfake Incremental Learning by Exploiting Domain-invariant Forgery Cluescited by 23
  16. 2024Learning Spatiotemporal Inconsistency via Thumbnail Layout for Face Deepfake Detectioncited by 21
  17. 2022Deepfake Video Detection with Spatiotemporal Dropout Transformercited by 19
  18. 2024SoK: Systematization and Benchmarking of Deepfake Detectors in a Unified Frameworkcited by 14
  19. 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
  20. 2022FedForgery: Generalized Face Forgery Detection with Residual Federated Learningcited by 12
  21. 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 12
  22. 2023Avatar Fingerprinting for Authorized Use of Synthetic Talking-Head Videoscited by 11
  23. 2023Reinforced Disentanglement for Face Swapping without Skip Connectioncited by 10
  24. 2024Data-Independent Operator: A Training-Free Artifact Representation Extractor for Generalizable Deepfake Detectioncited by 10
  25. 2024A Timely Survey on Vision Transformer for Deepfake Detectioncited by 10
  26. 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
  27. 2025SyncTalk++: High-Fidelity and Efficient Synchronized Talking Heads Synthesis Using Gaussian Splattingcited by 9
  28. 2023Unsupervised Multimodal Deepfake Detection Using Intra- and Cross-Modal Inconsistenciescited by 8
  29. 2024Semantic Contextualization of Face Forgery: A New Definition, Dataset, and Detection Methodcited by 8
  30. 2024Open-Set Deepfake Detection: A Parameter-Efficient Adaptation Method with Forgery Style Mixturecited by 7
  31. 2025Guard Me If You Know Me: Protecting Specific Face-Identity from Deepfakescited by 7
  32. 2025DeepShield: Fortifying Deepfake Video Detection with Local and Global Forgery Analysiscited by 7
  33. 2023Diff-ID: An Explainable Identity Difference Quantification Framework for DeepFake Detectioncited by 6
  34. 2023CrossDF: Improving Cross-Domain Deepfake Detection with Deep Information Decompositioncited by 6
  35. 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
  36. 2024FakeFormer: Efficient Vulnerability-Driven Transformers for Generalisable Deepfake Detectioncited by 6
  37. 2022GOTCHA: Real-Time Video Deepfake Detection via Challenge-Responsecited by 5
  38. 2023RetouchingFFHQ: A Large-scale Dataset for Fine-grained Face Retouching Detectioncited by 5

50 most cited of 95 All 95 (JSON)