mlsanityData to 14 Oct 2026

LAMM-ViT: AI Face Detection via Layer-Aware Modulation of Region-Guided Attention

arXiv 2505.07734 ↗First posted 12 May 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Detecting AI-synthetic faces presents a critical challenge: it is hard to capture consistent structural relationships between facial regions across diverse generation techniques. Current methods, which focus on specific artifacts rather than fundamental inconsistencies, often fail when confronted with novel generative models. To address this limitation, we introduce Layer-aware Mask Modulation Vision Transformer (LAMM-ViT), a Vision Transformer designed for robust facial forgery detection. This model integrates distinct Region-Guided Multi-Head Attention (RG-MHA) and Layer-aware Mask Modulation (LAMM) components within each layer. RG-MHA utilizes facial landmarks to create regional attention masks, guiding the model to scrutinize architectural inconsistencies across different facial areas. Crucially, the separate LAMM module dynamically generates layer-specific parameters, including mask weights and gating values, based on network context. These parameters then modulate the behavior of RG-MHA, enabling adaptive adjustment of regional focus across network depths. This architecture facilitates the capture of subtle, hierarchical forgery cues ubiquitous among diverse generation techniques, such as GANs and Diffusion Models. In cross-model generalization tests, LAMM-ViT demonstrates superior performance, achieving 94.09% mean ACC (a +5.45% improvement over SoTA) and 98.62% mean AP (a +3.09% improvement). These results demonstrate LAMM-ViT's exceptional ability to generalize and its potential for reliable deployment against evolving synthetic media threats.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 38 references that are in the map. First posted on arXiv 12 May 2025.

Builds on

29 of 38 references.

References · 29

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  6. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  7. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  8. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  9. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
  10. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  11. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  12. 2023DIRE for Diffusion-Generated Image Detectioncited by 390
17 more
  1. 2021Multi-attentional Deepfake Detectioncited by 341
  2. 2022Detecting Deepfakes with Self-Blended Imagescited by 338
  3. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
  4. 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
  5. 2019On the Detection of Digital Face Manipulationcited by 260
  6. 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
  7. 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
  8. 2020Learning Self-Consistency for Deepfake Detectioncited by 179
  9. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 173
  10. 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
  11. 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
  12. 2021Are GAN generated images easy to detect? A critical analysis of the state-of-the-artcited by 139
  13. 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
  14. 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
  15. 2022FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbationscited by 75
  16. 2021BiHPF: Bilateral High-Pass Filters for Robust Deepfake Detectioncited by 60
  17. 2024AI-Face: A Million-Scale Demographically Annotated AI-Generated Face Dataset and Fairness Benchmarkcited by 28

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Distilled Transformers with Locally Enhanced Global Representations for Face Forgery Detection
  2. 2025A Dual-Branch CNN for Robust Detection of AI-Generated Facial Forgeries
  3. 2024Detecting Facial Image Manipulations with Multi-Layer CNN Models
  4. 2025Identity-Aware Vision-Language Model for Explainable Face Forgery Detection
  5. 2026ViT-FREE: Efficient Face Recognition via Early Exiting and Synthetic Adaptation
  6. 2024FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation Learning
  7. 2024GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning
  8. 2025HAMLET-FFD: Hierarchical Adaptive Multi-modal Learning Embeddings Transformation for Face Forgery Detection