mlsanityData to 7 Oct 2026

Face Transformer for Recognition

arXiv 2103.14803 ↗First posted 27 Mar 2021cs.CVcited by 45

Not on the map. Why?

Abstract (arXiv)

Recently there has been a growing interest in Transformer not only in NLP but also in computer vision. We wonder if transformer can be used in face recognition and whether it is better than CNNs. Therefore, we investigate the performance of Transformer models in face recognition. Considering the original Transformer may neglect the inter-patch information, we modify the patch generation process and make the tokens with sliding patches which overlaps with each others. The models are trained on CASIA-WebFace and MS-Celeb-1M databases, and evaluated on several mainstream benchmarks, including LFW, SLLFW, CALFW, CPLFW, TALFW, CFP-FP, AGEDB and IJB-C databases. We demonstrate that Face Transformer models trained on a large-scale database, MS-Celeb-1M, achieve comparable performance as CNN with similar number of parameters and MACs. To facilitate further researches, Face Transformer models and codes are available at https://github.com/zhongyy/Face-Transformer.

Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 27 Mar 2021.

Builds on

19 of 30 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2020End-to-End Object Detection with Transformerscited by 7,384
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  6. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  7. 2014Going Deeper with Convolutionscited by 4,231
  8. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  9. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
  10. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
  11. 2020Quantifying Attention Flow in Transformerscited by 759
  12. 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 733
7 more
  1. 2021Transformer in Transformercited by 632
  2. 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
  3. 2014Learning Face Representation from Scratchcited by 451
  4. 2017Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environmentscited by 258
  5. 2017NormFace: L2 Hypersphere Embedding for Face Verificationcited by 237
  6. 2018End-to-End Dense Video Captioning with Masked Transformercited by 214
  7. 2020Towards Transferable Adversarial Attack against Deep Face Recognitioncited by 79

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 12; 2023: 8; 2024: 8; 2025: 7; 2026: 6.

45 papers.

Sort:

By area:

  1. 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
  2. 2022GradViT: Gradient Inversion of Vision Transformerscited by 52
  3. 2023SwinFace: A Multi-task Transformer for Face Recognition, Expression Recognition, Age Estimation and Attribute Estimationcited by 38
  4. 2022Spatial-Spectral Transformer for Hyperspectral Image Denoisingcited by 34
  5. 2021Cross-Quality LFW: A Database for Analyzing Cross-Resolution Image Face Recognition in Unconstrained Environmentscited by 33
  6. 2022Spatial Transformer Network on Skeleton-based Gait Recognitioncited by 32
  7. 2024Continual Forgetting for Pre-trained Vision Modelscited by 29
  8. 2022AFR-Net: Attention-Driven Fingerprint Recognition Networkcited by 23
  9. 2023TransFace++: Rethinking the Face Recognition Paradigm with a Focus on Accuracy, Efficiency, and Securitycited by 22
  10. 2022Part-based Face Recognition with Vision Transformerscited by 18
  11. 2022Explainable Model-Agnostic Similarity and Confidence in Face Verificationcited by 13
  12. 2024TopoFR: A Closer Look at Topology Alignment on Face Recognitioncited by 13
33 more
  1. 2024LAFS: Landmark-based Facial Self-supervised Learning for Face Recognitioncited by 12
  2. 2022Minutiae-Guided Fingerprint Embeddings via Vision Transformerscited by 9
  3. 2023Cross Architecture Distillation for Face Recognitioncited by 9
  4. 2021DBIA: Data-free Backdoor Injection Attack against Transformer Networkscited by 8
  5. 2025ViT-FIQA: Assessing Face Image Quality using Vision Transformerscited by 7
  6. 2022Octuplet Loss: Make Face Recognition Robust to Image Resolutioncited by 5
  7. 2022Face Pyramid Vision Transformercited by 5
  8. 2024Mobile Contactless Palmprint Recognition: Use of Multiscale, Multimodel Embeddingscited by 5
  9. 2024Task-adaptive Q-Facecited by 5
  10. 2026FG-OrIU: Towards Better Forgetting via Feature-Gradient Orthogonality for Incremental Unlearningcited by 5
  11. 2021Learning Fair Face Representation With Progressive Cross Transformercited by 4
  12. 2022Vec2Face-v2: Unveil Human Faces from their Blackbox Features via Attention-based Network in Face Recognitioncited by 4
  13. 2023Fast and Interpretable Face Identification for Out-Of-Distribution Data Using Vision Transformerscited by 4
  14. 2024T-TAME: Trainable Attention Mechanism for Explaining Convolutional Networks and Vision Transformerscited by 4
  15. 2025Practical Continual Forgetting for Pre-trained Vision Modelscited by 4
  16. 2026ViTNT-FIQA: Training-Free Face Image Quality Assessment with Vision Transformerscited by 4
  17. 2022HiMFR: A Hybrid Masked Face Recognition Through Face Inpaintingcited by 3
  18. 2024CATFace: Cross-Attribute-Guided Transformer with Self-Attention Distillation for Low-Quality Face Recognitioncited by 3
  19. 2026FaceLiVTv2: An Improved Hybrid Architecture for Efficient Mobile Face Recognitioncited by 3
  20. 2023Dive into the Resolution Augmentations and Metrics in Low Resolution Face Recognition: A Plain yet Effective New Baselinecited by 2
  21. 2023ExtSwap: Leveraging Extended Latent Mapper for Generating High Quality Face Swappingcited by 2
  22. 2025Improved Ear Verification with Vision Transformers and Overlapping Patchescited by 2
  23. 2022Transformer-based dimensionality reductioncited by 1
  24. 2023Tackling Face Verification Edge Cases: In-Depth Analysis and Human-Machine Fusion Approachcited by 1
  25. 2023Efficient Verification-Based Face Identificationcited by 1
  26. 2024Brain-like emergent properties in deep networks: impact of network architecture, datasets and trainingcited by 1
  27. 2025Structured Context Learning for Generic Event Boundary Detectioncited by 1
  28. 2025Face Identity Unlearning for Retrieval via Embedding Dispersioncited by 1
  29. 2026BID-LoRA: A Parameter-Efficient Framework for Continual Learning and Unlearningcited by 1
  30. 2025Unified Face Matching and Physical-Digital Spoofing Attack Detectioncited by 0
  31. 2025A Responsible Face Recognition Approach for Small and Mid-Scale Systems Through Personalized Neural Networkscited by 0
  32. 2026ViT-FREE: Efficient Face Recognition via Early Exiting and Synthetic Adaptationcited by 0
  33. 2026Vision Transformers for Face Recognition Need More Registerscited by 0